 Frederick was the brother of another noted painter, Alfred Thomas Agate.At the age of 15, he moved to New York City to study painting under John Rubens Smith.In 1825, with his friend Thomas S. Cummings, he left Smith to study under Samuel F. B. Morse at the National Academy of Fine Arts in New York City.