 Coe grew up in Cleveland, Ohio, where his parents and sister were also involved in the art world, with his father an art collector specializing in Impressionist art as a trustee of the Cleveland Museum of Art.He earned a bachelor's degree at Oberlin College, and a master's at Yale University, both in art history.At Yale he worked for John Pope Hennessy as a research assistant.