 An interest in theater drew him to New York City in 1886, and there he married Jessie Gregg on July 23, 1891; the two then returned to California for four more years, during which time Kelley composed, conducted, lectured, and taught.In 1896 the couple returned to New York, where Edgar was hired to conduct an operetta company.He also taught, at the New York College of Music and New York University, and in 1901 replaced Horatio Parker for a year at Yale when the latter went on sabbatical.