 During World War II, Geller served in the U.S. Army Corps of Engineers (1942–45) and was inadvertently exposed to a toxic chemical agent, suffering medical consequences for the remainder of his life.Geller married Shirley Morris (a painter) in 1944.The couple lived in Northport, New York, and together had a son, Gregg Geller (formerly catalog executive at RCA, CBS and Warner Bros.) and a daughter, Jamie Geller Dutra (formerly interior designer at Loewy/Snaith).