 Frey was born in Rutherford, New Jersey, the son of Mildred (Engel) and Louis Frey.He graduated in 1951 from Rutherford High School, and received a B.A.in 1955 from Colgate University in Hamilton, New York.