 Gersh was born in New York City to poor Russian Jewish immigrant parents, Ida and Louis Gershowitz.His parents owned a deli on 25th and 9th Avenue.When Gersh was 8 or 9 years old, his family moved to Washington Heights and opened a restaurant there.