Bernstein's parents, Philip S. Bernstein, a Reform rabbi, and Sophie Rubin Bernstein named him after the biblical Jeremiah, the subject of his father's masters thesis. Philip's parents were immigrants from Lithuania, while Sophie was of Russian-Jewish descent. The family moved from Rochester to New York City during World War II, when his father became head of all the Jewish chaplains in the armed forces.