 Amberg was born in the Russian Empire into a Jewish family, the fifth of eight children born to Charles and Rose Amberg ("née" Mindelwitz).The family immigrated to New York in 1904.In 1910, the father's occupation was listed as a peddler.