 Goldenberg was born in Odessa, Ukraine, Russian Empire, and was Jewish.He and his family immigrated to Wisconsin in the United States when he was four years of age.His nickname, a play on "buttocks," was "Buckets."