 He was born on January 25, 1891, on the Lower East Side of New York City, the grandson of Rabbi Jacob Joseph.Lazarus remained a Shomer Shabbos Jew even as a high ranking politician, and as City Comptroller campaigned for the Kosher Meat Laws in New York City.Lazarus graduated from New York University School of Law in 1912, and practiced in New York City.