 Jaffee competed again at the 1932 Winter Olympics in Lake Placid, New York.At the time, Jaffee recalled, there were signs in Lake Placid that said "No dogs or Jews allowed".There, he won gold medals in both the 5,000 and 10,000-meter races.