 Billy and Bobby were born in Peoria, Illinois, to Felix, an employee of the Toledo, Peoria & Western Railroad and his wife, Marguerite (née Burley).Billy was older than Bobby by ten minutes.They began singing and acting in radio at the age of seven and later appeared in print advertisements before signing a contract with Warner Bros.

After moving with their mother to Hollywood in 1935, Billy was cast as the young title character in the film "Anthony Adverse" because he resembled Fredric March, who was to play Adverse as an adult.