Carruthers's father died when he was 12, after which his family moved to the South Side of Chicago where they stayed with relatives until he went to college. Carruthers enjoyed visiting Chicago museums, libraries, and the Adler Planetarium. After Sputnik he experimented with model rocketry, becoming a member of the junior division of the Chicago Rocket Society and various science clubs.