Carruthers was born October 1, 1939, in Cincinnati, Ohio, to George and Sophia Carruthers. Carruthers was the eldest of four children. His father was a civil engineer with the Army Corps of Engineers and his mother was a homemaker. When Carruthers was young the family lived in the Evanston neighborhood before moving to Milford, Ohio.