 Clay was born in Jefferson County, Kentucky, the son of Herman H. Clay (March 1876 – February 1, 1954) and Edith E. Greathouse (December 1889 – December 30, 1972).He had a sister and four brothers, including Nathaniel Clay.Clay's paternal grandparents were John Clay and Sallie Anne Clay.