 Hayward was married in 1940 to Mary Jackson, and they had a son Stuart (born in 1942) and a daughter, Sylvia (born 1951).As his career developed as a jazz pianist, as well as an arranger, Hayward became the most sought-after pianist on the island, called to play for visiting singers including Carmen McRae, Joe Williams, Sarah Vaughan, Arthur Prysock and Marvin Gaye.Hayward also formed an all-male chorus, the Mu-En Chorale.