 His parents were Leonard R. Swinney and Ethel Bertheaud Swinney.In 1967 Harry Swinney married Gloria T. Luyas, and in 1978 they had a son, Brent Luyas Swinney.Brent died of cancer in 1995 and Gloria died of cancer in 1997.