 Downes also owned a car dealership and a nightclub, and worked as a boxing manager, working with British title challenger Colin Lake in the late 1960s.Downes and his wife Barbara (nee Clarke) were married from 1958 until his death in 2017.They had four children and eight grandchildren, one of whom includes prominent football writer and comedian James McNicholas.