 Born an illegitimate child, he was a ward of the state and raised in fostered care.In 1941, he married his first wife, Kate Challis, who died in 1989.Smith married his second wife, Margaret Forster, in 1995 and subsequently separated.