 In 1920 he married Else Heyerdahl (1899–1985), and had Hieronymus Heyerdahl as a father-in-law.He died in January 1978 in Oslo.Olaf Ditlev-Simonsen practised different sports in the club IF Ready, and, partly together with his four brothers, he won several Norwegian championships in bandy.