 In later years, Williams grew bitter about his sporting experiences, culminating in being the only living Canadian Olympic gold medalist who refused the federal government's invitation to the 1976 Summer Olympics in Montreal.In 1979, he was made an Officer of the Order of Canada.Williams, who never married, stayed with his mother until her death in 1980, at the age of 92.