 In 1942, Emery married dancer Tamara Geva, divorcing in 1963.Emery had started a long-term relationship with actress Joan Bennett in 1961, who cared for him through his final illness and death in 1964.Due to their resemblance, Emery often was rumoured to be the illegitimate child of John Barrymore.