 In 1962 after a failed attempt to come back into politics, he went to live quietly at Shiwa with his daughter and son-in-law, Lorna and John Harvey (who managed the estate), and his four grand children, Penelope, Charles, Mark and David.Lady Gore-Browne, still living in England made occasional long visits to Shiwa.Their second daughter, Angela, married with two daughters, Karen and Miranda, had moved to Kenya where she lectured at the Royal College in Nairobi.