 After retiring in 1904 Foster and his family moved to Rickmansworth in the Hertfordshire countryside, where he became a justice of the peace and took an active interest in Liberal Party politics.Foster developed congestion of the lungs in January 1919 and died of heart failure at his home, Ladywalk, Long Lane, Rickmansworth.He was buried next to his wife in the cemetery at Rickmansworth.