 Williams and his family resided in Wellesley before relocating to Weston, where Williams and his wife lived for 43 years before he moved to the North Hill retirement community in Needham.Following the creation of the Hampshire County Historical Society in Hampshire County, West Virginia on August 29, 1959, Williams served on the society's original board of directors.After his retirement, he continued to serve as a Harvard Business School's George Gund Professor of Commercial Banking "Emeritus", and serve on boards, instruct seminars, read history, and travel.