 He was also a trustee and treasurer of The Clinton Hall Association, and governor of the New York Woman's Hospital.He was a member of Delta Kappa Epsilon, Down Town Association, Jekyll Island Club, Merchants Club of New York, Metropolitan Club of New York, New England Society, New York Yacht Club, Players Club of New York, Republican Club of New York, Riding Club of New York, Seawanhaka Corinthian Yacht Club, Skull and Bones, South Side Sportsmen's Club, Union League Club of New York and the Whist Club of New York.In 1898, Borden's steam yacht named "Sovereign" was acquired by the United States Navy and renamed the USS Scorpion, serving the Navy until 1929.