 He did not seek reelection in 1866, and was replaced by fellow Republican Daniel Polsley.In 1868, he served as collector of customs at Brazos de Santiago, Texas.Whaley died in Point Pleasant, West Virginia on May 20, 1876 and was interred in Lone Oak Cemetery in Point Pleasant.