 Defeated in his re-election bid, he returned to the Pennsylvania State House of Representatives (1824–1830; 1834 and 1835).He died on February 6, 1849 and is interred at the Saint Aloysius Cemetery in Littlestown, Pennsylvania.His son, James McSherry Jr. was a lawyer and writer best known for his "History of Maryland".