 He was defeated for re-election in 1854, and lost again in 1856.In 1860, he was again elected Representative, as a Constitutional Unionist.He took his seat in 1861, but resigned in September, due to failing health.