 Jefferson rode to the Capitol on horseback on March 4, 1805, but much of Congress had already left after the body had adjourned following Burr's farewell address before the Senate a couple days earlier.Thus the inaugural ceremony was modest and appeared anticlimactic.The president spoke softly and quietly, as he was known for, and provided copies of his inaugural address.