 Wearing a velvet dress, Dolley, the new First Lady, drew large crowds of admirers at the ball, while Madison described the occasion as exhausting and unpleasant.On March 4, 1809, James Madison gave his Inaugural Address and was sworn into office as the fourth president of the United States of America.He addressed the nation on how he felt.