 As Colonel of the 5th Maryland Regiment ( Flying Camp Regiment) of the First Maryland Brigade, he participated in Battle of Harlem Heights in 1776, moved the Continental Treasury from Philadelphia to Baltimore in 1777, and fought at the Battle of Camden in 1780.In later life he also served as a Presidential Elector.Colonel Richardson High School and Colonel Richardson Middle School in Federalsburg, Maryland are named for him.