 Burns was born in Burlington, New Jersey, of Scottish ancestry; his father claimed a relationship with poet Robert Burns.He served as an enlisted man in the War of 1812, fighting in numerous battles, including Lundy's Lane, and volunteered for both the Mexican–American War and the Civil War.He was rejected for combat duty in the latter war due to his advanced age, but he served as a teamster in support of the Union Army.