 In 1861 he joined the 6th Massachusetts Militia as a Major, and he was soon named commander with the rank of Colonel.He led the organization on its famed march through Baltimore, which sparked the first bloodshed of the American Civil War.His troops traveled onward and helped with the defense of Washington, D.C.

Jones later recruited and commanded the 26th Massachusetts Infantry.