 In 1870 he was elected to the Massachusetts Senate for the second Norfolk district.On May 27, 1875 Colburn was appointed as an Associate Justice of the Superior Court by Governor Gaston.On November 19, 1882 Colburn was appointed by Governor Long as an Associate Justice of the Massachusetts Supreme Judicial Court.