 In 1860, he married Jane Percival Cowan.Baker was elected to the House of Commons in an 1870 by-election after Brown Chamberlin resigned his seat.He served as minister without portfolio and then solicitor general in the Quebec cabinet.