 He was born on Saint Kitts in the West Indies, the son of James Boyer Smith, who served in the house of assembly for the island.Smith came to Nova Scotia with his family in 1833.In 1849, he was called to the Nova Scotia bar.