 When he was two, his family moved to the growing town of Litchfield, Connecticut.Although the son of a prosperous farmer, Stone ventured off on his own as a merchant.Stone married his first wife, Leah Moore, in 1780.