 When he was eighteen years of age, he bought his indenture and moved to New York City in 1822 to pursue a career in the mercantile business.Later, Penniman moved to Orwell, Vermont, where he engaged in business as a dry-goods merchant.In 1840, he moved to Plymouth, Michigan and again engaged as a dry-goods merchant.