 Penniman resumed mercantile pursuits until the First National Bank of Plymouth was organized in November 1871, and he, at the age of 67, was named president.Penniman died in Plymouth, Wayne County, Michigan, on April 12, 1890 (age 86 years, 91 days).He is interred at Riverside Cemetery, Plymouth, Michigan.