 Letcher first married Susan Oden Epps.Epps died on March 9, 1816 and did not bear any children.Following the death of his first wife, Letcher married Charlotte Robertson, sister of George Robertson, a congressman and future chief justice of the Kentucky Court of Appeals.