 On June 30, 1859, he married Mary Eliza Avery.They had eight children.During the Civil War, McIlhenny fled with his in-laws, the Avery family, to Texas, where he served as a civilian employee of the Confederate army, first as a clerk in a commissary office, then as a financial agent for the paymaster.