 Two years later he became lieutenant of the 34th Regiment of Foot.Father and son, both accounted "notorious womanizers", had a bitter relationship.His father once challenged Luttrell to a duel, but he declined, observing that his father was not a gentleman.