 He was appointed to the post of Surveyor-General of the Ordnance, holding it along with his parliamentary seat until his death at a relatively young age in 1788.Luttrell was born at Four Oaks, Warwickshire c. 1751, the youngest surviving son of Simon Luttrell, 1st Earl of Carhampton and his wife, Judith Maria Lawes.The Luttrells were a significant political family, with James's father sitting as member of parliament for several constituencies, and his brothers Henry, John and Temple Simon all sitting in parliament, while Henry and John in turn inherited their father's earldom.