L'Enfant was born in Paris, France on August 2, 1754, the third child and second son of Pierre L'Enfant (1704 – 1787), a painter with a good reputation in the service of King Louis XV of France, (1710 - 1774, reigned 1715 - 1774), and Marie L'Enfant, the daughter of a minor official at court.