 On 15 November 1815, Emperor Francis I of Austria awarded him the title of "Fürst von Koháry de Csábrág et Szitnya".He was the son of Ignác József Anton Franz Xaver, Count Koháry de Csábrág et Szitnya (Szent-Antal, 2 December 1726 – Vienna, 10 October 1777) and his wife, Countess Maria Gabriella Cavriani di Imena (Vienna, 25 April 1736 – Pest, 29 July 1803), who were married at Seiffersdorf on 15 January 1758.On 13 February 1792, he married Countess Maria Antonia of Waldstein-Wartenberg in Vienna.