 He was hated by Louis XVI's two surviving brothers, particularly by the comte d'Artois.Breteuil was allowed to return to France in 1802 by Napoleon Bonaparte, having made his peace with the First French Empire.He tried to urge other Royalists to join him, but he was largely unsuccessful.