 His siblings were Princes Peter August, August Leopold and Joseph Ferdinand.Shortly after their mother's death in 1871, Ludwig and his brothers moved to Brazil, where they lived with their maternal grandfather until a military coup d'état in 1889 abolished the monarchy, forcing the imperial family into exile.Ludwig Gaston went to Wiener Neustadt to study at the Theresian Military Academy, where he successfully graduated in 1892.