 Walter also suffered problems within his own family.His son Thomas, Viscount Thurles, married the daughter of Sir John Poyntz of Gloucestershire against Walter's wish, and years later, he was accidentally drowned at The Skerries, Isle of Anglesey at the beginning of Walter's long imprisonment in the Fleet Prison.Viscount Thurles was a prominent Catholic and at the time of his death, was being sent to England on charges of having garrisoned Kilkenny.