 His second wife was Lucy Courthorpe, daughter of Sir Peter Courthorpe of County Cork, by whom he had his second son and heir Alan, 2nd Viscount Midleton.He married thirdly Anne Hill, daughter of Sir John Trevor, Master of the Rolls, and Jane Mostyn, and widow of Michael Hill.Midleton was acknowledged by all who knew him to be a man of great talent and intelligence, but he was also arrogant, hot-tempered and violent in speech.