 James's mother was Irish and belonged to the Butler Dynasty, an influential Old English family.She was the third daughter of Thomas Butler, Viscount Thurles and a sister of the future 1st Duke of Ormond.His parents married in 1629.