 William was the eldest surviving son of eleven children born to William Irving Sr. (1731–1807), originally of Quholm, Shapinsay, Orkney, Scotland, and Sarah (née Sanders) Irving (1738–1817).Among his surviving siblings were four brothers and three sisters, including