 The eldest son of George Nevill, 17th Baron Bergavenny and his wife Henrietta Pelham, he was born on 22 February 1755 and baptized on 19 March 1755 at St George's, Hanover Square.Nevill matriculated at Christ Church, Oxford on 29 May 1773, and took his MA from there on 8 March 1776.He married Mary Robinson (c.1760–1796), daughter of John Robinson, on 3 October 1781, and they had the following children