 He lived at Worstead House near Norwich, Norfolk.Sole survivor of eleven children from his father Sir Berney Brograve, 1st Baronet's second marriage, he succeeded to the title and his father's estates in 1797.He was trained as a lawyer.