 Brookfield was born in London, the third child of Rev.William Henry Brookfield, curate of St. Luke's, Berwick Street and his wife, Jane Octavia Brookfield (née Elton), novelist, daughter of Sir Charles Elton, 6th Baronet and niece of Henry Hallam.Brookfield was named after his paternal grandfather, a solicitor.