 His mother was Edward's wife Lady Lucy Graham, third daughter of James Graham, 3rd Duke of Montrose.He was educated at Eton and the Royal Military College, Sandhurst.Herbert was made an ensign in the 43rd (Monmouthshire) Light Infantry in January 1840, serving with them in the war on the Xhosa (1851–53), the Orange River Boers expedition, and the battle of Berea.