 He was the oldest son of George Abercromby, 3rd Baron Abercromby.His mother Louisa Penuel Forbes was the daughter of the judge John Forbes, Lord Medwyn and sister of the clergyman Alexander Penrose Forbes.Abercromby succeeded his father as baron in 1852 and joined the House of Lords.