 Amherst's mother was Mary, daughter of Andrew Fountaine, of Narford Hall, Norfolk.In 1852, he and his father assumed by Royal licence the surname of Tyssen-Amhurst.However, in 1877 he again changed it, to Tyssen-Amherst, also by Royal licence.