 Taylor was himself one of three sons and four daughters.His older brother, Thomas Edward, born in 1811, joined the 6th Dragoon Guards, while his younger brother, Hercules Langford Barry, born in 1824, died in 1833.Their sisters were Marianne Jane (born 1809), Elizabeth Augusta Anne (1812), Louisa Catherine (1815) and Henrietta Frances (1817).