 Benjamin Davis and his five younger brothers became wards of an uncle William Taylor who lived in Monroe County, Mississippi.Davis was appointed from Mississippi to the United States Military Academy at West Point, New York, graduating in 1854.Among his classmates were Jeb Stuart, Stephen H. Weed, Oliver Otis Howard and William Dorsey Pender.