 Charles P. Rogers was born in New York City, the second son of merchant Andrew Yelverton Rogers and Jane Phillips (born 1796, New York City, died 1874 Southold, Long Island).In 1854 Charles was married to Anna Burt.