 Born in St. George's Rectory, Montreal, he was the oldest son of Edward Sullivan and Frances Mary Renaud.In 1869, his father became rector of Trinity Church, Chicago.The family lived to the city in 1871, and thus witnessed the Great Chicago Fire.