 After his major league appearances, Stafford played in the minor leagues until 1898, including seasons in the New England League and the Western League.His older brother was James Joseph "General" Stafford, who played in the major leagues between 1890 and 1899.Stafford became known as "Doc" after his playing career, when he became an optometrist in his hometown of Dudley, Massachusetts.