 Scarbrough was an All-Southern quarterback for the Sewanee Tigers of , and captain of its team in 1905.On the dedication of Harris Stadium, one writer noted "The University of the South has numbered among its athletes some of the greatest.Anyone who played against giant Henry Phillips in 1901-1903 felt that he was nothing less than the best as guard and fullback.