 While he only played 16 games over 2 seasons with the Toronto Argonauts, he had a successful stint with the Toronto Balmy Beach Beachers of the Ontario Rugby Football Union, where he was selected an all-star 3 times.He finished his football career in 1959 with the Calgary Stampeders.Fisher was among the first African-American players to break the colour barrier in the CFL.