 As an Australian rules footballer, Harley played for Brunswick in the Victorian Football Association (VFA).He trained with VFL clubs Carlton and North Melbourne.Harley, who joined the Victorian Police Force in 1935, retired from boxing in 1939 after winning 93 out of 100 bouts.