 During the Second World War Harvey joined the Royal Air Force.He was seen in the eyes of the public as a national sporting idol and was given an officer rank.During this time he was persuaded to defend his titles against Freddie Mills on 20 June 1942.