 Despite this embarrassing defeat, Belfast Celtic's manager, Elisha Scott (a former goalkeeper), signed Kelly in the summer of 1941 to replace Tommy Breen.Whilst with the Celtic Park club, Kelly claimed two Irish Cup winner's medals with victories over Glentoran in 1943 (1–0) and Linfield in 1944 (3–1).Kelly may have claimed more honours but a contractual dispute left him on the side-lines for some time.