 He lost to hard hitting Jack McGee in Boston on December 19, 1884 in a fast second round knockout before a crowd of around 100.Both contestants were Boston natives, though McGee was four years older.After this rare knockout loss, Duffy lost only once more in his career.