the man who stood in their gun sights had led the mob the better part of the afternoon : shouting , cursing , flinging stones and pieces of brick at the unfortunate house that was number 22 , hanover square .