by about noon , the throng within and without the mansion had become so great that marshall greene thought it wise to clear the mansion of all but the bereaved smith family and a few of their closest friends .