in an area where the lines were so quickly being drawn over the south 's peculiar institution , it was assumed that he must be sound on the goose because he was accepting his brother 's benevolence and was using a black man 's labor to establish his home and farm .