If the charge build up had been positive (as it appears in some metals and semiconductors), then the V H assigned in the image would have been negative (positive charge would have built up on the left side).