sir walter occupied the little town of corfe and surrounded the castle , blocking all ways in and out , and no doubt thought that as its master , sir john bankes , was away fighting for the king , leaving only his wife in charge , it would soon fall , and he could then bring most of his troops back to defend us .