Minecraft wiki entry for Survival_in_an_infinite_desert, associated text: Ignore the unoccupied houses and farms at first. Leave them outside your walls or trenches initially. Later, you can include these into your defensive system.