Minecraft wiki entry for Zombie_siege_defense, associated text: If there are less than two villagers remaining at any time, they will be unable to breed their numbers back up, and the village will not be viable.