Minecraft wiki entry for Multiplayer_PvP_bases, associated text: Material for building transport is difficult (you have to teleport a lot of times).
You might fall in the void.
Endermen might pick blocks off your base walls.