Minecraft wiki entry for Best_biomes_for_homes, associated text: Spawning in a desert is a rough time. For newer players, it is recommended to wander to another biome as staying here means accepting a great challenge when it comes to survival.
Coming to the desert to mass-collect the sand in bulk is a good idea if you need glass or sandstone.
If you find a desert and expect to need sand in the future, set up a base somewhere more habitable and come back later.