How big is the Terraria map? It's a complicated ... it will strengthen enemies, including the appearance of Desert Spirits. Removing the background wall will remove the biome's effects.

Terraria has a pretty straightforward progression ... between life and death when you accidentally encounter a swarm of enemies, so you should always have a stack of them on you.