Carlsbad Caverns National Park Hidden beneath the flowering cacti, desert wildlife, and deep rocky canyons are the limestone caves, which are caused by sulfuric acid dissolution. Go play in the caves at Carlsbad Caverns and you'll start to question if you're in New Mexico at all.