 Most natural arches are formed from narrow fins and sea stacks composed of sandstone or limestone with steep, often vertical, cliff faces.The formations become narrower due to erosion over geologic time scales.The softer rock stratum erodes away creating rock shelters, or alcoves, on opposite sides of the formation beneath the relatively harder stratum, or caprock, above it.