 Many of the caves contain spectacular stalactites and stalagmites.The caves, which are located within the boundaries of what is now the national park, were first encountered in 1845 with the discovery of Blanche Cave.In 1885, the Department of Woods and Forests appointed a caretaker due to “the popularity of the caves and their vulnerability to vandalism.”

In 1916, the control of the portion of the forest reserve which contained many of the caves and which consisted of about of land was transferred from the Department of Woods and Forests to the Immigration, Publicity and Tourist Bureau who would manage it as a national pleasure resort under the "National Pleasure Resort Act 1914" until 1972.