On Karpathos, you can walk from the traditional settlement of Olimbos to the shrine of St. John in the north of the island.
Olimbos is very crowded and you have to plan way ahead to be able to travel there.