 The walls of both parts are quite high, and have been called "too tall for so small a church".Some rubble and tiles from a nearby Roman building were used in its construction; an east–west Roman road, the Sussex Greensand Way, on the lower part of the Greensand Ridge passed close to the chapel, and a large villa stood about away, near the original Buncton manor house.