 In the 1880s the church was described as being "ancient, plain, and good, with a tower; and contains a few brasses and monuments".In April 2015, North Hertfordshire District Council announced that a Roman copper-alloy jug had been discovered in a field in Kelshall by a metal detectorist in late 2014.A subsequent archaeological dig found a Roman grave, which contained a number of other artefacts believed to date to between 205 and 215AD, including a silver denarius of Trajan, three 2nd century copper-alloy coins, a quantity of Roman glass, including bottles, glasses and two polychrome dishes thought to have been made in Roman Alexandria.