 With the help of fellow monks and local masons, he succeeded in building 'Llanthony Tertia', where an eccentric version of monastic life – witnessed by Francis Kilvert – continued till his death in 1908.Lyne is buried in the monastery church which, being poorly built and subsequently neglected, is now partly ruined.A memorial trust exists to restore the church and an annual pilgrimage is held between Llanthony Priory and Capel-y-ffin.