 The Culpepper family of Aylesford owned the house during the reign of King Edward III (1327–1377).The High Sheriff of Kent in 1426–27, Walter Culpeper, was the owner until the house devolved onto his heirs, eventually passing to Richard Culpeper (later Sir Richard Culpepper) who also owned the manor house at Oxon Hoath.Sir Richard Culpepper died in 1484 without issue, and the house was divided amongst his three daughters, one of whom was Joyce Culpeper—whose daughter was Catherine Howard and would become the fifth wife of King Henry VIII.