 In 1874 Oakley Court was sold to Lord Otho FitzGerald, then to a John Lewis Phipps and in 1900 to Sir William Beilby Avery of Avery Scales.In 1919 Ernest Olivier purchased the property together with of Berkshire woodland for £27,000.Richard Hall-Say built Oakley Court in 1859 two years after his marriage.