 The family is first mentioned in the town records in 1280.In 1357 Peter Colfox was commissioned by Edward III to rebuild Marshwood Castle, sold by Colfox's brother-in-law in the early 20th century.In 1394, Sir William Colfox, Vicar of Chilthorne Dommer near Yeovil, witnessed an Inquisition relating to part of the Manor of Symondsbury which Sir William Philip Colfox inherited in 1924.