 Garnett was born at Marple, Cheshire and educated at Charterhouse School at Godalming, Surrey, and studied classics at Magdalene College, Cambridge.He began his teaching career at Westminster School, London, and then returned to Charterhouse to teach classics.During the Second World War he served in the RAF Regiment in India and Burma.