 In October 1790 Joseph Aston married Elizabeth Preston, also of Manchester.In 1803 he opened a stationer's shop at 84 Deansgate, where on 1 January 1805 he issued the prospectus of the "Manchester Mail," published at sixpence and professing "no political creed".From 1809 till 1825 he was publisher and editor of a conservative journal, the "Manchester Exchange Herald".