My Python scripts running on AWS download the HTML of the front pages for all 10 sites twice per day, at 6:30 a.m. and 11 a.m., and also grab an image of the front page with PhantomJS and Selenium which I then resize to a thumbnail.