{"push_id":724459374,"size":1,"distinct_size":1,"ref":"refs/heads/master","head":"1eb43480b93e3759ec33b0563440c1367d5f94c6","before":"3b42dc6b6f24863557813c9dc1bdf4a17f7ecab6","commits":[{"sha":"1eb43480b93e3759ec33b0563440c1367d5f94c6","author":{"email":"0b5ba7619f4884da7f61e9f0d00ee7e8c420d729@gmail.com","name":"rushdishams"},"message":"v-8.0.0: (1) snl.com and sec.gov are not longer positive websites, (2) Refactored shouldVisit() method for inserting urls in the set data structure, (3) PDF pattern filter is taken out because it is not helping, (4) .js extension is removed from the filters. However, this should not enable the crawler to overcome its deficit to crawl javascript pages.","distinct":true,"url":"https://api.github.com/repos/rushdishams/CrawlerSource/commits/1eb43480b93e3759ec33b0563440c1367d5f94c6"}]}