{"action":"created","issue":{"url":"https://api.github.com/repos/scrapinghub/scrapylib/issues/35","labels_url":"https://api.github.com/repos/scrapinghub/scrapylib/issues/35/labels{/name}","comments_url":"https://api.github.com/repos/scrapinghub/scrapylib/issues/35/comments","events_url":"https://api.github.com/repos/scrapinghub/scrapylib/issues/35/events","html_url":"https://github.com/scrapinghub/scrapylib/pull/35","id":23643478,"number":35,"title":"proposed deprecation and merge of  scrapinghub/scmongo","user":{"login":"nyov","id":438293,"avatar_url":"https://avatars.githubusercontent.com/u/438293?v=3","gravatar_id":"","url":"https://api.github.com/users/nyov","html_url":"https://github.com/nyov","followers_url":"https://api.github.com/users/nyov/followers","following_url":"https://api.github.com/users/nyov/following{/other_user}","gists_url":"https://api.github.com/users/nyov/gists{/gist_id}","starred_url":"https://api.github.com/users/nyov/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/nyov/subscriptions","organizations_url":"https://api.github.com/users/nyov/orgs","repos_url":"https://api.github.com/users/nyov/repos","events_url":"https://api.github.com/users/nyov/events{/privacy}","received_events_url":"https://api.github.com/users/nyov/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"milestone":null,"comments":24,"created_at":"2013-12-03T13:52:21Z","updated_at":"2015-08-19T11:23:50Z","closed_at":"2015-08-19T07:44:29Z","pull_request":{"url":"https://api.github.com/repos/scrapinghub/scrapylib/pulls/35","html_url":"https://github.com/scrapinghub/scrapylib/pull/35","diff_url":"https://github.com/scrapinghub/scrapylib/pull/35.diff","patch_url":"https://github.com/scrapinghub/scrapylib/pull/35.patch"},"body":"I believe this project might escape some bitrot by inclusion into scrapylib.\r\n\r\nSince there are so many different scrapy+mongodb projects around now, I thought a rename might be in order but feel free to ignore/change the last commit."},"comment":{"url":"https://api.github.com/repos/scrapinghub/scrapylib/issues/comments/132552809","html_url":"https://github.com/scrapinghub/scrapylib/pull/35#issuecomment-132552809","issue_url":"https://api.github.com/repos/scrapinghub/scrapylib/issues/35","id":132552809,"user":{"login":"nyov","id":438293,"avatar_url":"https://avatars.githubusercontent.com/u/438293?v=3","gravatar_id":"","url":"https://api.github.com/users/nyov","html_url":"https://github.com/nyov","followers_url":"https://api.github.com/users/nyov/followers","following_url":"https://api.github.com/users/nyov/following{/other_user}","gists_url":"https://api.github.com/users/nyov/gists{/gist_id}","starred_url":"https://api.github.com/users/nyov/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/nyov/subscriptions","organizations_url":"https://api.github.com/users/nyov/orgs","repos_url":"https://api.github.com/users/nyov/repos","events_url":"https://api.github.com/users/nyov/events{/privacy}","received_events_url":"https://api.github.com/users/nyov/received_events","type":"User","site_admin":false},"created_at":"2015-08-19T11:23:49Z","updated_at":"2015-08-19T11:23:49Z","body":"thanks.\r\n\r\nAnd a Project Request? (Sorry to abuse the dead thread)\r\nBecause I would love to see scrapy-independent HTTP caches.\r\n\r\nSadly I have yet to find a perfect extensible and hackable application proxy not geared to reverse caching. Polipo, Privoxy, Squid, mitmproxy, Zorp, ... none look quite right to me :(\r\n\r\nI think a standalone proxy with scrapy's httpcache plus modular extension support could be amazing (and keeping it embeddable as well, it would be an elsewhere reuseable DownloaderMiddlewares system).\r\n\r\nI could envision extensions for anything from adblocking, privoxy-filter rules, https certificate checking / safebrowsing to tiered caching, memento/google cache lookups and more.\r\n\r\nAnd with a bigger userbase, more contributors, everyone would benefit?"}}