{"action":"created","issue":{"url":"https://api.github.com/repos/raawaa/jav-scrapy/issues/5","labels_url":"https://api.github.com/repos/raawaa/jav-scrapy/issues/5/labels{/name}","comments_url":"https://api.github.com/repos/raawaa/jav-scrapy/issues/5/comments","events_url":"https://api.github.com/repos/raawaa/jav-scrapy/issues/5/events","html_url":"https://github.com/raawaa/jav-scrapy/issues/5","id":115035746,"number":5,"title":"未处理完当前页影片就开始处理下一页的影片","user":{"login":"raawaa","id":8319722,"avatar_url":"https://avatars.githubusercontent.com/u/8319722?v=3","gravatar_id":"","url":"https://api.github.com/users/raawaa","html_url":"https://github.com/raawaa","followers_url":"https://api.github.com/users/raawaa/followers","following_url":"https://api.github.com/users/raawaa/following{/other_user}","gists_url":"https://api.github.com/users/raawaa/gists{/gist_id}","starred_url":"https://api.github.com/users/raawaa/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/raawaa/subscriptions","organizations_url":"https://api.github.com/users/raawaa/orgs","repos_url":"https://api.github.com/users/raawaa/repos","events_url":"https://api.github.com/users/raawaa/events{/privacy}","received_events_url":"https://api.github.com/users/raawaa/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/raawaa/jav-scrapy/labels/bug","name":"bug","color":"fc2929"}],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":2,"created_at":"2015-11-04T11:47:25Z","updated_at":"2015-11-04T16:33:59Z","closed_at":null,"body":"当待处理影片小于当前页面影片数时，如果获取磁链或封面时出现网络请求错误，会直接跳过当前页面直接抓取下一页的影片。\r\n\r\n例如：`jav -l 2`，首先会抓取第一页的两部影片，如果其中一部影片抓取出错，会直接结束本页处理，开始抓取下一页的两部影片。\r\n\r\n```\r\n========== 获取资源站点：http://www.javbus.in ==========\r\n并行连接数： 2        连接超时设置： 1 秒\r\n磁链保存位置:  /home/raawaa/magnets.txt\r\n获取第1页中的影片链接 ( http://www.javbus.in )...\r\n正处理以下番号影片...\r\nHIHL-012,INBA-004\r\n===== 第1页处理完毕 =====\r\n\r\n获取第2页中的影片链接 ( http://www.javbus.in/page/2 )...\r\n正处理以下番号影片...\r\nHVG-021,RABS-015\r\n总进度(1/2): [=========================-------------------------]\r\n===== 第2页处理完毕 =====\r\n\r\n获取第3页中的影片链接 ( http://www.javbus.in/page/3 )...\r\n正处理以下番号影片...\r\nRBD-724,RBD-721\r\n总进度(2/2): [==================================================]\r\n已抓取2个磁链，本次抓取完毕，等待其他爬虫回家...\r\n```\r\n\r\n导致了许多影片没有被抓取，直接被跳过了\r\n"},"comment":{"url":"https://api.github.com/repos/raawaa/jav-scrapy/issues/comments/153784698","html_url":"https://github.com/raawaa/jav-scrapy/issues/5#issuecomment-153784698","issue_url":"https://api.github.com/repos/raawaa/jav-scrapy/issues/5","id":153784698,"user":{"login":"qiusli","id":7484601,"avatar_url":"https://avatars.githubusercontent.com/u/7484601?v=3","gravatar_id":"","url":"https://api.github.com/users/qiusli","html_url":"https://github.com/qiusli","followers_url":"https://api.github.com/users/qiusli/followers","following_url":"https://api.github.com/users/qiusli/following{/other_user}","gists_url":"https://api.github.com/users/qiusli/gists{/gist_id}","starred_url":"https://api.github.com/users/qiusli/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/qiusli/subscriptions","organizations_url":"https://api.github.com/users/qiusli/orgs","repos_url":"https://api.github.com/users/qiusli/repos","events_url":"https://api.github.com/users/qiusli/events{/privacy}","received_events_url":"https://api.github.com/users/qiusli/received_events","type":"User","site_admin":false},"created_at":"2015-11-04T16:33:59Z","updated_at":"2015-11-04T16:33:59Z","body":"I'll fix it this evening, sorry about that"}}