{"action":"created","issue":{"url":"https://api.github.com/repos/binux/pyspider/issues/264","labels_url":"https://api.github.com/repos/binux/pyspider/issues/264/labels{/name}","comments_url":"https://api.github.com/repos/binux/pyspider/issues/264/comments","events_url":"https://api.github.com/repos/binux/pyspider/issues/264/events","html_url":"https://github.com/binux/pyspider/issues/264","id":101314961,"number":264,"title":"pysipder would not start scheduler and fetcher through all mode sometimes ","user":{"login":"eromoe","id":3938751,"avatar_url":"https://avatars.githubusercontent.com/u/3938751?v=3","gravatar_id":"","url":"https://api.github.com/users/eromoe","html_url":"https://github.com/eromoe","followers_url":"https://api.github.com/users/eromoe/followers","following_url":"https://api.github.com/users/eromoe/following{/other_user}","gists_url":"https://api.github.com/users/eromoe/gists{/gist_id}","starred_url":"https://api.github.com/users/eromoe/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/eromoe/subscriptions","organizations_url":"https://api.github.com/users/eromoe/orgs","repos_url":"https://api.github.com/users/eromoe/repos","events_url":"https://api.github.com/users/eromoe/events{/privacy}","received_events_url":"https://api.github.com/users/eromoe/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":1,"created_at":"2015-08-17T01:00:02Z","updated_at":"2015-09-06T19:34:54Z","closed_at":null,"body":"It first get a error while starting scheduler , \r\n```\r\n[E 150818 16:52:11 scheduler:485] 'NoneType' object has no attribute 'full'\r\n    Traceback (most recent call last):\r\n      File \"C:\\Python27\\lib\\site-packages\\pyspider-0.3.6-py2.7.egg\\pyspider\\scheduler\\scheduler.py\", line 480, in run\r\n        self.run_once()\r\n      File \"C:\\Python27\\lib\\site-packages\\pyspider-0.3.6-py2.7.egg\\pyspider\\scheduler\\scheduler.py\", line 469, in run_on\r\nce\r\n        self._check_select()\r\n      File \"C:\\Python27\\lib\\site-packages\\pyspider-0.3.6-py2.7.egg\\pyspider\\scheduler\\scheduler.py\", line 346, in _check\r\n_select\r\n        if self.out_queue.full():\r\n    AttributeError: 'NoneType' object has no attribute 'full'\r\n```\r\n\r\nthen, I restart cmd, run\r\n```\r\nE:\\Project\\test_spider>pyspider -c config.json\r\nWeb server running on port 25555\r\n[I 150817 08:53:42 result_worker:49] result_worker starting...\r\n[I 150817 08:53:42 processor:213] processor starting...\r\n[I 150817 08:53:42 app:65] webui running on http://0.0.0.0:5000/\r\n```\r\nscheduler  and fetcher not start\r\n\r\n------------------\r\nsometimes this error:\r\n```\r\n[E 150817 11:35:20 scheduler:480] 'NoneType' object has no attribute 'put_nowait'\r\n    Traceback (most recent call last):\r\n      File \"C:\\Python27\\lib\\site-packages\\pyspider-0.3.6-py2.7.egg\\pyspider\\scheduler\\scheduler.py\", line 475, in run\r\n        self.run_once()\r\n      File \"C:\\Python27\\lib\\site-packages\\pyspider-0.3.6-py2.7.egg\\pyspider\\scheduler\\scheduler.py\", line 459, in run_on\r\nce\r\n        self._update_projects()\r\n      File \"C:\\Python27\\lib\\site-packages\\pyspider-0.3.6-py2.7.egg\\pyspider\\scheduler\\scheduler.py\", line 89, in _update\r\n_projects\r\n        self._update_project(project)\r\n      File \"C:\\Python27\\lib\\site-packages\\pyspider-0.3.6-py2.7.egg\\pyspider\\scheduler\\scheduler.py\", line 121, in _updat\r\ne_project\r\n        'callback': '_on_get_info',\r\n      File \"C:\\Python27\\lib\\site-packages\\pyspider-0.3.6-py2.7.egg\\pyspider\\scheduler\\scheduler.py\", line 747, in on_sel\r\nect_task\r\n        self.send_task(task)\r\n      File \"C:\\Python27\\lib\\site-packages\\pyspider-0.3.6-py2.7.egg\\pyspider\\scheduler\\scheduler.py\", line 202, in send_t\r\nask\r\n        self.out_queue.put_nowait(task)\r\n    AttributeError: 'NoneType' object has no attribute 'put_nowait'\r\n```\r\n\r\n--------------------------------\r\n\r\nthis error and unknown project#248  gone after I delete some tasks from taskdb"},"comment":{"url":"https://api.github.com/repos/binux/pyspider/issues/comments/138117443","html_url":"https://github.com/binux/pyspider/issues/264#issuecomment-138117443","issue_url":"https://api.github.com/repos/binux/pyspider/issues/264","id":138117443,"user":{"login":"binux","id":646451,"avatar_url":"https://avatars.githubusercontent.com/u/646451?v=3","gravatar_id":"","url":"https://api.github.com/users/binux","html_url":"https://github.com/binux","followers_url":"https://api.github.com/users/binux/followers","following_url":"https://api.github.com/users/binux/following{/other_user}","gists_url":"https://api.github.com/users/binux/gists{/gist_id}","starred_url":"https://api.github.com/users/binux/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/binux/subscriptions","organizations_url":"https://api.github.com/users/binux/orgs","repos_url":"https://api.github.com/users/binux/repos","events_url":"https://api.github.com/users/binux/events{/privacy}","received_events_url":"https://api.github.com/users/binux/received_events","type":"User","site_admin":false},"created_at":"2015-09-06T19:34:54Z","updated_at":"2015-09-06T19:34:54Z","body":"in `all` mode, the components of pyspider are started in subprocess or threads, which work different as it in *nux. (Specifically, global value would not be shared between processes under windows platform. This issue is the one that I knew) As I don't have a windows environment, I suggest using linux/OSX environment."}}