{"action":"created","issue":{"url":"https://api.github.com/repos/scrapinghub/frontera/issues/33","labels_url":"https://api.github.com/repos/scrapinghub/frontera/issues/33/labels{/name}","comments_url":"https://api.github.com/repos/scrapinghub/frontera/issues/33/comments","events_url":"https://api.github.com/repos/scrapinghub/frontera/issues/33/events","html_url":"https://github.com/scrapinghub/frontera/issues/33","id":68947728,"number":33,"title":"New DELAY_ON_EMPTY functionality on FronteraScheduler terminates crawl right at start","user":{"login":"plafl","id":6486862,"avatar_url":"https://avatars.githubusercontent.com/u/6486862?v=3","gravatar_id":"","url":"https://api.github.com/users/plafl","html_url":"https://github.com/plafl","followers_url":"https://api.github.com/users/plafl/followers","following_url":"https://api.github.com/users/plafl/following{/other_user}","gists_url":"https://api.github.com/users/plafl/gists{/gist_id}","starred_url":"https://api.github.com/users/plafl/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/plafl/subscriptions","organizations_url":"https://api.github.com/users/plafl/orgs","repos_url":"https://api.github.com/users/plafl/repos","events_url":"https://api.github.com/users/plafl/events{/privacy}","received_events_url":"https://api.github.com/users/plafl/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/scrapinghub/frontera/labels/bug","name":"bug","color":"fc2929"}],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":13,"created_at":"2015-04-16T15:24:11Z","updated_at":"2015-12-16T10:38:51Z","closed_at":null,"body":"While this is solved you can use this on your settings as a workaround:\r\n\r\n    DELAY_ON_EMPTY=0.0\r\n\r\nThe problem is in `frontera.contrib.scrapy.schedulers.FrontieraScheduler`, method `_get_next_requests`.\r\nIf there are no pending requests and the test `self._delay_next_call < time()` fails, an empty list is returned which causes the crawl to terminate"},"comment":{"url":"https://api.github.com/repos/scrapinghub/frontera/issues/comments/165061660","html_url":"https://github.com/scrapinghub/frontera/issues/33#issuecomment-165061660","issue_url":"https://api.github.com/repos/scrapinghub/frontera/issues/33","id":165061660,"user":{"login":"sibiryakov","id":9044124,"avatar_url":"https://avatars.githubusercontent.com/u/9044124?v=3","gravatar_id":"","url":"https://api.github.com/users/sibiryakov","html_url":"https://github.com/sibiryakov","followers_url":"https://api.github.com/users/sibiryakov/followers","following_url":"https://api.github.com/users/sibiryakov/following{/other_user}","gists_url":"https://api.github.com/users/sibiryakov/gists{/gist_id}","starred_url":"https://api.github.com/users/sibiryakov/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/sibiryakov/subscriptions","organizations_url":"https://api.github.com/users/sibiryakov/orgs","repos_url":"https://api.github.com/users/sibiryakov/repos","events_url":"https://api.github.com/users/sibiryakov/events{/privacy}","received_events_url":"https://api.github.com/users/sibiryakov/received_events","type":"User","site_admin":false},"created_at":"2015-12-16T10:38:51Z","updated_at":"2015-12-16T10:38:51Z","body":"With latest master changes (backend take up) and event loop halting fix in Scrapy this problem should be fixed. Anyone here to test it?"}}