{"action":"closed","issue":{"url":"https://api.github.com/repos/DigitalPebble/storm-crawler/issues/213","labels_url":"https://api.github.com/repos/DigitalPebble/storm-crawler/issues/213/labels{/name}","comments_url":"https://api.github.com/repos/DigitalPebble/storm-crawler/issues/213/comments","events_url":"https://api.github.com/repos/DigitalPebble/storm-crawler/issues/213/events","html_url":"https://github.com/DigitalPebble/storm-crawler/issues/213","id":116345467,"number":213,"title":"[SOLR] Check that not more than one instance of the Spout exists","user":{"login":"jnioche","id":218319,"avatar_url":"https://avatars.githubusercontent.com/u/218319?v=3","gravatar_id":"","url":"https://api.github.com/users/jnioche","html_url":"https://github.com/jnioche","followers_url":"https://api.github.com/users/jnioche/followers","following_url":"https://api.github.com/users/jnioche/following{/other_user}","gists_url":"https://api.github.com/users/jnioche/gists{/gist_id}","starred_url":"https://api.github.com/users/jnioche/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jnioche/subscriptions","organizations_url":"https://api.github.com/users/jnioche/orgs","repos_url":"https://api.github.com/users/jnioche/repos","events_url":"https://api.github.com/users/jnioche/events{/privacy}","received_events_url":"https://api.github.com/users/jnioche/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/DigitalPebble/storm-crawler/labels/SOLR","name":"SOLR","color":"fbca04"}],"state":"closed","locked":false,"assignee":null,"milestone":null,"comments":1,"created_at":"2015-11-11T14:31:39Z","updated_at":"2015-11-17T13:44:46Z","closed_at":"2015-11-17T13:44:46Z","body":"Similar to what we do in [ElasticSearchSpout](https://github.com/DigitalPebble/storm-crawler/blob/master/external/elasticsearch/src/main/java/com/digitalpebble/storm/crawler/elasticsearch/persistence/ElasticSearchSpout.java#L118). Having more than one instance of the SOLR Spout would potentially send the same URLs down the topology more than once. \r\nLater on we could enforce sharding based on hostname/domain etc... and make so that there is one instance of the spout per shard. \r\n\r\n@jorgelbg what do you think?"}}