{"action":"created","issue":{"url":"https://api.github.com/repos/elastic/elasticsearch-hadoop/issues/528","labels_url":"https://api.github.com/repos/elastic/elasticsearch-hadoop/issues/528/labels{/name}","comments_url":"https://api.github.com/repos/elastic/elasticsearch-hadoop/issues/528/comments","events_url":"https://api.github.com/repos/elastic/elasticsearch-hadoop/issues/528/events","html_url":"https://github.com/elastic/elasticsearch-hadoop/issues/528","id":98412425,"number":528,"title":"Allow a higher number of partitions with an RDD","user":{"login":"costin","id":76245,"avatar_url":"https://avatars.githubusercontent.com/u/76245?v=3","gravatar_id":"","url":"https://api.github.com/users/costin","html_url":"https://github.com/costin","followers_url":"https://api.github.com/users/costin/followers","following_url":"https://api.github.com/users/costin/following{/other_user}","gists_url":"https://api.github.com/users/costin/gists{/gist_id}","starred_url":"https://api.github.com/users/costin/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/costin/subscriptions","organizations_url":"https://api.github.com/users/costin/orgs","repos_url":"https://api.github.com/users/costin/repos","events_url":"https://api.github.com/users/costin/events{/privacy}","received_events_url":"https://api.github.com/users/costin/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/elastic/elasticsearch-hadoop/labels/spark","name":"spark","color":"006b75"},{"url":"https://api.github.com/repos/elastic/elasticsearch-hadoop/labels/v2.1.2","name":"v2.1.2","color":"bfdadc"},{"url":"https://api.github.com/repos/elastic/elasticsearch-hadoop/labels/v2.2.0-m2","name":"v2.2.0-m2","color":"bfdadc"}],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":1,"created_at":"2015-07-31T15:22:00Z","updated_at":"2015-10-05T22:36:42Z","closed_at":null,"body":"When dealing with large number of documents, Spark tasks can be overwelmed by the number of documents within a shard. \r\nWhile one can re-partition the shards, it would be convenient to allow this have this built-in resulting in \"fake\" partitions that basically slice the shards into smaller bits that should be easier for Spark to digest."},"comment":{"url":"https://api.github.com/repos/elastic/elasticsearch-hadoop/issues/comments/145688891","html_url":"https://github.com/elastic/elasticsearch-hadoop/issues/528#issuecomment-145688891","issue_url":"https://api.github.com/repos/elastic/elasticsearch-hadoop/issues/528","id":145688891,"user":{"login":"mavencode01","id":542912,"avatar_url":"https://avatars.githubusercontent.com/u/542912?v=3","gravatar_id":"","url":"https://api.github.com/users/mavencode01","html_url":"https://github.com/mavencode01","followers_url":"https://api.github.com/users/mavencode01/followers","following_url":"https://api.github.com/users/mavencode01/following{/other_user}","gists_url":"https://api.github.com/users/mavencode01/gists{/gist_id}","starred_url":"https://api.github.com/users/mavencode01/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/mavencode01/subscriptions","organizations_url":"https://api.github.com/users/mavencode01/orgs","repos_url":"https://api.github.com/users/mavencode01/repos","events_url":"https://api.github.com/users/mavencode01/events{/privacy}","received_events_url":"https://api.github.com/users/mavencode01/received_events","type":"User","site_admin":false},"created_at":"2015-10-05T22:36:42Z","updated_at":"2015-10-05T22:36:42Z","body":":+1: "}}