{"action":"created","issue":{"url":"https://api.github.com/repos/elastic/elasticsearch-hadoop/issues/142","labels_url":"https://api.github.com/repos/elastic/elasticsearch-hadoop/issues/142/labels{/name}","comments_url":"https://api.github.com/repos/elastic/elasticsearch-hadoop/issues/142/comments","events_url":"https://api.github.com/repos/elastic/elasticsearch-hadoop/issues/142/events","html_url":"https://github.com/elastic/elasticsearch-hadoop/issues/142","id":27965271,"number":142,"title":"If possible add an example of usage with https://spark.incubator.apache.org","user":{"login":"rbraley","id":492578,"avatar_url":"https://avatars.githubusercontent.com/u/492578?v=3","gravatar_id":"","url":"https://api.github.com/users/rbraley","html_url":"https://github.com/rbraley","followers_url":"https://api.github.com/users/rbraley/followers","following_url":"https://api.github.com/users/rbraley/following{/other_user}","gists_url":"https://api.github.com/users/rbraley/gists{/gist_id}","starred_url":"https://api.github.com/users/rbraley/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/rbraley/subscriptions","organizations_url":"https://api.github.com/users/rbraley/orgs","repos_url":"https://api.github.com/users/rbraley/repos","events_url":"https://api.github.com/users/rbraley/events{/privacy}","received_events_url":"https://api.github.com/users/rbraley/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"milestone":null,"comments":21,"created_at":"2014-02-20T14:30:49Z","updated_at":"2015-08-27T14:45:39Z","closed_at":"2014-08-03T18:39:37Z","body":"It should be possible since it can use any hadoop input formats.\r\n\r\nBonus points if we can figure out how to use shark with it."},"comment":{"url":"https://api.github.com/repos/elastic/elasticsearch-hadoop/issues/comments/135456563","html_url":"https://github.com/elastic/elasticsearch-hadoop/issues/142#issuecomment-135456563","issue_url":"https://api.github.com/repos/elastic/elasticsearch-hadoop/issues/142","id":135456563,"user":{"login":"emwalker","id":760949,"avatar_url":"https://avatars.githubusercontent.com/u/760949?v=3","gravatar_id":"","url":"https://api.github.com/users/emwalker","html_url":"https://github.com/emwalker","followers_url":"https://api.github.com/users/emwalker/followers","following_url":"https://api.github.com/users/emwalker/following{/other_user}","gists_url":"https://api.github.com/users/emwalker/gists{/gist_id}","starred_url":"https://api.github.com/users/emwalker/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/emwalker/subscriptions","organizations_url":"https://api.github.com/users/emwalker/orgs","repos_url":"https://api.github.com/users/emwalker/repos","events_url":"https://api.github.com/users/emwalker/events{/privacy}","received_events_url":"https://api.github.com/users/emwalker/received_events","type":"User","site_admin":false},"created_at":"2015-08-27T14:45:39Z","updated_at":"2015-08-27T14:45:39Z","body":"@costin, any thoughts on getting the native ES integration to work in PySpark?  I see that there is a https://github.com/TargetHolding/pyspark-elastic project, but it looks like a one-off, and don't know enough yet about the relevant code to have an opinion on whether it's taking the right approach."}}