{"action":"created","issue":{"url":"https://api.github.com/repos/elastic/elasticsearch-hadoop/issues/527","labels_url":"https://api.github.com/repos/elastic/elasticsearch-hadoop/issues/527/labels{/name}","comments_url":"https://api.github.com/repos/elastic/elasticsearch-hadoop/issues/527/comments","events_url":"https://api.github.com/repos/elastic/elasticsearch-hadoop/issues/527/events","html_url":"https://github.com/elastic/elasticsearch-hadoop/issues/527","id":98313488,"number":527,"title":"Hive queries are running very slow with where clause","user":{"login":"ashubhumca","id":644219,"avatar_url":"https://avatars.githubusercontent.com/u/644219?v=3","gravatar_id":"","url":"https://api.github.com/users/ashubhumca","html_url":"https://github.com/ashubhumca","followers_url":"https://api.github.com/users/ashubhumca/followers","following_url":"https://api.github.com/users/ashubhumca/following{/other_user}","gists_url":"https://api.github.com/users/ashubhumca/gists{/gist_id}","starred_url":"https://api.github.com/users/ashubhumca/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/ashubhumca/subscriptions","organizations_url":"https://api.github.com/users/ashubhumca/orgs","repos_url":"https://api.github.com/users/ashubhumca/repos","events_url":"https://api.github.com/users/ashubhumca/events{/privacy}","received_events_url":"https://api.github.com/users/ashubhumca/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":3,"created_at":"2015-07-31T04:18:20Z","updated_at":"2015-07-31T12:11:01Z","closed_at":null,"body":"Hi,\r\n\r\nI'm using **elasticsearch version 1.2.1 and hadoop-2**\r\nThis jar is used for the communication: elasticsearch-hadoop-2.1.1.BUILD-SNAPSHOT.jar\r\n\r\nIssue: \r\n\r\nFor query: *\"select session_id from app_sessions_prod where 1=1 limit 5;\"* I'm getting the result in 15 seconds but when I'm using any where clause (including table columns) e.g *\"select session_id from app_sessions_prod where 1=1 and session_id = '8043472_2015-05-07 06:55:24' limit 5;\"* then it is running very slow. Even after running it for hours, it is not completing.\r\n\r\nPlease help me.\r\n\r\nCould you tell me if these where cluases applied on ES itself before getting the data into Hive for further processing? For any given query, what part will execute on ES??\r\n\r\n\r\nThanks in advance,\r\n\r\nAshish"},"comment":{"url":"https://api.github.com/repos/elastic/elasticsearch-hadoop/issues/comments/126671068","html_url":"https://github.com/elastic/elasticsearch-hadoop/issues/527#issuecomment-126671068","issue_url":"https://api.github.com/repos/elastic/elasticsearch-hadoop/issues/527","id":126671068,"user":{"login":"costin","id":76245,"avatar_url":"https://avatars.githubusercontent.com/u/76245?v=3","gravatar_id":"","url":"https://api.github.com/users/costin","html_url":"https://github.com/costin","followers_url":"https://api.github.com/users/costin/followers","following_url":"https://api.github.com/users/costin/following{/other_user}","gists_url":"https://api.github.com/users/costin/gists{/gist_id}","starred_url":"https://api.github.com/users/costin/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/costin/subscriptions","organizations_url":"https://api.github.com/users/costin/orgs","repos_url":"https://api.github.com/users/costin/repos","events_url":"https://api.github.com/users/costin/events{/privacy}","received_events_url":"https://api.github.com/users/costin/received_events","type":"User","site_admin":false},"created_at":"2015-07-31T12:11:01Z","updated_at":"2015-07-31T12:11:01Z","body":"The plan has been there for a long time - unfortunately this needs to be fixed in Hive, to expose the proper hooks for external storages (like us) to plug into. Where they are available (like SparkSQL) such functionality is already available.\r\n\r\nIn other words, unless Hive exposes the proper API/hooks, there's not much we can do."}}