{"action":"created","issue":{"url":"https://api.github.com/repos/apache/spark/issues/7446","labels_url":"https://api.github.com/repos/apache/spark/issues/7446/labels{/name}","comments_url":"https://api.github.com/repos/apache/spark/issues/7446/comments","events_url":"https://api.github.com/repos/apache/spark/issues/7446/events","html_url":"https://github.com/apache/spark/pull/7446","id":95446892,"number":7446,"title":"[SPARK-9082][SQL] Filter using non-deterministic expressions should not be pushed down","user":{"login":"cloud-fan","id":3182036,"avatar_url":"https://avatars.githubusercontent.com/u/3182036?v=3","gravatar_id":"","url":"https://api.github.com/users/cloud-fan","html_url":"https://github.com/cloud-fan","followers_url":"https://api.github.com/users/cloud-fan/followers","following_url":"https://api.github.com/users/cloud-fan/following{/other_user}","gists_url":"https://api.github.com/users/cloud-fan/gists{/gist_id}","starred_url":"https://api.github.com/users/cloud-fan/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/cloud-fan/subscriptions","organizations_url":"https://api.github.com/users/cloud-fan/orgs","repos_url":"https://api.github.com/users/cloud-fan/repos","events_url":"https://api.github.com/users/cloud-fan/events{/privacy}","received_events_url":"https://api.github.com/users/cloud-fan/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":18,"created_at":"2015-07-16T14:33:50Z","updated_at":"2015-07-16T23:11:13Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/apache/spark/pulls/7446","html_url":"https://github.com/apache/spark/pull/7446","diff_url":"https://github.com/apache/spark/pull/7446.diff","patch_url":"https://github.com/apache/spark/pull/7446.patch"},"body":""},"comment":{"url":"https://api.github.com/repos/apache/spark/issues/comments/122127501","html_url":"https://github.com/apache/spark/pull/7446#issuecomment-122127501","issue_url":"https://api.github.com/repos/apache/spark/issues/7446","id":122127501,"user":{"login":"liancheng","id":230655,"avatar_url":"https://avatars.githubusercontent.com/u/230655?v=3","gravatar_id":"","url":"https://api.github.com/users/liancheng","html_url":"https://github.com/liancheng","followers_url":"https://api.github.com/users/liancheng/followers","following_url":"https://api.github.com/users/liancheng/following{/other_user}","gists_url":"https://api.github.com/users/liancheng/gists{/gist_id}","starred_url":"https://api.github.com/users/liancheng/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/liancheng/subscriptions","organizations_url":"https://api.github.com/users/liancheng/orgs","repos_url":"https://api.github.com/users/liancheng/repos","events_url":"https://api.github.com/users/liancheng/events{/privacy}","received_events_url":"https://api.github.com/users/liancheng/received_events","type":"User","site_admin":false},"created_at":"2015-07-16T23:11:13Z","updated_at":"2015-07-16T23:11:13Z","body":"@yhuai I believe expressions with UDF(s) are never pushed down in Parquet or any other data sources. Only simple comparison and string predicates dealing with constants can be pushed down. I'm double checking partition pruning."}}