{"action":"created","issue":{"url":"https://api.github.com/repos/apache/spark/issues/7424","labels_url":"https://api.github.com/repos/apache/spark/issues/7424/labels{/name}","comments_url":"https://api.github.com/repos/apache/spark/issues/7424/comments","events_url":"https://api.github.com/repos/apache/spark/issues/7424/events","html_url":"https://github.com/apache/spark/pull/7424","id":95245773,"number":7424,"title":"[SPARK-9067][SQL] Close reader in NewHadoopRDD early if there is no more data","user":{"login":"viirya","id":68855,"avatar_url":"https://avatars.githubusercontent.com/u/68855?v=3","gravatar_id":"","url":"https://api.github.com/users/viirya","html_url":"https://github.com/viirya","followers_url":"https://api.github.com/users/viirya/followers","following_url":"https://api.github.com/users/viirya/following{/other_user}","gists_url":"https://api.github.com/users/viirya/gists{/gist_id}","starred_url":"https://api.github.com/users/viirya/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/viirya/subscriptions","organizations_url":"https://api.github.com/users/viirya/orgs","repos_url":"https://api.github.com/users/viirya/repos","events_url":"https://api.github.com/users/viirya/events{/privacy}","received_events_url":"https://api.github.com/users/viirya/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":44,"created_at":"2015-07-15T17:19:09Z","updated_at":"2015-07-22T05:00:15Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/apache/spark/pulls/7424","html_url":"https://github.com/apache/spark/pull/7424","diff_url":"https://github.com/apache/spark/pull/7424.diff","patch_url":"https://github.com/apache/spark/pull/7424.patch"},"body":"JIRA: https://issues.apache.org/jira/browse/SPARK-9067\r\n\r\nAccording to the description of the JIRA ticket, calling `reader.close()` only after the task is finished will cause memory and file open limit problem since these resources are occupied even we don't need that anymore.\r\n\r\nThis PR simply closes the reader early when we know there is no more data to read.\r\n"},"comment":{"url":"https://api.github.com/repos/apache/spark/issues/comments/123562675","html_url":"https://github.com/apache/spark/pull/7424#issuecomment-123562675","issue_url":"https://api.github.com/repos/apache/spark/issues/7424","id":123562675,"user":{"login":"AmplabJenkins","id":4031291,"avatar_url":"https://avatars.githubusercontent.com/u/4031291?v=3","gravatar_id":"","url":"https://api.github.com/users/AmplabJenkins","html_url":"https://github.com/AmplabJenkins","followers_url":"https://api.github.com/users/AmplabJenkins/followers","following_url":"https://api.github.com/users/AmplabJenkins/following{/other_user}","gists_url":"https://api.github.com/users/AmplabJenkins/gists{/gist_id}","starred_url":"https://api.github.com/users/AmplabJenkins/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/AmplabJenkins/subscriptions","organizations_url":"https://api.github.com/users/AmplabJenkins/orgs","repos_url":"https://api.github.com/users/AmplabJenkins/repos","events_url":"https://api.github.com/users/AmplabJenkins/events{/privacy}","received_events_url":"https://api.github.com/users/AmplabJenkins/received_events","type":"User","site_admin":false},"created_at":"2015-07-22T05:00:15Z","updated_at":"2015-07-22T05:00:15Z","body":"Merged build finished. Test PASSed."}}