{"action":"created","issue":{"url":"https://api.github.com/repos/databricks/spark-csv/issues/166","labels_url":"https://api.github.com/repos/databricks/spark-csv/issues/166/labels{/name}","comments_url":"https://api.github.com/repos/databricks/spark-csv/issues/166/comments","events_url":"https://api.github.com/repos/databricks/spark-csv/issues/166/events","html_url":"https://github.com/databricks/spark-csv/issues/166","id":111600106,"number":166,"title":"Support for pruned scan for required fields.","user":{"login":"HyukjinKwon","id":6477701,"avatar_url":"https://avatars.githubusercontent.com/u/6477701?v=3","gravatar_id":"","url":"https://api.github.com/users/HyukjinKwon","html_url":"https://github.com/HyukjinKwon","followers_url":"https://api.github.com/users/HyukjinKwon/followers","following_url":"https://api.github.com/users/HyukjinKwon/following{/other_user}","gists_url":"https://api.github.com/users/HyukjinKwon/gists{/gist_id}","starred_url":"https://api.github.com/users/HyukjinKwon/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/HyukjinKwon/subscriptions","organizations_url":"https://api.github.com/users/HyukjinKwon/orgs","repos_url":"https://api.github.com/users/HyukjinKwon/repos","events_url":"https://api.github.com/users/HyukjinKwon/events{/privacy}","received_events_url":"https://api.github.com/users/HyukjinKwon/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":1,"created_at":"2015-10-15T11:43:58Z","updated_at":"2015-10-15T17:30:52Z","closed_at":null,"body":"As I look through the codes, it looks it reads all the data without pruning by required fields, which i think might improve its performance in particular when the number of requested columns is few but the schema is huge (by io cost and etc.).\r\n\r\nI understand that the parser itself parses line by line though.\r\nIs this intentionally unimplemented for some reasons?"},"comment":{"url":"https://api.github.com/repos/databricks/spark-csv/issues/comments/148466629","html_url":"https://github.com/databricks/spark-csv/issues/166#issuecomment-148466629","issue_url":"https://api.github.com/repos/databricks/spark-csv/issues/166","id":148466629,"user":{"login":"falaki","id":512364,"avatar_url":"https://avatars.githubusercontent.com/u/512364?v=3","gravatar_id":"","url":"https://api.github.com/users/falaki","html_url":"https://github.com/falaki","followers_url":"https://api.github.com/users/falaki/followers","following_url":"https://api.github.com/users/falaki/following{/other_user}","gists_url":"https://api.github.com/users/falaki/gists{/gist_id}","starred_url":"https://api.github.com/users/falaki/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/falaki/subscriptions","organizations_url":"https://api.github.com/users/falaki/orgs","repos_url":"https://api.github.com/users/falaki/repos","events_url":"https://api.github.com/users/falaki/events{/privacy}","received_events_url":"https://api.github.com/users/falaki/received_events","type":"User","site_admin":false},"created_at":"2015-10-15T17:30:52Z","updated_at":"2015-10-15T17:30:52Z","body":"We always appreciate community contribution."}}