{"action":"created","issue":{"url":"https://api.github.com/repos/yatish27/salesforce_bulk_api/issues/39","labels_url":"https://api.github.com/repos/yatish27/salesforce_bulk_api/issues/39/labels{/name}","comments_url":"https://api.github.com/repos/yatish27/salesforce_bulk_api/issues/39/comments","events_url":"https://api.github.com/repos/yatish27/salesforce_bulk_api/issues/39/events","html_url":"https://github.com/yatish27/salesforce_bulk_api/issues/39","id":53969189,"number":39,"title":"Use csv format to download batches.","user":{"login":"thomasdziedzic","id":203340,"avatar_url":"https://avatars.githubusercontent.com/u/203340?v=3","gravatar_id":"","url":"https://api.github.com/users/thomasdziedzic","html_url":"https://github.com/thomasdziedzic","followers_url":"https://api.github.com/users/thomasdziedzic/followers","following_url":"https://api.github.com/users/thomasdziedzic/following{/other_user}","gists_url":"https://api.github.com/users/thomasdziedzic/gists{/gist_id}","starred_url":"https://api.github.com/users/thomasdziedzic/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/thomasdziedzic/subscriptions","organizations_url":"https://api.github.com/users/thomasdziedzic/orgs","repos_url":"https://api.github.com/users/thomasdziedzic/repos","events_url":"https://api.github.com/users/thomasdziedzic/events{/privacy}","received_events_url":"https://api.github.com/users/thomasdziedzic/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":1,"created_at":"2015-01-10T19:51:15Z","updated_at":"2015-08-15T21:44:52Z","closed_at":null,"body":"In the job file:\r\nhttps://github.com/yatish27/salesforce_bulk_api/blob/master/lib/salesforce_bulk_api/job.rb#L205\r\n\r\nYou are using xml to download batches of large data sets.\r\nThis is unideal since salesforce allows you to specify csv [0] as the type.\r\n\r\nThis would have the following pros:\r\n1. Simplifying the parsing code\r\n2. Smaller download size\r\n3. Less cpu time spent parsing\r\n4. Less memory used trying to hold the xml\r\n\r\n[0] - http://www.salesforce.com/us/developer/docs/api_asynch/\r\nunder Bulk Query -> Bulk Query Details"},"comment":{"url":"https://api.github.com/repos/yatish27/salesforce_bulk_api/issues/comments/131452011","html_url":"https://github.com/yatish27/salesforce_bulk_api/issues/39#issuecomment-131452011","issue_url":"https://api.github.com/repos/yatish27/salesforce_bulk_api/issues/39","id":131452011,"user":{"login":"hoffmanilya","id":1533384,"avatar_url":"https://avatars.githubusercontent.com/u/1533384?v=3","gravatar_id":"","url":"https://api.github.com/users/hoffmanilya","html_url":"https://github.com/hoffmanilya","followers_url":"https://api.github.com/users/hoffmanilya/followers","following_url":"https://api.github.com/users/hoffmanilya/following{/other_user}","gists_url":"https://api.github.com/users/hoffmanilya/gists{/gist_id}","starred_url":"https://api.github.com/users/hoffmanilya/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/hoffmanilya/subscriptions","organizations_url":"https://api.github.com/users/hoffmanilya/orgs","repos_url":"https://api.github.com/users/hoffmanilya/repos","events_url":"https://api.github.com/users/hoffmanilya/events{/privacy}","received_events_url":"https://api.github.com/users/hoffmanilya/received_events","type":"User","site_admin":false},"created_at":"2015-08-15T21:44:52Z","updated_at":"2015-08-15T21:44:52Z","body":"The performance gains from switching to CSV are substantial. In some simple bench marking I found that querying 25k sObjects takes ~83% less time (14s vs. 86s) and consumes ~95% less memory (29MB vs 554MB). "}}