{"action":"created","issue":{"url":"https://api.github.com/repos/HazyResearch/deepdive/issues/372","labels_url":"https://api.github.com/repos/HazyResearch/deepdive/issues/372/labels{/name}","comments_url":"https://api.github.com/repos/HazyResearch/deepdive/issues/372/comments","events_url":"https://api.github.com/repos/HazyResearch/deepdive/issues/372/events","html_url":"https://github.com/HazyResearch/deepdive/issues/372","id":103883053,"number":372,"title":"PGXL parallel dump","user":{"login":"zifeishan","id":1811701,"avatar_url":"https://avatars.githubusercontent.com/u/1811701?v=3","gravatar_id":"","url":"https://api.github.com/users/zifeishan","html_url":"https://github.com/zifeishan","followers_url":"https://api.github.com/users/zifeishan/followers","following_url":"https://api.github.com/users/zifeishan/following{/other_user}","gists_url":"https://api.github.com/users/zifeishan/gists{/gist_id}","starred_url":"https://api.github.com/users/zifeishan/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/zifeishan/subscriptions","organizations_url":"https://api.github.com/users/zifeishan/orgs","repos_url":"https://api.github.com/users/zifeishan/repos","events_url":"https://api.github.com/users/zifeishan/events{/privacy}","received_events_url":"https://api.github.com/users/zifeishan/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":{"login":"feiranwang","id":5935656,"avatar_url":"https://avatars.githubusercontent.com/u/5935656?v=3","gravatar_id":"","url":"https://api.github.com/users/feiranwang","html_url":"https://github.com/feiranwang","followers_url":"https://api.github.com/users/feiranwang/followers","following_url":"https://api.github.com/users/feiranwang/following{/other_user}","gists_url":"https://api.github.com/users/feiranwang/gists{/gist_id}","starred_url":"https://api.github.com/users/feiranwang/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/feiranwang/subscriptions","organizations_url":"https://api.github.com/users/feiranwang/orgs","repos_url":"https://api.github.com/users/feiranwang/repos","events_url":"https://api.github.com/users/feiranwang/events{/privacy}","received_events_url":"https://api.github.com/users/feiranwang/received_events","type":"User","site_admin":false},"milestone":null,"comments":9,"created_at":"2015-08-29T21:09:01Z","updated_at":"2015-09-02T01:25:50Z","closed_at":null,"body":"In PostgresXL, currently there are no parallel dump support, and we are using `COPY` command to dump extractor input.\r\n\r\nOne way for parallel dump is that: if all the join tables have same distribution key, we can control individual data nodes to do local joins and dump in parallel. The datanodes can be connected in read-only mode through command line, and if there are N data nodes, the dump is essentially N times faster than single-threaded COPY.\r\n"},"comment":{"url":"https://api.github.com/repos/HazyResearch/deepdive/issues/comments/136909441","html_url":"https://github.com/HazyResearch/deepdive/issues/372#issuecomment-136909441","issue_url":"https://api.github.com/repos/HazyResearch/deepdive/issues/372","id":136909441,"user":{"login":"alldefector","id":5607717,"avatar_url":"https://avatars.githubusercontent.com/u/5607717?v=3","gravatar_id":"","url":"https://api.github.com/users/alldefector","html_url":"https://github.com/alldefector","followers_url":"https://api.github.com/users/alldefector/followers","following_url":"https://api.github.com/users/alldefector/following{/other_user}","gists_url":"https://api.github.com/users/alldefector/gists{/gist_id}","starred_url":"https://api.github.com/users/alldefector/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/alldefector/subscriptions","organizations_url":"https://api.github.com/users/alldefector/orgs","repos_url":"https://api.github.com/users/alldefector/repos","events_url":"https://api.github.com/users/alldefector/events{/privacy}","received_events_url":"https://api.github.com/users/alldefector/received_events","type":"User","site_admin":false},"created_at":"2015-09-02T01:25:50Z","updated_at":"2015-09-02T01:25:50Z","body":"@raphaelhoffmann : what throughput do you get for loading with UNLOGGED? Did you find a work-around to turn off UNLOGGED after loading?"}}