{"action":"created","issue":{"url":"https://api.github.com/repos/HazyResearch/deepdive/issues/379","labels_url":"https://api.github.com/repos/HazyResearch/deepdive/issues/379/labels{/name}","comments_url":"https://api.github.com/repos/HazyResearch/deepdive/issues/379/comments","events_url":"https://api.github.com/repos/HazyResearch/deepdive/issues/379/events","html_url":"https://github.com/HazyResearch/deepdive/issues/379","id":105119279,"number":379,"title":"Sequence assignment is major performance bottleneck ","user":{"login":"raphaelhoffmann","id":991789,"avatar_url":"https://avatars.githubusercontent.com/u/991789?v=3","gravatar_id":"","url":"https://api.github.com/users/raphaelhoffmann","html_url":"https://github.com/raphaelhoffmann","followers_url":"https://api.github.com/users/raphaelhoffmann/followers","following_url":"https://api.github.com/users/raphaelhoffmann/following{/other_user}","gists_url":"https://api.github.com/users/raphaelhoffmann/gists{/gist_id}","starred_url":"https://api.github.com/users/raphaelhoffmann/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/raphaelhoffmann/subscriptions","organizations_url":"https://api.github.com/users/raphaelhoffmann/orgs","repos_url":"https://api.github.com/users/raphaelhoffmann/repos","events_url":"https://api.github.com/users/raphaelhoffmann/events{/privacy}","received_events_url":"https://api.github.com/users/raphaelhoffmann/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":24,"created_at":"2015-09-06T21:58:24Z","updated_at":"2015-09-09T00:26:06Z","closed_at":null,"body":"On greenplum (raiders4), the following query is executed while running our rates extractor:\r\n\r\nSELECT fast_seqassign('rates', 0)\r\n\r\nThroughput is 2.4 MB/sec. \r\n\r\nThis means it takes alone 3h to assign IDs to the candidates, and another 3h+ (still running) to assign IDs to the features.\r\n\r\nAny ideas on how we could speed up sequence assignment?\r\n"},"comment":{"url":"https://api.github.com/repos/HazyResearch/deepdive/issues/comments/138738543","html_url":"https://github.com/HazyResearch/deepdive/issues/379#issuecomment-138738543","issue_url":"https://api.github.com/repos/HazyResearch/deepdive/issues/379","id":138738543,"user":{"login":"zhangce","id":1608867,"avatar_url":"https://avatars.githubusercontent.com/u/1608867?v=3","gravatar_id":"","url":"https://api.github.com/users/zhangce","html_url":"https://github.com/zhangce","followers_url":"https://api.github.com/users/zhangce/followers","following_url":"https://api.github.com/users/zhangce/following{/other_user}","gists_url":"https://api.github.com/users/zhangce/gists{/gist_id}","starred_url":"https://api.github.com/users/zhangce/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/zhangce/subscriptions","organizations_url":"https://api.github.com/users/zhangce/orgs","repos_url":"https://api.github.com/users/zhangce/repos","events_url":"https://api.github.com/users/zhangce/events{/privacy}","received_events_url":"https://api.github.com/users/zhangce/received_events","type":"User","site_admin":false},"created_at":"2015-09-09T00:26:06Z","updated_at":"2015-09-09T00:26:06Z","body":"@alldefector @raphaelhoffmann Sorry I am confused on this... The 2:18h number is on raiders4 that you just said the IO bandwidth is 4x lower than than raiders3?... Maybe we should do proper profiling before we jump into discussions of all those details? Let's fix the machine for you first, and then restart our discussion?"}}