{"action":"created","comment":{"url":"https://api.github.com/repos/uwescience/raco/pulls/comments/38874685","id":38874685,"diff_hunk":"@@ -643,6 +656,9 @@ def __repr__(self):\n         return \"{op}({inp!r}, {hc!r})\".format(op=self.opname(), inp=self.input,\n                                               hc=self.hash_columns)\n \n+    def partitioning(self):","path":"raco/language/myrialang.py","position":52,"original_position":52,"commit_id":"14cb42169762b1eed7d7a709b7f9423d329506fc","original_commit_id":"14cb42169762b1eed7d7a709b7f9423d329506fc","user":{"login":"bmyerz","id":1979690,"avatar_url":"https://avatars.githubusercontent.com/u/1979690?v=3","gravatar_id":"","url":"https://api.github.com/users/bmyerz","html_url":"https://github.com/bmyerz","followers_url":"https://api.github.com/users/bmyerz/followers","following_url":"https://api.github.com/users/bmyerz/following{/other_user}","gists_url":"https://api.github.com/users/bmyerz/gists{/gist_id}","starred_url":"https://api.github.com/users/bmyerz/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/bmyerz/subscriptions","organizations_url":"https://api.github.com/users/bmyerz/orgs","repos_url":"https://api.github.com/users/bmyerz/repos","events_url":"https://api.github.com/users/bmyerz/events{/privacy}","received_events_url":"https://api.github.com/users/bmyerz/received_events","type":"User","site_admin":false},"body":"see above","created_at":"2015-09-07T17:22:09Z","updated_at":"2015-09-07T17:22:09Z","html_url":"https://github.com/uwescience/raco/pull/467#discussion_r38874685","pull_request_url":"https://api.github.com/repos/uwescience/raco/pulls/467","_links":{"self":{"href":"https://api.github.com/repos/uwescience/raco/pulls/comments/38874685"},"html":{"href":"https://github.com/uwescience/raco/pull/467#discussion_r38874685"},"pull_request":{"href":"https://api.github.com/repos/uwescience/raco/pulls/467"}}},"pull_request":{"url":"https://api.github.com/repos/uwescience/raco/pulls/467","id":42610293,"html_url":"https://github.com/uwescience/raco/pull/467","diff_url":"https://github.com/uwescience/raco/pull/467.diff","patch_url":"https://github.com/uwescience/raco/pull/467.patch","issue_url":"https://api.github.com/repos/uwescience/raco/issues/467","number":467,"state":"open","locked":false,"title":"proposed design for partitioning info in Raco","user":{"login":"bmyerz","id":1979690,"avatar_url":"https://avatars.githubusercontent.com/u/1979690?v=3","gravatar_id":"","url":"https://api.github.com/users/bmyerz","html_url":"https://github.com/bmyerz","followers_url":"https://api.github.com/users/bmyerz/followers","following_url":"https://api.github.com/users/bmyerz/following{/other_user}","gists_url":"https://api.github.com/users/bmyerz/gists{/gist_id}","starred_url":"https://api.github.com/users/bmyerz/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/bmyerz/subscriptions","organizations_url":"https://api.github.com/users/bmyerz/orgs","repos_url":"https://api.github.com/users/bmyerz/repos","events_url":"https://api.github.com/users/bmyerz/events{/privacy}","received_events_url":"https://api.github.com/users/bmyerz/received_events","type":"User","site_admin":false},"body":"Proposing to add interesting orders to the scheme rather than the catalog. The reason is that we would like to track interesting orders at the operator granularity and every operator already has a scheme\r\n\r\n__WIP__\r\n- [x] design agreed upon\r\n- [ ] @bmyerz make catalog create schema with interesting orders\r\n- [ ] @senderista update myria catalog interface to get myria's catalog partition info (note that the myria catalog interface is buried in another unmerged branch https://github.com/uwescience/raco/blob/raco_only_execution/raco/backends/myria/catalog.py part of PR #450 )\r\n- [x] @bmyerz operators propagate partition info from Shuffle/(or radish HashJoin) to store\r\n- [ ] @senderista myriax store `compileme` to json needs to include partitioning info\r\n- [x] @bmyerz rule to omit a shuffle when relations are co-partitioned\r\n- [ ] tests\r\n\r\nWe can be conservative and add more rules after this PR.","created_at":"2015-08-17T17:00:57Z","updated_at":"2015-09-07T17:22:09Z","closed_at":null,"merged_at":null,"merge_commit_sha":"6f9e6222da0d0e8859333fbf193e2732d6df551c","assignee":{"login":"senderista","id":131425,"avatar_url":"https://avatars.githubusercontent.com/u/131425?v=3","gravatar_id":"","url":"https://api.github.com/users/senderista","html_url":"https://github.com/senderista","followers_url":"https://api.github.com/users/senderista/followers","following_url":"https://api.github.com/users/senderista/following{/other_user}","gists_url":"https://api.github.com/users/senderista/gists{/gist_id}","starred_url":"https://api.github.com/users/senderista/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/senderista/subscriptions","organizations_url":"https://api.github.com/users/senderista/orgs","repos_url":"https://api.github.com/users/senderista/repos","events_url":"https://api.github.com/users/senderista/events{/privacy}","received_events_url":"https://api.github.com/users/senderista/received_events","type":"User","site_admin":false},"milestone":null,"commits_url":"https://api.github.com/repos/uwescience/raco/pulls/467/commits","review_comments_url":"https://api.github.com/repos/uwescience/raco/pulls/467/comments","review_comment_url":"https://api.github.com/repos/uwescience/raco/pulls/comments{/number}","comments_url":"https://api.github.com/repos/uwescience/raco/issues/467/comments","statuses_url":"https://api.github.com/repos/uwescience/raco/statuses/14cb42169762b1eed7d7a709b7f9423d329506fc","head":{"label":"uwescience:bmyerz/partitioning","ref":"bmyerz/partitioning","sha":"14cb42169762b1eed7d7a709b7f9423d329506fc","user":{"login":"uwescience","id":2243113,"avatar_url":"https://avatars.githubusercontent.com/u/2243113?v=3","gravatar_id":"","url":"https://api.github.com/users/uwescience","html_url":"https://github.com/uwescience","followers_url":"https://api.github.com/users/uwescience/followers","following_url":"https://api.github.com/users/uwescience/following{/other_user}","gists_url":"https://api.github.com/users/uwescience/gists{/gist_id}","starred_url":"https://api.github.com/users/uwescience/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/uwescience/subscriptions","organizations_url":"https://api.github.com/users/uwescience/orgs","repos_url":"https://api.github.com/users/uwescience/repos","events_url":"https://api.github.com/users/uwescience/events{/privacy}","received_events_url":"https://api.github.com/users/uwescience/received_events","type":"Organization","site_admin":false},"repo":{"id":6326372,"name":"raco","full_name":"uwescience/raco","owner":{"login":"uwescience","id":2243113,"avatar_url":"https://avatars.githubusercontent.com/u/2243113?v=3","gravatar_id":"","url":"https://api.github.com/users/uwescience","html_url":"https://github.com/uwescience","followers_url":"https://api.github.com/users/uwescience/followers","following_url":"https://api.github.com/users/uwescience/following{/other_user}","gists_url":"https://api.github.com/users/uwescience/gists{/gist_id}","starred_url":"https://api.github.com/users/uwescience/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/uwescience/subscriptions","organizations_url":"https://api.github.com/users/uwescience/orgs","repos_url":"https://api.github.com/users/uwescience/repos","events_url":"https://api.github.com/users/uwescience/events{/privacy}","received_events_url":"https://api.github.com/users/uwescience/received_events","type":"Organization","site_admin":false},"private":false,"html_url":"https://github.com/uwescience/raco","description":"Compilation and rule-based optimization framework for datalog.  Includes an RA compiler.","fork":false,"url":"https://api.github.com/repos/uwescience/raco","forks_url":"https://api.github.com/repos/uwescience/raco/forks","keys_url":"https://api.github.com/repos/uwescience/raco/keys{/key_id}","collaborators_url":"https://api.github.com/repos/uwescience/raco/collaborators{/collaborator}","teams_url":"https://api.github.com/repos/uwescience/raco/teams","hooks_url":"https://api.github.com/repos/uwescience/raco/hooks","issue_events_url":"https://api.github.com/repos/uwescience/raco/issues/events{/number}","events_url":"https://api.github.com/repos/uwescience/raco/events","assignees_url":"https://api.github.com/repos/uwescience/raco/assignees{/user}","branches_url":"https://api.github.com/repos/uwescience/raco/branches{/branch}","tags_url":"https://api.github.com/repos/uwescience/raco/tags","blobs_url":"https://api.github.com/repos/uwescience/raco/git/blobs{/sha}","git_tags_url":"https://api.github.com/repos/uwescience/raco/git/tags{/sha}","git_refs_url":"https://api.github.com/repos/uwescience/raco/git/refs{/sha}","trees_url":"https://api.github.com/repos/uwescience/raco/git/trees{/sha}","statuses_url":"https://api.github.com/repos/uwescience/raco/statuses/{sha}","languages_url":"https://api.github.com/repos/uwescience/raco/languages","stargazers_url":"https://api.github.com/repos/uwescience/raco/stargazers","contributors_url":"https://api.github.com/repos/uwescience/raco/contributors","subscribers_url":"https://api.github.com/repos/uwescience/raco/subscribers","subscription_url":"https://api.github.com/repos/uwescience/raco/subscription","commits_url":"https://api.github.com/repos/uwescience/raco/commits{/sha}","git_commits_url":"https://api.github.com/repos/uwescience/raco/git/commits{/sha}","comments_url":"https://api.github.com/repos/uwescience/raco/comments{/number}","issue_comment_url":"https://api.github.com/repos/uwescience/raco/issues/comments{/number}","contents_url":"https://api.github.com/repos/uwescience/raco/contents/{+path}","compare_url":"https://api.github.com/repos/uwescience/raco/compare/{base}...{head}","merges_url":"https://api.github.com/repos/uwescience/raco/merges","archive_url":"https://api.github.com/repos/uwescience/raco/{archive_format}{/ref}","downloads_url":"https://api.github.com/repos/uwescience/raco/downloads","issues_url":"https://api.github.com/repos/uwescience/raco/issues{/number}","pulls_url":"https://api.github.com/repos/uwescience/raco/pulls{/number}","milestones_url":"https://api.github.com/repos/uwescience/raco/milestones{/number}","notifications_url":"https://api.github.com/repos/uwescience/raco/notifications{?since,all,participating}","labels_url":"https://api.github.com/repos/uwescience/raco/labels{/name}","releases_url":"https://api.github.com/repos/uwescience/raco/releases{/id}","created_at":"2012-10-21T22:26:47Z","updated_at":"2015-07-25T16:44:46Z","pushed_at":"2015-09-03T19:36:30Z","git_url":"git://github.com/uwescience/raco.git","ssh_url":"git@github.com:uwescience/raco.git","clone_url":"https://github.com/uwescience/raco.git","svn_url":"https://github.com/uwescience/raco","homepage":null,"size":60312,"stargazers_count":17,"watchers_count":17,"language":"Python","has_issues":true,"has_downloads":true,"has_wiki":true,"has_pages":false,"forks_count":6,"mirror_url":null,"open_issues_count":82,"forks":6,"open_issues":82,"watchers":17,"default_branch":"master"}},"base":{"label":"uwescience:master","ref":"master","sha":"bd71c3fb285d4bba669b732aa55648e53e329ac9","user":{"login":"uwescience","id":2243113,"avatar_url":"https://avatars.githubusercontent.com/u/2243113?v=3","gravatar_id":"","url":"https://api.github.com/users/uwescience","html_url":"https://github.com/uwescience","followers_url":"https://api.github.com/users/uwescience/followers","following_url":"https://api.github.com/users/uwescience/following{/other_user}","gists_url":"https://api.github.com/users/uwescience/gists{/gist_id}","starred_url":"https://api.github.com/users/uwescience/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/uwescience/subscriptions","organizations_url":"https://api.github.com/users/uwescience/orgs","repos_url":"https://api.github.com/users/uwescience/repos","events_url":"https://api.github.com/users/uwescience/events{/privacy}","received_events_url":"https://api.github.com/users/uwescience/received_events","type":"Organization","site_admin":false},"repo":{"id":6326372,"name":"raco","full_name":"uwescience/raco","owner":{"login":"uwescience","id":2243113,"avatar_url":"https://avatars.githubusercontent.com/u/2243113?v=3","gravatar_id":"","url":"https://api.github.com/users/uwescience","html_url":"https://github.com/uwescience","followers_url":"https://api.github.com/users/uwescience/followers","following_url":"https://api.github.com/users/uwescience/following{/other_user}","gists_url":"https://api.github.com/users/uwescience/gists{/gist_id}","starred_url":"https://api.github.com/users/uwescience/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/uwescience/subscriptions","organizations_url":"https://api.github.com/users/uwescience/orgs","repos_url":"https://api.github.com/users/uwescience/repos","events_url":"https://api.github.com/users/uwescience/events{/privacy}","received_events_url":"https://api.github.com/users/uwescience/received_events","type":"Organization","site_admin":false},"private":false,"html_url":"https://github.com/uwescience/raco","description":"Compilation and rule-based optimization framework for datalog.  Includes an RA compiler.","fork":false,"url":"https://api.github.com/repos/uwescience/raco","forks_url":"https://api.github.com/repos/uwescience/raco/forks","keys_url":"https://api.github.com/repos/uwescience/raco/keys{/key_id}","collaborators_url":"https://api.github.com/repos/uwescience/raco/collaborators{/collaborator}","teams_url":"https://api.github.com/repos/uwescience/raco/teams","hooks_url":"https://api.github.com/repos/uwescience/raco/hooks","issue_events_url":"https://api.github.com/repos/uwescience/raco/issues/events{/number}","events_url":"https://api.github.com/repos/uwescience/raco/events","assignees_url":"https://api.github.com/repos/uwescience/raco/assignees{/user}","branches_url":"https://api.github.com/repos/uwescience/raco/branches{/branch}","tags_url":"https://api.github.com/repos/uwescience/raco/tags","blobs_url":"https://api.github.com/repos/uwescience/raco/git/blobs{/sha}","git_tags_url":"https://api.github.com/repos/uwescience/raco/git/tags{/sha}","git_refs_url":"https://api.github.com/repos/uwescience/raco/git/refs{/sha}","trees_url":"https://api.github.com/repos/uwescience/raco/git/trees{/sha}","statuses_url":"https://api.github.com/repos/uwescience/raco/statuses/{sha}","languages_url":"https://api.github.com/repos/uwescience/raco/languages","stargazers_url":"https://api.github.com/repos/uwescience/raco/stargazers","contributors_url":"https://api.github.com/repos/uwescience/raco/contributors","subscribers_url":"https://api.github.com/repos/uwescience/raco/subscribers","subscription_url":"https://api.github.com/repos/uwescience/raco/subscription","commits_url":"https://api.github.com/repos/uwescience/raco/commits{/sha}","git_commits_url":"https://api.github.com/repos/uwescience/raco/git/commits{/sha}","comments_url":"https://api.github.com/repos/uwescience/raco/comments{/number}","issue_comment_url":"https://api.github.com/repos/uwescience/raco/issues/comments{/number}","contents_url":"https://api.github.com/repos/uwescience/raco/contents/{+path}","compare_url":"https://api.github.com/repos/uwescience/raco/compare/{base}...{head}","merges_url":"https://api.github.com/repos/uwescience/raco/merges","archive_url":"https://api.github.com/repos/uwescience/raco/{archive_format}{/ref}","downloads_url":"https://api.github.com/repos/uwescience/raco/downloads","issues_url":"https://api.github.com/repos/uwescience/raco/issues{/number}","pulls_url":"https://api.github.com/repos/uwescience/raco/pulls{/number}","milestones_url":"https://api.github.com/repos/uwescience/raco/milestones{/number}","notifications_url":"https://api.github.com/repos/uwescience/raco/notifications{?since,all,participating}","labels_url":"https://api.github.com/repos/uwescience/raco/labels{/name}","releases_url":"https://api.github.com/repos/uwescience/raco/releases{/id}","created_at":"2012-10-21T22:26:47Z","updated_at":"2015-07-25T16:44:46Z","pushed_at":"2015-09-03T19:36:30Z","git_url":"git://github.com/uwescience/raco.git","ssh_url":"git@github.com:uwescience/raco.git","clone_url":"https://github.com/uwescience/raco.git","svn_url":"https://github.com/uwescience/raco","homepage":null,"size":60312,"stargazers_count":17,"watchers_count":17,"language":"Python","has_issues":true,"has_downloads":true,"has_wiki":true,"has_pages":false,"forks_count":6,"mirror_url":null,"open_issues_count":82,"forks":6,"open_issues":82,"watchers":17,"default_branch":"master"}},"_links":{"self":{"href":"https://api.github.com/repos/uwescience/raco/pulls/467"},"html":{"href":"https://github.com/uwescience/raco/pull/467"},"issue":{"href":"https://api.github.com/repos/uwescience/raco/issues/467"},"comments":{"href":"https://api.github.com/repos/uwescience/raco/issues/467/comments"},"review_comments":{"href":"https://api.github.com/repos/uwescience/raco/pulls/467/comments"},"review_comment":{"href":"https://api.github.com/repos/uwescience/raco/pulls/comments{/number}"},"commits":{"href":"https://api.github.com/repos/uwescience/raco/pulls/467/commits"},"statuses":{"href":"https://api.github.com/repos/uwescience/raco/statuses/14cb42169762b1eed7d7a709b7f9423d329506fc"}}}}