{"action":"closed","number":5693,"pull_request":{"url":"https://api.github.com/repos/idaholab/moose/pulls/5693","id":45008053,"html_url":"https://github.com/idaholab/moose/pull/5693","diff_url":"https://github.com/idaholab/moose/pull/5693.diff","patch_url":"https://github.com/idaholab/moose/pull/5693.patch","issue_url":"https://api.github.com/repos/idaholab/moose/issues/5693","number":5693,"state":"closed","locked":false,"title":"MultiApp Recovery","user":{"login":"friedmud","id":870705,"avatar_url":"https://avatars.githubusercontent.com/u/870705?v=3","gravatar_id":"","url":"https://api.github.com/users/friedmud","html_url":"https://github.com/friedmud","followers_url":"https://api.github.com/users/friedmud/followers","following_url":"https://api.github.com/users/friedmud/following{/other_user}","gists_url":"https://api.github.com/users/friedmud/gists{/gist_id}","starred_url":"https://api.github.com/users/friedmud/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/friedmud/subscriptions","organizations_url":"https://api.github.com/users/friedmud/orgs","repos_url":"https://api.github.com/users/friedmud/repos","events_url":"https://api.github.com/users/friedmud/events{/privacy}","received_events_url":"https://api.github.com/users/friedmud/received_events","type":"User","site_admin":false},"body":"This implements MultiApp recovery by just using all the data in the (ultimate) master app's checkpoint file.\r\n\r\nThe \"Ultimate\" part of \"Ultimate Master\" means that it is the _original_ master app.. i.e. the app that goes with the original input file.  In code this means that it's `multiapp_level` is `0`\r\n\r\nBasically - only the input file that you actually pass as `-i` needs to output a checkpoint file... and the data for all sub-apps (and even their sub-apps, and turtles all the way down) are contained in that one checkpoint file.\r\n\r\nWhen `--recover` is used or a `restart_file_base` is set the ultimate master is recovered/restarted like usual... and then the sub-app data is unpacked and pushed down through the MultiApp levels.\r\n\r\nThis is all working to the point where I was able to re-enable recovery testing for lots of multiapp tests and for lots of transfer tests.\r\n\r\nThere are a few things that aren't currently possible:\r\n\r\n1.  Adaptive mesh in the sub-apps.  Currently, the mesh is NOT saved in the checkpoint file... so there is no way to \"push\" that down to the sub-apps.  I'll find a way around this eventually.  For now, I've capture this here: #5690\r\n\r\n2.  Similarly, this doesn't support many of the things \"restart\" does in MOOSE.  In particular, you can't adapt or uniformly refine a sub-app mesh on restart.  I've captured that here: #5691\r\n\r\n3.  Continuing with that trend, I haven't tried it yet, but I suspect that adding a variable (NL or Aux) to a sub-app during restart is NOT going to work.  This has to do with the rigid way that solution vector data is stored in Checkpoint files.  To fix this, we would need to store something a bit more flexible (something closer to the XDA/R files).  Captured that one here: #5692\r\n\r\nI'm sure there is more that we'll find as we actually try to use this capability.\r\n\r\nOh yeah... this is all for #4941","created_at":"2015-09-15T04:30:57Z","updated_at":"2015-09-15T14:20:30Z","closed_at":"2015-09-15T14:20:30Z","merged_at":"2015-09-15T14:20:30Z","merge_commit_sha":"37b5ce15d244ad8124b147a13588e6dfe56d1408","assignee":null,"milestone":null,"commits_url":"https://api.github.com/repos/idaholab/moose/pulls/5693/commits","review_comments_url":"https://api.github.com/repos/idaholab/moose/pulls/5693/comments","review_comment_url":"https://api.github.com/repos/idaholab/moose/pulls/comments{/number}","comments_url":"https://api.github.com/repos/idaholab/moose/issues/5693/comments","statuses_url":"https://api.github.com/repos/idaholab/moose/statuses/63e1069bd1eb8341530756f992d03da1ed755145","head":{"label":"friedmud:multiapp_restart_4941","ref":"multiapp_restart_4941","sha":"63e1069bd1eb8341530756f992d03da1ed755145","user":{"login":"friedmud","id":870705,"avatar_url":"https://avatars.githubusercontent.com/u/870705?v=3","gravatar_id":"","url":"https://api.github.com/users/friedmud","html_url":"https://github.com/friedmud","followers_url":"https://api.github.com/users/friedmud/followers","following_url":"https://api.github.com/users/friedmud/following{/other_user}","gists_url":"https://api.github.com/users/friedmud/gists{/gist_id}","starred_url":"https://api.github.com/users/friedmud/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/friedmud/subscriptions","organizations_url":"https://api.github.com/users/friedmud/orgs","repos_url":"https://api.github.com/users/friedmud/repos","events_url":"https://api.github.com/users/friedmud/events{/privacy}","received_events_url":"https://api.github.com/users/friedmud/received_events","type":"User","site_admin":false},"repo":{"id":17852546,"name":"moose","full_name":"friedmud/moose","owner":{"login":"friedmud","id":870705,"avatar_url":"https://avatars.githubusercontent.com/u/870705?v=3","gravatar_id":"","url":"https://api.github.com/users/friedmud","html_url":"https://github.com/friedmud","followers_url":"https://api.github.com/users/friedmud/followers","following_url":"https://api.github.com/users/friedmud/following{/other_user}","gists_url":"https://api.github.com/users/friedmud/gists{/gist_id}","starred_url":"https://api.github.com/users/friedmud/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/friedmud/subscriptions","organizations_url":"https://api.github.com/users/friedmud/orgs","repos_url":"https://api.github.com/users/friedmud/repos","events_url":"https://api.github.com/users/friedmud/events{/privacy}","received_events_url":"https://api.github.com/users/friedmud/received_events","type":"User","site_admin":false},"private":false,"html_url":"https://github.com/friedmud/moose","description":"Multiphysics Object Oriented Simulation Environment","fork":true,"url":"https://api.github.com/repos/friedmud/moose","forks_url":"https://api.github.com/repos/friedmud/moose/forks","keys_url":"https://api.github.com/repos/friedmud/moose/keys{/key_id}","collaborators_url":"https://api.github.com/repos/friedmud/moose/collaborators{/collaborator}","teams_url":"https://api.github.com/repos/friedmud/moose/teams","hooks_url":"https://api.github.com/repos/friedmud/moose/hooks","issue_events_url":"https://api.github.com/repos/friedmud/moose/issues/events{/number}","events_url":"https://api.github.com/repos/friedmud/moose/events","assignees_url":"https://api.github.com/repos/friedmud/moose/assignees{/user}","branches_url":"https://api.github.com/repos/friedmud/moose/branches{/branch}","tags_url":"https://api.github.com/repos/friedmud/moose/tags","blobs_url":"https://api.github.com/repos/friedmud/moose/git/blobs{/sha}","git_tags_url":"https://api.github.com/repos/friedmud/moose/git/tags{/sha}","git_refs_url":"https://api.github.com/repos/friedmud/moose/git/refs{/sha}","trees_url":"https://api.github.com/repos/friedmud/moose/git/trees{/sha}","statuses_url":"https://api.github.com/repos/friedmud/moose/statuses/{sha}","languages_url":"https://api.github.com/repos/friedmud/moose/languages","stargazers_url":"https://api.github.com/repos/friedmud/moose/stargazers","contributors_url":"https://api.github.com/repos/friedmud/moose/contributors","subscribers_url":"https://api.github.com/repos/friedmud/moose/subscribers","subscription_url":"https://api.github.com/repos/friedmud/moose/subscription","commits_url":"https://api.github.com/repos/friedmud/moose/commits{/sha}","git_commits_url":"https://api.github.com/repos/friedmud/moose/git/commits{/sha}","comments_url":"https://api.github.com/repos/friedmud/moose/comments{/number}","issue_comment_url":"https://api.github.com/repos/friedmud/moose/issues/comments{/number}","contents_url":"https://api.github.com/repos/friedmud/moose/contents/{+path}","compare_url":"https://api.github.com/repos/friedmud/moose/compare/{base}...{head}","merges_url":"https://api.github.com/repos/friedmud/moose/merges","archive_url":"https://api.github.com/repos/friedmud/moose/{archive_format}{/ref}","downloads_url":"https://api.github.com/repos/friedmud/moose/downloads","issues_url":"https://api.github.com/repos/friedmud/moose/issues{/number}","pulls_url":"https://api.github.com/repos/friedmud/moose/pulls{/number}","milestones_url":"https://api.github.com/repos/friedmud/moose/milestones{/number}","notifications_url":"https://api.github.com/repos/friedmud/moose/notifications{?since,all,participating}","labels_url":"https://api.github.com/repos/friedmud/moose/labels{/name}","releases_url":"https://api.github.com/repos/friedmud/moose/releases{/id}","created_at":"2014-03-18T03:31:09Z","updated_at":"2015-07-15T01:31:15Z","pushed_at":"2015-09-15T04:33:42Z","git_url":"git://github.com/friedmud/moose.git","ssh_url":"git@github.com:friedmud/moose.git","clone_url":"https://github.com/friedmud/moose.git","svn_url":"https://github.com/friedmud/moose","homepage":null,"size":116336,"stargazers_count":0,"watchers_count":0,"language":"C++","has_issues":false,"has_downloads":true,"has_wiki":true,"has_pages":true,"forks_count":0,"mirror_url":null,"open_issues_count":0,"forks":0,"open_issues":0,"watchers":0,"default_branch":"devel"}},"base":{"label":"idaholab:devel","ref":"devel","sha":"c19bf012f02e93f01cc0f62974e2c666b469db59","user":{"login":"idaholab","id":3855370,"avatar_url":"https://avatars.githubusercontent.com/u/3855370?v=3","gravatar_id":"","url":"https://api.github.com/users/idaholab","html_url":"https://github.com/idaholab","followers_url":"https://api.github.com/users/idaholab/followers","following_url":"https://api.github.com/users/idaholab/following{/other_user}","gists_url":"https://api.github.com/users/idaholab/gists{/gist_id}","starred_url":"https://api.github.com/users/idaholab/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/idaholab/subscriptions","organizations_url":"https://api.github.com/users/idaholab/orgs","repos_url":"https://api.github.com/users/idaholab/repos","events_url":"https://api.github.com/users/idaholab/events{/privacy}","received_events_url":"https://api.github.com/users/idaholab/received_events","type":"Organization","site_admin":false},"repo":{"id":16851223,"name":"moose","full_name":"idaholab/moose","owner":{"login":"idaholab","id":3855370,"avatar_url":"https://avatars.githubusercontent.com/u/3855370?v=3","gravatar_id":"","url":"https://api.github.com/users/idaholab","html_url":"https://github.com/idaholab","followers_url":"https://api.github.com/users/idaholab/followers","following_url":"https://api.github.com/users/idaholab/following{/other_user}","gists_url":"https://api.github.com/users/idaholab/gists{/gist_id}","starred_url":"https://api.github.com/users/idaholab/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/idaholab/subscriptions","organizations_url":"https://api.github.com/users/idaholab/orgs","repos_url":"https://api.github.com/users/idaholab/repos","events_url":"https://api.github.com/users/idaholab/events{/privacy}","received_events_url":"https://api.github.com/users/idaholab/received_events","type":"Organization","site_admin":false},"private":false,"html_url":"https://github.com/idaholab/moose","description":"Multiphysics Object Oriented Simulation Environment","fork":false,"url":"https://api.github.com/repos/idaholab/moose","forks_url":"https://api.github.com/repos/idaholab/moose/forks","keys_url":"https://api.github.com/repos/idaholab/moose/keys{/key_id}","collaborators_url":"https://api.github.com/repos/idaholab/moose/collaborators{/collaborator}","teams_url":"https://api.github.com/repos/idaholab/moose/teams","hooks_url":"https://api.github.com/repos/idaholab/moose/hooks","issue_events_url":"https://api.github.com/repos/idaholab/moose/issues/events{/number}","events_url":"https://api.github.com/repos/idaholab/moose/events","assignees_url":"https://api.github.com/repos/idaholab/moose/assignees{/user}","branches_url":"https://api.github.com/repos/idaholab/moose/branches{/branch}","tags_url":"https://api.github.com/repos/idaholab/moose/tags","blobs_url":"https://api.github.com/repos/idaholab/moose/git/blobs{/sha}","git_tags_url":"https://api.github.com/repos/idaholab/moose/git/tags{/sha}","git_refs_url":"https://api.github.com/repos/idaholab/moose/git/refs{/sha}","trees_url":"https://api.github.com/repos/idaholab/moose/git/trees{/sha}","statuses_url":"https://api.github.com/repos/idaholab/moose/statuses/{sha}","languages_url":"https://api.github.com/repos/idaholab/moose/languages","stargazers_url":"https://api.github.com/repos/idaholab/moose/stargazers","contributors_url":"https://api.github.com/repos/idaholab/moose/contributors","subscribers_url":"https://api.github.com/repos/idaholab/moose/subscribers","subscription_url":"https://api.github.com/repos/idaholab/moose/subscription","commits_url":"https://api.github.com/repos/idaholab/moose/commits{/sha}","git_commits_url":"https://api.github.com/repos/idaholab/moose/git/commits{/sha}","comments_url":"https://api.github.com/repos/idaholab/moose/comments{/number}","issue_comment_url":"https://api.github.com/repos/idaholab/moose/issues/comments{/number}","contents_url":"https://api.github.com/repos/idaholab/moose/contents/{+path}","compare_url":"https://api.github.com/repos/idaholab/moose/compare/{base}...{head}","merges_url":"https://api.github.com/repos/idaholab/moose/merges","archive_url":"https://api.github.com/repos/idaholab/moose/{archive_format}{/ref}","downloads_url":"https://api.github.com/repos/idaholab/moose/downloads","issues_url":"https://api.github.com/repos/idaholab/moose/issues{/number}","pulls_url":"https://api.github.com/repos/idaholab/moose/pulls{/number}","milestones_url":"https://api.github.com/repos/idaholab/moose/milestones{/number}","notifications_url":"https://api.github.com/repos/idaholab/moose/notifications{?since,all,participating}","labels_url":"https://api.github.com/repos/idaholab/moose/labels{/name}","releases_url":"https://api.github.com/repos/idaholab/moose/releases{/id}","created_at":"2014-02-14T22:26:15Z","updated_at":"2015-09-03T00:35:28Z","pushed_at":"2015-09-15T14:20:30Z","git_url":"git://github.com/idaholab/moose.git","ssh_url":"git@github.com:idaholab/moose.git","clone_url":"https://github.com/idaholab/moose.git","svn_url":"https://github.com/idaholab/moose","homepage":"http://www.mooseframework.org","size":136092,"stargazers_count":97,"watchers_count":97,"language":"C++","has_issues":true,"has_downloads":true,"has_wiki":true,"has_pages":true,"forks_count":162,"mirror_url":null,"open_issues_count":480,"forks":162,"open_issues":480,"watchers":97,"default_branch":"devel"}},"_links":{"self":{"href":"https://api.github.com/repos/idaholab/moose/pulls/5693"},"html":{"href":"https://github.com/idaholab/moose/pull/5693"},"issue":{"href":"https://api.github.com/repos/idaholab/moose/issues/5693"},"comments":{"href":"https://api.github.com/repos/idaholab/moose/issues/5693/comments"},"review_comments":{"href":"https://api.github.com/repos/idaholab/moose/pulls/5693/comments"},"review_comment":{"href":"https://api.github.com/repos/idaholab/moose/pulls/comments{/number}"},"commits":{"href":"https://api.github.com/repos/idaholab/moose/pulls/5693/commits"},"statuses":{"href":"https://api.github.com/repos/idaholab/moose/statuses/63e1069bd1eb8341530756f992d03da1ed755145"}},"merged":true,"mergeable":null,"mergeable_state":"unknown","merged_by":{"login":"permcody","id":3036960,"avatar_url":"https://avatars.githubusercontent.com/u/3036960?v=3","gravatar_id":"","url":"https://api.github.com/users/permcody","html_url":"https://github.com/permcody","followers_url":"https://api.github.com/users/permcody/followers","following_url":"https://api.github.com/users/permcody/following{/other_user}","gists_url":"https://api.github.com/users/permcody/gists{/gist_id}","starred_url":"https://api.github.com/users/permcody/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/permcody/subscriptions","organizations_url":"https://api.github.com/users/permcody/orgs","repos_url":"https://api.github.com/users/permcody/repos","events_url":"https://api.github.com/users/permcody/events{/privacy}","received_events_url":"https://api.github.com/users/permcody/received_events","type":"User","site_admin":false},"comments":1,"review_comments":0,"commits":5,"additions":79,"deletions":64,"changed_files":22}}