{"action":"closed","number":7,"pull_request":{"url":"https://api.github.com/repos/rentpath/mini_autobot/pulls/7","id":46423997,"html_url":"https://github.com/rentpath/mini_autobot/pull/7","diff_url":"https://github.com/rentpath/mini_autobot/pull/7.diff","patch_url":"https://github.com/rentpath/mini_autobot/pull/7.patch","issue_url":"https://api.github.com/repos/rentpath/mini_autobot/issues/7","number":7,"state":"closed","locked":false,"title":"Ph/rerun failing tests","user":{"login":"peijiehu","id":8250778,"avatar_url":"https://avatars.githubusercontent.com/u/8250778?v=3","gravatar_id":"","url":"https://api.github.com/users/peijiehu","html_url":"https://github.com/peijiehu","followers_url":"https://api.github.com/users/peijiehu/followers","following_url":"https://api.github.com/users/peijiehu/following{/other_user}","gists_url":"https://api.github.com/users/peijiehu/gists{/gist_id}","starred_url":"https://api.github.com/users/peijiehu/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/peijiehu/subscriptions","organizations_url":"https://api.github.com/users/peijiehu/orgs","repos_url":"https://api.github.com/users/peijiehu/repos","events_url":"https://api.github.com/users/peijiehu/events{/privacy}","received_events_url":"https://api.github.com/users/peijiehu/received_events","type":"User","site_admin":false},"body":"[[PH][104191480] Optional Rerun Failing Tests](https://www.pivotaltracker.com/story/show/104191480)\r\n\r\n#### Optional Rerun Failing Tests\r\n\r\n##### Goal\r\nFor regression run or other test runs which have results that teams want to depend on, it's critical that the results are trustworthy, so rerun failing tests serves as a way to improve its credibility. While during tests development or debugging, it should be disabled so user can see test failure immediately.\r\n\r\n##### Usage\r\nWhen running tests from command line, use option `-R` or `--rerun-failure`, it'll rerun tests if there's any failure from this run, default rerun up to once, can optionally specify a number value for it, eg. `-R 2` means rerun up to 2 times (if it failed consecutively).\r\n\r\n##### Final Thoughts\r\nCurrently, when rerun feature is enabled, it'll rerun the whole run if there's any failure, eg.\r\n`be mini_autobot -c firefox -e rent_qa -t critical_path -R` will rerun all `-t critical_path` tests if there's only one test failed, which is not very time efficient, but it simplifies things from test result reporter's standpoint - all runs are done within the same process, initialize a new reporter for every new run, the code for result aggregation stays untouched so counting will not go wrong. Otherwise, it would need to open new processes/threads to run individual failing tests, grab the results and come back to the parent process and merge the results with other tests in the run.","created_at":"2015-09-30T16:21:38Z","updated_at":"2015-10-06T21:04:34Z","closed_at":"2015-10-06T21:04:34Z","merged_at":"2015-10-06T21:04:34Z","merge_commit_sha":"c186b61b7c004e0fc5d569e4522a1f7127de4943","assignee":null,"milestone":null,"commits_url":"https://api.github.com/repos/rentpath/mini_autobot/pulls/7/commits","review_comments_url":"https://api.github.com/repos/rentpath/mini_autobot/pulls/7/comments","review_comment_url":"https://api.github.com/repos/rentpath/mini_autobot/pulls/comments{/number}","comments_url":"https://api.github.com/repos/rentpath/mini_autobot/issues/7/comments","statuses_url":"https://api.github.com/repos/rentpath/mini_autobot/statuses/89acdd98f6f1032cb03b30bb1431373cfa947c51","head":{"label":"rentpath:ph/rerun-failing-tests","ref":"ph/rerun-failing-tests","sha":"89acdd98f6f1032cb03b30bb1431373cfa947c51","user":{"login":"rentpath","id":37622,"avatar_url":"https://avatars.githubusercontent.com/u/37622?v=3","gravatar_id":"","url":"https://api.github.com/users/rentpath","html_url":"https://github.com/rentpath","followers_url":"https://api.github.com/users/rentpath/followers","following_url":"https://api.github.com/users/rentpath/following{/other_user}","gists_url":"https://api.github.com/users/rentpath/gists{/gist_id}","starred_url":"https://api.github.com/users/rentpath/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/rentpath/subscriptions","organizations_url":"https://api.github.com/users/rentpath/orgs","repos_url":"https://api.github.com/users/rentpath/repos","events_url":"https://api.github.com/users/rentpath/events{/privacy}","received_events_url":"https://api.github.com/users/rentpath/received_events","type":"Organization","site_admin":false},"repo":{"id":40264870,"name":"mini_autobot","full_name":"rentpath/mini_autobot","owner":{"login":"rentpath","id":37622,"avatar_url":"https://avatars.githubusercontent.com/u/37622?v=3","gravatar_id":"","url":"https://api.github.com/users/rentpath","html_url":"https://github.com/rentpath","followers_url":"https://api.github.com/users/rentpath/followers","following_url":"https://api.github.com/users/rentpath/following{/other_user}","gists_url":"https://api.github.com/users/rentpath/gists{/gist_id}","starred_url":"https://api.github.com/users/rentpath/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/rentpath/subscriptions","organizations_url":"https://api.github.com/users/rentpath/orgs","repos_url":"https://api.github.com/users/rentpath/repos","events_url":"https://api.github.com/users/rentpath/events{/privacy}","received_events_url":"https://api.github.com/users/rentpath/received_events","type":"Organization","site_admin":false},"private":false,"html_url":"https://github.com/rentpath/mini_autobot","description":"Web automation framework on minitest, selenium webdriver, and page objects.","fork":false,"url":"https://api.github.com/repos/rentpath/mini_autobot","forks_url":"https://api.github.com/repos/rentpath/mini_autobot/forks","keys_url":"https://api.github.com/repos/rentpath/mini_autobot/keys{/key_id}","collaborators_url":"https://api.github.com/repos/rentpath/mini_autobot/collaborators{/collaborator}","teams_url":"https://api.github.com/repos/rentpath/mini_autobot/teams","hooks_url":"https://api.github.com/repos/rentpath/mini_autobot/hooks","issue_events_url":"https://api.github.com/repos/rentpath/mini_autobot/issues/events{/number}","events_url":"https://api.github.com/repos/rentpath/mini_autobot/events","assignees_url":"https://api.github.com/repos/rentpath/mini_autobot/assignees{/user}","branches_url":"https://api.github.com/repos/rentpath/mini_autobot/branches{/branch}","tags_url":"https://api.github.com/repos/rentpath/mini_autobot/tags","blobs_url":"https://api.github.com/repos/rentpath/mini_autobot/git/blobs{/sha}","git_tags_url":"https://api.github.com/repos/rentpath/mini_autobot/git/tags{/sha}","git_refs_url":"https://api.github.com/repos/rentpath/mini_autobot/git/refs{/sha}","trees_url":"https://api.github.com/repos/rentpath/mini_autobot/git/trees{/sha}","statuses_url":"https://api.github.com/repos/rentpath/mini_autobot/statuses/{sha}","languages_url":"https://api.github.com/repos/rentpath/mini_autobot/languages","stargazers_url":"https://api.github.com/repos/rentpath/mini_autobot/stargazers","contributors_url":"https://api.github.com/repos/rentpath/mini_autobot/contributors","subscribers_url":"https://api.github.com/repos/rentpath/mini_autobot/subscribers","subscription_url":"https://api.github.com/repos/rentpath/mini_autobot/subscription","commits_url":"https://api.github.com/repos/rentpath/mini_autobot/commits{/sha}","git_commits_url":"https://api.github.com/repos/rentpath/mini_autobot/git/commits{/sha}","comments_url":"https://api.github.com/repos/rentpath/mini_autobot/comments{/number}","issue_comment_url":"https://api.github.com/repos/rentpath/mini_autobot/issues/comments{/number}","contents_url":"https://api.github.com/repos/rentpath/mini_autobot/contents/{+path}","compare_url":"https://api.github.com/repos/rentpath/mini_autobot/compare/{base}...{head}","merges_url":"https://api.github.com/repos/rentpath/mini_autobot/merges","archive_url":"https://api.github.com/repos/rentpath/mini_autobot/{archive_format}{/ref}","downloads_url":"https://api.github.com/repos/rentpath/mini_autobot/downloads","issues_url":"https://api.github.com/repos/rentpath/mini_autobot/issues{/number}","pulls_url":"https://api.github.com/repos/rentpath/mini_autobot/pulls{/number}","milestones_url":"https://api.github.com/repos/rentpath/mini_autobot/milestones{/number}","notifications_url":"https://api.github.com/repos/rentpath/mini_autobot/notifications{?since,all,participating}","labels_url":"https://api.github.com/repos/rentpath/mini_autobot/labels{/name}","releases_url":"https://api.github.com/repos/rentpath/mini_autobot/releases{/id}","created_at":"2015-08-05T19:29:44Z","updated_at":"2015-08-13T01:00:25Z","pushed_at":"2015-10-06T21:04:34Z","git_url":"git://github.com/rentpath/mini_autobot.git","ssh_url":"git@github.com:rentpath/mini_autobot.git","clone_url":"https://github.com/rentpath/mini_autobot.git","svn_url":"https://github.com/rentpath/mini_autobot","homepage":null,"size":27204,"stargazers_count":0,"watchers_count":0,"language":"Ruby","has_issues":true,"has_downloads":true,"has_wiki":true,"has_pages":false,"forks_count":0,"mirror_url":null,"open_issues_count":0,"forks":0,"open_issues":0,"watchers":0,"default_branch":"master"}},"base":{"label":"rentpath:master","ref":"master","sha":"7131ebdf725535c2a52faa1543f9991b53b91931","user":{"login":"rentpath","id":37622,"avatar_url":"https://avatars.githubusercontent.com/u/37622?v=3","gravatar_id":"","url":"https://api.github.com/users/rentpath","html_url":"https://github.com/rentpath","followers_url":"https://api.github.com/users/rentpath/followers","following_url":"https://api.github.com/users/rentpath/following{/other_user}","gists_url":"https://api.github.com/users/rentpath/gists{/gist_id}","starred_url":"https://api.github.com/users/rentpath/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/rentpath/subscriptions","organizations_url":"https://api.github.com/users/rentpath/orgs","repos_url":"https://api.github.com/users/rentpath/repos","events_url":"https://api.github.com/users/rentpath/events{/privacy}","received_events_url":"https://api.github.com/users/rentpath/received_events","type":"Organization","site_admin":false},"repo":{"id":40264870,"name":"mini_autobot","full_name":"rentpath/mini_autobot","owner":{"login":"rentpath","id":37622,"avatar_url":"https://avatars.githubusercontent.com/u/37622?v=3","gravatar_id":"","url":"https://api.github.com/users/rentpath","html_url":"https://github.com/rentpath","followers_url":"https://api.github.com/users/rentpath/followers","following_url":"https://api.github.com/users/rentpath/following{/other_user}","gists_url":"https://api.github.com/users/rentpath/gists{/gist_id}","starred_url":"https://api.github.com/users/rentpath/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/rentpath/subscriptions","organizations_url":"https://api.github.com/users/rentpath/orgs","repos_url":"https://api.github.com/users/rentpath/repos","events_url":"https://api.github.com/users/rentpath/events{/privacy}","received_events_url":"https://api.github.com/users/rentpath/received_events","type":"Organization","site_admin":false},"private":false,"html_url":"https://github.com/rentpath/mini_autobot","description":"Web automation framework on minitest, selenium webdriver, and page objects.","fork":false,"url":"https://api.github.com/repos/rentpath/mini_autobot","forks_url":"https://api.github.com/repos/rentpath/mini_autobot/forks","keys_url":"https://api.github.com/repos/rentpath/mini_autobot/keys{/key_id}","collaborators_url":"https://api.github.com/repos/rentpath/mini_autobot/collaborators{/collaborator}","teams_url":"https://api.github.com/repos/rentpath/mini_autobot/teams","hooks_url":"https://api.github.com/repos/rentpath/mini_autobot/hooks","issue_events_url":"https://api.github.com/repos/rentpath/mini_autobot/issues/events{/number}","events_url":"https://api.github.com/repos/rentpath/mini_autobot/events","assignees_url":"https://api.github.com/repos/rentpath/mini_autobot/assignees{/user}","branches_url":"https://api.github.com/repos/rentpath/mini_autobot/branches{/branch}","tags_url":"https://api.github.com/repos/rentpath/mini_autobot/tags","blobs_url":"https://api.github.com/repos/rentpath/mini_autobot/git/blobs{/sha}","git_tags_url":"https://api.github.com/repos/rentpath/mini_autobot/git/tags{/sha}","git_refs_url":"https://api.github.com/repos/rentpath/mini_autobot/git/refs{/sha}","trees_url":"https://api.github.com/repos/rentpath/mini_autobot/git/trees{/sha}","statuses_url":"https://api.github.com/repos/rentpath/mini_autobot/statuses/{sha}","languages_url":"https://api.github.com/repos/rentpath/mini_autobot/languages","stargazers_url":"https://api.github.com/repos/rentpath/mini_autobot/stargazers","contributors_url":"https://api.github.com/repos/rentpath/mini_autobot/contributors","subscribers_url":"https://api.github.com/repos/rentpath/mini_autobot/subscribers","subscription_url":"https://api.github.com/repos/rentpath/mini_autobot/subscription","commits_url":"https://api.github.com/repos/rentpath/mini_autobot/commits{/sha}","git_commits_url":"https://api.github.com/repos/rentpath/mini_autobot/git/commits{/sha}","comments_url":"https://api.github.com/repos/rentpath/mini_autobot/comments{/number}","issue_comment_url":"https://api.github.com/repos/rentpath/mini_autobot/issues/comments{/number}","contents_url":"https://api.github.com/repos/rentpath/mini_autobot/contents/{+path}","compare_url":"https://api.github.com/repos/rentpath/mini_autobot/compare/{base}...{head}","merges_url":"https://api.github.com/repos/rentpath/mini_autobot/merges","archive_url":"https://api.github.com/repos/rentpath/mini_autobot/{archive_format}{/ref}","downloads_url":"https://api.github.com/repos/rentpath/mini_autobot/downloads","issues_url":"https://api.github.com/repos/rentpath/mini_autobot/issues{/number}","pulls_url":"https://api.github.com/repos/rentpath/mini_autobot/pulls{/number}","milestones_url":"https://api.github.com/repos/rentpath/mini_autobot/milestones{/number}","notifications_url":"https://api.github.com/repos/rentpath/mini_autobot/notifications{?since,all,participating}","labels_url":"https://api.github.com/repos/rentpath/mini_autobot/labels{/name}","releases_url":"https://api.github.com/repos/rentpath/mini_autobot/releases{/id}","created_at":"2015-08-05T19:29:44Z","updated_at":"2015-08-13T01:00:25Z","pushed_at":"2015-10-06T21:04:34Z","git_url":"git://github.com/rentpath/mini_autobot.git","ssh_url":"git@github.com:rentpath/mini_autobot.git","clone_url":"https://github.com/rentpath/mini_autobot.git","svn_url":"https://github.com/rentpath/mini_autobot","homepage":null,"size":27204,"stargazers_count":0,"watchers_count":0,"language":"Ruby","has_issues":true,"has_downloads":true,"has_wiki":true,"has_pages":false,"forks_count":0,"mirror_url":null,"open_issues_count":0,"forks":0,"open_issues":0,"watchers":0,"default_branch":"master"}},"_links":{"self":{"href":"https://api.github.com/repos/rentpath/mini_autobot/pulls/7"},"html":{"href":"https://github.com/rentpath/mini_autobot/pull/7"},"issue":{"href":"https://api.github.com/repos/rentpath/mini_autobot/issues/7"},"comments":{"href":"https://api.github.com/repos/rentpath/mini_autobot/issues/7/comments"},"review_comments":{"href":"https://api.github.com/repos/rentpath/mini_autobot/pulls/7/comments"},"review_comment":{"href":"https://api.github.com/repos/rentpath/mini_autobot/pulls/comments{/number}"},"commits":{"href":"https://api.github.com/repos/rentpath/mini_autobot/pulls/7/commits"},"statuses":{"href":"https://api.github.com/repos/rentpath/mini_autobot/statuses/89acdd98f6f1032cb03b30bb1431373cfa947c51"}},"merged":true,"mergeable":null,"mergeable_state":"unknown","merged_by":{"login":"jtheodore-rent","id":11199248,"avatar_url":"https://avatars.githubusercontent.com/u/11199248?v=3","gravatar_id":"","url":"https://api.github.com/users/jtheodore-rent","html_url":"https://github.com/jtheodore-rent","followers_url":"https://api.github.com/users/jtheodore-rent/followers","following_url":"https://api.github.com/users/jtheodore-rent/following{/other_user}","gists_url":"https://api.github.com/users/jtheodore-rent/gists{/gist_id}","starred_url":"https://api.github.com/users/jtheodore-rent/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jtheodore-rent/subscriptions","organizations_url":"https://api.github.com/users/jtheodore-rent/orgs","repos_url":"https://api.github.com/users/jtheodore-rent/repos","events_url":"https://api.github.com/users/jtheodore-rent/events{/privacy}","received_events_url":"https://api.github.com/users/jtheodore-rent/received_events","type":"User","site_admin":false},"comments":2,"review_comments":0,"commits":13,"additions":43,"deletions":1,"changed_files":5}}