{"action":"created","issue":{"url":"https://api.github.com/repos/Particular/ServicePulse/issues/209","labels_url":"https://api.github.com/repos/Particular/ServicePulse/issues/209/labels{/name}","comments_url":"https://api.github.com/repos/Particular/ServicePulse/issues/209/comments","events_url":"https://api.github.com/repos/Particular/ServicePulse/issues/209/events","html_url":"https://github.com/Particular/ServicePulse/issues/209","id":115136173,"number":209,"title":"Smoke Test for pre-release","user":{"login":"petersgiles","id":1644481,"avatar_url":"https://avatars.githubusercontent.com/u/1644481?v=3","gravatar_id":"","url":"https://api.github.com/users/petersgiles","html_url":"https://github.com/petersgiles","followers_url":"https://api.github.com/users/petersgiles/followers","following_url":"https://api.github.com/users/petersgiles/following{/other_user}","gists_url":"https://api.github.com/users/petersgiles/gists{/gist_id}","starred_url":"https://api.github.com/users/petersgiles/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/petersgiles/subscriptions","organizations_url":"https://api.github.com/users/petersgiles/orgs","repos_url":"https://api.github.com/users/petersgiles/repos","events_url":"https://api.github.com/users/petersgiles/events{/privacy}","received_events_url":"https://api.github.com/users/petersgiles/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/Particular/ServicePulse/labels/Impact:%20L","name":"Impact: L","color":"e11d21"},{"url":"https://api.github.com/repos/Particular/ServicePulse/labels/Size:%20S","name":"Size: S","color":"B6FF00"},{"url":"https://api.github.com/repos/Particular/ServicePulse/labels/State:%20Getting%20Ready","name":"State: Getting Ready","color":"ededed"},{"url":"https://api.github.com/repos/Particular/ServicePulse/labels/Type:%20Documentation","name":"Type: Documentation","color":"ededed"}],"state":"open","locked":false,"assignee":{"login":"petersgiles","id":1644481,"avatar_url":"https://avatars.githubusercontent.com/u/1644481?v=3","gravatar_id":"","url":"https://api.github.com/users/petersgiles","html_url":"https://github.com/petersgiles","followers_url":"https://api.github.com/users/petersgiles/followers","following_url":"https://api.github.com/users/petersgiles/following{/other_user}","gists_url":"https://api.github.com/users/petersgiles/gists{/gist_id}","starred_url":"https://api.github.com/users/petersgiles/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/petersgiles/subscriptions","organizations_url":"https://api.github.com/users/petersgiles/orgs","repos_url":"https://api.github.com/users/petersgiles/repos","events_url":"https://api.github.com/users/petersgiles/events{/privacy}","received_events_url":"https://api.github.com/users/petersgiles/received_events","type":"User","site_admin":false},"milestone":null,"comments":2,"created_at":"2015-11-04T20:06:40Z","updated_at":"2015-11-04T20:52:29Z","closed_at":null,"body":"taskforce: @petersgiles\r\n\r\nRecently I've been working on ServicePulse and releasing fixes as I go. I've found myself caught by the lack of unit testing a few times now I think we (me especially) would benefit from a checklist I can follow to ensure better coverage during pre-release testing. At the very least it might save future embarrassment but I imagine it could serve to inform us as to what to put into our client unit test.\r\n\r\n---\r\n\r\n- [ ] Start ServicePulse & ServiceControl\r\n- [ ] Use the Fault Tolerance sample to create a few errors (turn off retries to save time)\r\n- [ ] Navigate to each page testing the breadcrumbs and other in app links\r\n- [ ] Navigate to Dashboard \r\n   - [ ] check that the failure counts match your expectations\r\n   - [ ] check that the Latest events log makes sense\r\n   - [ ] check that the endpoint counts are correct\r\n   - [ ] check that clicking on each of the indicators navigates you to the correct page\r\n   - [ ] check that version indicator at the bottom of the page is correct\r\n- [ ] Navigate to Endpoints\r\n   - [ ] check that the active and inactive endpoints are correct\r\n- [ ] Navigate to Custom Checks\r\n   - [ ] check that any expected custom checks are present\r\n- [ ] Navigate to Configuration\r\n   - [ ] check that all Endpoints can have their heartbeats activated and deactivated\r\n- [ ] Navigate to FailedMessages\r\n   - [ ] check that clicking on a message group link navigates to the messages tab and shows just the messages of that group\r\n   - [ ] check that 'view all failed messages' navigates to the messages tab\r\n\r\nIn Error Groups tab\r\n   - [ ] check that all ErrorGroups are present (leave the fault tolerance [FT] sample running with the exception on)\r\n      - [ ] check that you can retry an ErrorGroup  & check for processing in FT\r\n      - [ ] check that you can retry ALL ErrorGroups ( the big red button ) & check for processing in FT\r\n      - [ ] check that you can archive an ErrorGroup\r\n\r\nIn Messages tab\r\n   - [ ] check that the action buttons on each message function correctly\r\n      - [ ] check that you can retry a Message & check for processing in FT\r\n      - [ ] check that you can archive a Message \r\n\r\n---\r\n\r\nI hate to add yet another layer of process to what we do but I wonder if it would be worthwhile to look at a test management tool.\r\n\r\n- http://www.gurock.com/testrail/\r\n- http://www.testiatarantula.com/\r\n- http://www.jatakasource.org/testcube/\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n\r\n"},"comment":{"url":"https://api.github.com/repos/Particular/ServicePulse/issues/comments/153861692","html_url":"https://github.com/Particular/ServicePulse/issues/209#issuecomment-153861692","issue_url":"https://api.github.com/repos/Particular/ServicePulse/issues/209","id":153861692,"user":{"login":"sergioc","id":493451,"avatar_url":"https://avatars.githubusercontent.com/u/493451?v=3","gravatar_id":"","url":"https://api.github.com/users/sergioc","html_url":"https://github.com/sergioc","followers_url":"https://api.github.com/users/sergioc/followers","following_url":"https://api.github.com/users/sergioc/following{/other_user}","gists_url":"https://api.github.com/users/sergioc/gists{/gist_id}","starred_url":"https://api.github.com/users/sergioc/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/sergioc/subscriptions","organizations_url":"https://api.github.com/users/sergioc/orgs","repos_url":"https://api.github.com/users/sergioc/repos","events_url":"https://api.github.com/users/sergioc/events{/privacy}","received_events_url":"https://api.github.com/users/sergioc/received_events","type":"User","site_admin":false},"created_at":"2015-11-04T20:52:29Z","updated_at":"2015-11-04T20:52:29Z","body":"Would a test management tool be worthy at this time for such a small checklist?"}}