{"action":"created","issue":{"url":"https://api.github.com/repos/guardian/content-api-sanity-tests/issues/60","labels_url":"https://api.github.com/repos/guardian/content-api-sanity-tests/issues/60/labels{/name}","comments_url":"https://api.github.com/repos/guardian/content-api-sanity-tests/issues/60/comments","events_url":"https://api.github.com/repos/guardian/content-api-sanity-tests/issues/60/events","html_url":"https://github.com/guardian/content-api-sanity-tests/pull/60","id":92910358,"number":60,"title":"Add a CloudWatch alarm to check that tests are actually running","user":{"login":"cb372","id":106760,"avatar_url":"https://avatars.githubusercontent.com/u/106760?v=3","gravatar_id":"","url":"https://api.github.com/users/cb372","html_url":"https://github.com/cb372","followers_url":"https://api.github.com/users/cb372/followers","following_url":"https://api.github.com/users/cb372/following{/other_user}","gists_url":"https://api.github.com/users/cb372/gists{/gist_id}","starred_url":"https://api.github.com/users/cb372/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/cb372/subscriptions","organizations_url":"https://api.github.com/users/cb372/orgs","repos_url":"https://api.github.com/users/cb372/repos","events_url":"https://api.github.com/users/cb372/events{/privacy}","received_events_url":"https://api.github.com/users/cb372/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":1,"created_at":"2015-07-03T17:04:39Z","updated_at":"2015-07-15T09:59:48Z","closed_at":null,"pull_request":{"url":"https://api.github.com/repos/guardian/content-api-sanity-tests/pulls/60","html_url":"https://github.com/guardian/content-api-sanity-tests/pull/60","diff_url":"https://github.com/guardian/content-api-sanity-tests/pull/60.diff","patch_url":"https://github.com/guardian/content-api-sanity-tests/pull/60.patch"},"body":"* Publish metrics (only in PROD) on the number of successful tests, failed tests, and test runs (i.e. the whole suite of tests being run) to CloudWatch\r\n* Add an alarm to alert us if the number of successful tests drops below a threshold\r\n\r\nNote that this is in addition to, not a replacement for, the existing PagerDuty alerts that are triggered when tests fail. We had a problem recently where the test suite was crashing before even trying to run the tests, so the tests did not fail, thus we didn't get any PagerDuty alerts. The system was just crashing every 30 seconds and we had no way of knowing."},"comment":{"url":"https://api.github.com/repos/guardian/content-api-sanity-tests/issues/comments/121562684","html_url":"https://github.com/guardian/content-api-sanity-tests/pull/60#issuecomment-121562684","issue_url":"https://api.github.com/repos/guardian/content-api-sanity-tests/issues/60","id":121562684,"user":{"login":"mchv","id":615085,"avatar_url":"https://avatars.githubusercontent.com/u/615085?v=3","gravatar_id":"","url":"https://api.github.com/users/mchv","html_url":"https://github.com/mchv","followers_url":"https://api.github.com/users/mchv/followers","following_url":"https://api.github.com/users/mchv/following{/other_user}","gists_url":"https://api.github.com/users/mchv/gists{/gist_id}","starred_url":"https://api.github.com/users/mchv/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/mchv/subscriptions","organizations_url":"https://api.github.com/users/mchv/orgs","repos_url":"https://api.github.com/users/mchv/repos","events_url":"https://api.github.com/users/mchv/events{/privacy}","received_events_url":"https://api.github.com/users/mchv/received_events","type":"User","site_admin":false},"created_at":"2015-07-15T09:59:48Z","updated_at":"2015-07-15T09:59:48Z","body":":+1:  looks good.\r\nHowever we need to monitor the aws associated price as cloudwatch is quite expensive"}}