{"action":"closed","issue":{"url":"https://api.github.com/repos/jquery/qunit/issues/815","labels_url":"https://api.github.com/repos/jquery/qunit/issues/815/labels{/name}","comments_url":"https://api.github.com/repos/jquery/qunit/issues/815/comments","events_url":"https://api.github.com/repos/jquery/qunit/issues/815/events","html_url":"https://github.com/jquery/qunit/issues/815","id":70914478,"number":815,"title":"browserstack-runner improvements","user":{"login":"jzaefferer","id":52585,"avatar_url":"https://avatars.githubusercontent.com/u/52585?v=3","gravatar_id":"","url":"https://api.github.com/users/jzaefferer","html_url":"https://github.com/jzaefferer","followers_url":"https://api.github.com/users/jzaefferer/followers","following_url":"https://api.github.com/users/jzaefferer/following{/other_user}","gists_url":"https://api.github.com/users/jzaefferer/gists{/gist_id}","starred_url":"https://api.github.com/users/jzaefferer/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jzaefferer/subscriptions","organizations_url":"https://api.github.com/users/jzaefferer/orgs","repos_url":"https://api.github.com/users/jzaefferer/repos","events_url":"https://api.github.com/users/jzaefferer/events{/privacy}","received_events_url":"https://api.github.com/users/jzaefferer/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"milestone":null,"comments":0,"created_at":"2015-04-25T14:01:01Z","updated_at":"2015-09-10T18:46:48Z","closed_at":"2015-09-10T18:46:48Z","body":"Currently we run all our testsuites against most of our supported browsers for PRs and commits to master. With plenty of failures due to timeouts, this doesn't provide near as much value as it should. I'd like to use this issue to discuss some options for getting more values from this setup.\r\n\r\nOne idea: Only run the main tests for \"all\" commits, then set up a separate browserstack.json (or browserstack.js, might work) that runs all suites in (more|all) browsers, but only for some commits, e.g., all commits to master. The latter could also do multiple runs, each running just one of the testsuites, if that helps avoid the timeouts.\r\n\r\nMeanwhile we should use https://browserstack.com/automate to track failing tests, check which ones take forever to run (causing later suites to time out, since the 5 minute window is over), along with any other failures, and consistently report those back to support@browserstack.com. If we keep ignoring these issues, we won't make any progress."}}