{"action":"created","issue":{"url":"https://api.github.com/repos/dart-lang/test/issues/272","labels_url":"https://api.github.com/repos/dart-lang/test/issues/272/labels{/name}","comments_url":"https://api.github.com/repos/dart-lang/test/issues/272/comments","events_url":"https://api.github.com/repos/dart-lang/test/issues/272/events","html_url":"https://github.com/dart-lang/test/issues/272","id":87334242,"number":272,"title":"What are the differences/trade-offs between these two ways of running tests?","user":{"login":"sethladd","id":5479,"avatar_url":"https://avatars.githubusercontent.com/u/5479?v=3","gravatar_id":"","url":"https://api.github.com/users/sethladd","html_url":"https://github.com/sethladd","followers_url":"https://api.github.com/users/sethladd/followers","following_url":"https://api.github.com/users/sethladd/following{/other_user}","gists_url":"https://api.github.com/users/sethladd/gists{/gist_id}","starred_url":"https://api.github.com/users/sethladd/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/sethladd/subscriptions","organizations_url":"https://api.github.com/users/sethladd/orgs","repos_url":"https://api.github.com/users/sethladd/repos","events_url":"https://api.github.com/users/sethladd/events{/privacy}","received_events_url":"https://api.github.com/users/sethladd/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/dart-lang/test/labels/question","name":"question","color":"cc317c"}],"state":"closed","locked":false,"assignee":null,"milestone":null,"comments":5,"created_at":"2015-06-11T12:45:18Z","updated_at":"2015-06-11T18:57:50Z","closed_at":"2015-06-11T18:57:49Z","body":"Hi,\r\n\r\nCan you help me understand the pros/cons of these two ways to run the tests?\r\n\r\n`dart --checked test/all.dart`\r\n\r\nor\r\n\r\n`pub run test`  (assumes I have the latest SDK and checked mode is turned on)\r\n\r\n?\r\n\r\nThanks!"},"comment":{"url":"https://api.github.com/repos/dart-lang/test/issues/comments/111239512","html_url":"https://github.com/dart-lang/test/issues/272#issuecomment-111239512","issue_url":"https://api.github.com/repos/dart-lang/test/issues/272","id":111239512,"user":{"login":"nex3","id":188,"avatar_url":"https://avatars.githubusercontent.com/u/188?v=3","gravatar_id":"","url":"https://api.github.com/users/nex3","html_url":"https://github.com/nex3","followers_url":"https://api.github.com/users/nex3/followers","following_url":"https://api.github.com/users/nex3/following{/other_user}","gists_url":"https://api.github.com/users/nex3/gists{/gist_id}","starred_url":"https://api.github.com/users/nex3/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/nex3/subscriptions","organizations_url":"https://api.github.com/users/nex3/orgs","repos_url":"https://api.github.com/users/nex3/repos","events_url":"https://api.github.com/users/nex3/events{/privacy}","received_events_url":"https://api.github.com/users/nex3/received_events","type":"User","site_admin":false},"created_at":"2015-06-11T18:57:49Z","updated_at":"2015-06-11T18:57:49Z","body":"@sethladd\r\n\r\nRunning a test file manually via `dart` is meant as a quick-and-dirty shortcut, but it doesn't (and can't) support many of the features of the test runner, including parsing command-line arguments (which means that there's no way of selecting a single test to run) or suite-level metadata (which means there's no way of only running test suites on platforms they support). Many features that are planned for the future, like configuration files and plugins, also won't work with files run directly via `dart`.\r\n\r\n> One difference, is that `dart --checked test/all.dart` is 5 seconds faster than `pub run test` on dartdoc tests on my machine. It's the difference between 10 secs and 15 seconds.\r\n\r\n@kevmoo's right that I have a patch to help mitigate this; see f5efdf6a412f9ae72e40e5d2f7b0c7f50ff05505. A lot of it is just dart-lang/sdk#20470, though; `pub run test` loads pub, the test runner, and a bunch of test files in separate isolates, which means that the VM's code-loading performance becomes very important.\r\n\r\n@zoechi \r\n\r\n> What I have gathered `dart --checked test/all.dart` will decease to be supported when debugging works with `pub run ...`.\r\n\r\nThis isn't quite accurate. We will no longer support running test files directly *in the browser* once we have a good debugging story. We plan to support running test files directly from the command line indefinitely."}}