{"action":"created","issue":{"url":"https://api.github.com/repos/dotnet/corefx/issues/1477","labels_url":"https://api.github.com/repos/dotnet/corefx/issues/1477/labels{/name}","comments_url":"https://api.github.com/repos/dotnet/corefx/issues/1477/comments","events_url":"https://api.github.com/repos/dotnet/corefx/issues/1477/events","html_url":"https://github.com/dotnet/corefx/issues/1477","id":70288005,"number":1477,"title":"Test infrastructure requirements and scenarios","user":{"login":"Priya91","id":7853870,"avatar_url":"https://avatars.githubusercontent.com/u/7853870?v=3","gravatar_id":"","url":"https://api.github.com/users/Priya91","html_url":"https://github.com/Priya91","followers_url":"https://api.github.com/users/Priya91/followers","following_url":"https://api.github.com/users/Priya91/following{/other_user}","gists_url":"https://api.github.com/users/Priya91/gists{/gist_id}","starred_url":"https://api.github.com/users/Priya91/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/Priya91/subscriptions","organizations_url":"https://api.github.com/users/Priya91/orgs","repos_url":"https://api.github.com/users/Priya91/repos","events_url":"https://api.github.com/users/Priya91/events{/privacy}","received_events_url":"https://api.github.com/users/Priya91/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":3,"created_at":"2015-04-23T02:44:30Z","updated_at":"2015-04-23T15:40:32Z","closed_at":null,"body":"cc @eatdrinksleepcode @weshaggard @krwq \r\n\r\nThis is a consolidation of discussions happening in various issues and PRs. Features to be added:\r\n\r\n1. Provide support to disable entire test projects (without invoking xunit framework) in build, based on Xunit Categories - currently warning is reported for this.\r\n2. Provide support to run tests based on .NET platform - .NET Native, Cloud Optimized, Desktop.\r\n3. What are the category scenarios that we want to support:\r\n  - How to define InnerLoop and OuterLoop to xunit.\r\n  - Defined xunit categories: outerloop, failing, nonwindowstests, nonosxtests, nonlinuxtests\r\n\r\nCurrent msbuild properties in use:\r\nXunit:\r\n\r\n1. WithCategories - 1:1 to -trait\r\n2. WithoutCategories - 1:1 to -notrait\r\n3. DefaultNoCategories - defines categories that are not to be run in plain build.cmd \r\n\r\nOthers:\r\n\r\n1. RunTestsForProject\r\n2. SkipTests \r\n3. UnsupportedPlatforms - skip entire project based on platform"},"comment":{"url":"https://api.github.com/repos/dotnet/corefx/issues/comments/95628329","html_url":"https://github.com/dotnet/corefx/issues/1477#issuecomment-95628329","issue_url":"https://api.github.com/repos/dotnet/corefx/issues/1477","id":95628329,"user":{"login":"weshaggard","id":9010698,"avatar_url":"https://avatars.githubusercontent.com/u/9010698?v=3","gravatar_id":"","url":"https://api.github.com/users/weshaggard","html_url":"https://github.com/weshaggard","followers_url":"https://api.github.com/users/weshaggard/followers","following_url":"https://api.github.com/users/weshaggard/following{/other_user}","gists_url":"https://api.github.com/users/weshaggard/gists{/gist_id}","starred_url":"https://api.github.com/users/weshaggard/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/weshaggard/subscriptions","organizations_url":"https://api.github.com/users/weshaggard/orgs","repos_url":"https://api.github.com/users/weshaggard/repos","events_url":"https://api.github.com/users/weshaggard/events{/privacy}","received_events_url":"https://api.github.com/users/weshaggard/received_events","type":"User","site_admin":false},"created_at":"2015-04-23T15:40:32Z","updated_at":"2015-04-23T15:40:32Z","body":"@Priya91 thanks for opening this issue. I updated the title to more closely match what I'm hoping to get from this discussion. While we should continue to have the discussion as new comments can you keep the original post updated with the current list of requirements and scenarios. Lets use the original post as the spec if you will that we are trying to craft. \r\n\r\nSo with that said you can you reformat it to have at least a Scenarios section that we can use to enumerate the things people are trying to do with the test system. Then also add a requirements section that lists out what our test system requires in order to accomplish the scenarios we agree upon. Once we have those two fairly agreed upon then we can talk about potential technical solutions to the problem. "}}