{"action":"created","issue":{"url":"https://api.github.com/repos/GoogleCloudPlatform/kubernetes/issues/6605","labels_url":"https://api.github.com/repos/GoogleCloudPlatform/kubernetes/issues/6605/labels{/name}","comments_url":"https://api.github.com/repos/GoogleCloudPlatform/kubernetes/issues/6605/comments","events_url":"https://api.github.com/repos/GoogleCloudPlatform/kubernetes/issues/6605/events","html_url":"https://github.com/GoogleCloudPlatform/kubernetes/issues/6605","id":67245661,"number":6605,"title":"Let's figure out multi-platform automated e2e!","user":{"login":"justinsb","id":100893,"avatar_url":"https://avatars.githubusercontent.com/u/100893?v=3","gravatar_id":"","url":"https://api.github.com/users/justinsb","html_url":"https://github.com/justinsb","followers_url":"https://api.github.com/users/justinsb/followers","following_url":"https://api.github.com/users/justinsb/following{/other_user}","gists_url":"https://api.github.com/users/justinsb/gists{/gist_id}","starred_url":"https://api.github.com/users/justinsb/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/justinsb/subscriptions","organizations_url":"https://api.github.com/users/justinsb/orgs","repos_url":"https://api.github.com/users/justinsb/repos","events_url":"https://api.github.com/users/justinsb/events{/privacy}","received_events_url":"https://api.github.com/users/justinsb/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/GoogleCloudPlatform/kubernetes/labels/area/test","name":"area/test","color":"fad8c7"},{"url":"https://api.github.com/repos/GoogleCloudPlatform/kubernetes/labels/priority/P3","name":"priority/P3","color":"fef2c0"},{"url":"https://api.github.com/repos/GoogleCloudPlatform/kubernetes/labels/team/testing","name":"team/testing","color":"d2b48c"}],"state":"open","locked":false,"assignee":{"login":"zmerlynn","id":4942464,"avatar_url":"https://avatars.githubusercontent.com/u/4942464?v=3","gravatar_id":"","url":"https://api.github.com/users/zmerlynn","html_url":"https://github.com/zmerlynn","followers_url":"https://api.github.com/users/zmerlynn/followers","following_url":"https://api.github.com/users/zmerlynn/following{/other_user}","gists_url":"https://api.github.com/users/zmerlynn/gists{/gist_id}","starred_url":"https://api.github.com/users/zmerlynn/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/zmerlynn/subscriptions","organizations_url":"https://api.github.com/users/zmerlynn/orgs","repos_url":"https://api.github.com/users/zmerlynn/repos","events_url":"https://api.github.com/users/zmerlynn/events{/privacy}","received_events_url":"https://api.github.com/users/zmerlynn/received_events","type":"User","site_admin":false},"milestone":null,"comments":4,"created_at":"2015-04-08T23:48:57Z","updated_at":"2015-04-10T22:56:44Z","closed_at":null,"body":"I now have the AWS e2e tests running in a Jenkins instance, and I think they will all pass once my active PRs merge (load balancers & storage)  I am publishing the e2e results to S3 (here's an example; though I will likely change the URL in the near-future: http://public-kubernetes-meteor.s3-website-us-east-1.amazonaws.com/builds/kubernetes-e2e-aws/5/_1.xml )\r\n\r\nI also in the past had this working with CircleCI.  CircleCI builds have the advantage that they are naturally publicly available (if you want them to be).  I believe there was an issue with running the GCE builds on it though?\r\n\r\nWe've talked in the past about getting any platforms that want to contribute e2e test results contributing to an aggregating system.  Let's try to figure out what that should be!\r\n\r\n@zmerlynn I know you had some ideas?"},"comment":{"url":"https://api.github.com/repos/GoogleCloudPlatform/kubernetes/issues/comments/91712050","html_url":"https://github.com/GoogleCloudPlatform/kubernetes/issues/6605#issuecomment-91712050","issue_url":"https://api.github.com/repos/GoogleCloudPlatform/kubernetes/issues/6605","id":91712050,"user":{"login":"ixdy","id":8061296,"avatar_url":"https://avatars.githubusercontent.com/u/8061296?v=3","gravatar_id":"","url":"https://api.github.com/users/ixdy","html_url":"https://github.com/ixdy","followers_url":"https://api.github.com/users/ixdy/followers","following_url":"https://api.github.com/users/ixdy/following{/other_user}","gists_url":"https://api.github.com/users/ixdy/gists{/gist_id}","starred_url":"https://api.github.com/users/ixdy/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/ixdy/subscriptions","organizations_url":"https://api.github.com/users/ixdy/orgs","repos_url":"https://api.github.com/users/ixdy/repos","events_url":"https://api.github.com/users/ixdy/events{/privacy}","received_events_url":"https://api.github.com/users/ixdy/received_events","type":"User","site_admin":false},"created_at":"2015-04-10T22:56:44Z","updated_at":"2015-04-10T22:56:44Z","body":"@justinsb awesome progress!\r\n\r\nZach may have more specifics on why we can't (or at least haven't yet) used an external CI system for running e2e tests on GCE. I suspect at least part of it might be because we use the same account to run tests against GKE, and that account has some special permissions there which we want to protect.\r\n\r\nI'm still trying to figure out the best way to have aggregated e2e results for a variety of providers.\r\n\r\nWe could maybe set up one of the public CI services (like CircleCI, or Shippable, or maybe even Travis?), though I don't know how we'd coordinate having different cloud providers there, and it seems likely that some folks will probably still prefer to have a private CI system testing against their infrastructure but exporting results publicly (e.g. GKE).\r\n\r\nI've looked into setting up a public Jenkins instance which could have build results published to it, but it seems like every third-party job publishing to this instance would need quite broad permissions, including effectively being able to run anything on the host running Jenkins.\r\n\r\nI really wish there were some service that just ingested the JUnit XML files and drew pretty dashboards and graphs and things like that, but I've had no luck finding anything like that."}}