{"action":"created","issue":{"url":"https://api.github.com/repos/ipfs/infrastructure/issues/20","labels_url":"https://api.github.com/repos/ipfs/infrastructure/issues/20/labels{/name}","comments_url":"https://api.github.com/repos/ipfs/infrastructure/issues/20/comments","events_url":"https://api.github.com/repos/ipfs/infrastructure/issues/20/events","html_url":"https://github.com/ipfs/infrastructure/issues/20","id":76121149,"number":20,"title":"Testing Infrastructure","user":{"login":"jbenet","id":138401,"avatar_url":"https://avatars.githubusercontent.com/u/138401?v=3","gravatar_id":"","url":"https://api.github.com/users/jbenet","html_url":"https://github.com/jbenet","followers_url":"https://api.github.com/users/jbenet/followers","following_url":"https://api.github.com/users/jbenet/following{/other_user}","gists_url":"https://api.github.com/users/jbenet/gists{/gist_id}","starred_url":"https://api.github.com/users/jbenet/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jbenet/subscriptions","organizations_url":"https://api.github.com/users/jbenet/orgs","repos_url":"https://api.github.com/users/jbenet/repos","events_url":"https://api.github.com/users/jbenet/events{/privacy}","received_events_url":"https://api.github.com/users/jbenet/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":14,"created_at":"2015-05-13T20:55:36Z","updated_at":"2015-06-29T06:30:33Z","closed_at":null,"body":"Recap: \r\n- https://github.com/ipfs/infrastructure/issues/9\r\n- https://github.com/ipfs/go-ipfs/issues/283\r\n- https://github.com/ipfs/go-ipfs/pull/1220#issuecomment-101639464\r\n\r\n---\r\n\r\nWe should organize our testing infrastructure concerns.\r\n\r\nOur _constraints_ are:\r\n\r\n- (hard) robust, reliable way to test our code\r\n- (hard) able to run all the tests (with iptb, we no longer need docker)\r\n- (med) smooth, friendly UX for contributors -- including new contributors (travis wins, by far).\r\n- (hard) well integrated with github PRs and commit status indicators (travis wins by far)\r\n- (med) no management overhead on our side (jenkins was a huge pain, that's why we got rid of it) \r\n- (soft) tests take <5min\r\n- (soft) cheap. But doesn't even have to be free. i keep trying to give travis-ci money (they won't take it :( )\r\n\r\nUnfortunately, after trying multiple CI systems, always end up coming back to travis. (We used jenkins for a long time and it was a huge pain to manage. life is much better without it). \r\n\r\nClose seconds are:\r\n- https://circleci.com/ -- pricey but hear good things. not sure how well they integrate with OSS\r\n- https://codeship.com/ -- they keep improving, but don't take security seriously.\r\n\r\nFor testing on windows, we could use:\r\n- http://www.appveyor.com/\r\n"},"comment":{"url":"https://api.github.com/repos/ipfs/infrastructure/issues/comments/116476391","html_url":"https://github.com/ipfs/infrastructure/issues/20#issuecomment-116476391","issue_url":"https://api.github.com/repos/ipfs/infrastructure/issues/20","id":116476391,"user":{"login":"harlantwood","id":38769,"avatar_url":"https://avatars.githubusercontent.com/u/38769?v=3","gravatar_id":"","url":"https://api.github.com/users/harlantwood","html_url":"https://github.com/harlantwood","followers_url":"https://api.github.com/users/harlantwood/followers","following_url":"https://api.github.com/users/harlantwood/following{/other_user}","gists_url":"https://api.github.com/users/harlantwood/gists{/gist_id}","starred_url":"https://api.github.com/users/harlantwood/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/harlantwood/subscriptions","organizations_url":"https://api.github.com/users/harlantwood/orgs","repos_url":"https://api.github.com/users/harlantwood/repos","events_url":"https://api.github.com/users/harlantwood/events{/privacy}","received_events_url":"https://api.github.com/users/harlantwood/received_events","type":"User","site_admin":false},"created_at":"2015-06-29T06:30:32Z","updated_at":"2015-06-29T06:30:32Z","body":"Great to see that [go-ipfs is passing now on Cirlce CI](https://circleci.com/gh/ipfs/go-ipfs/444) (nice work @jbenet).\r\n\r\nI know that we've installed _both_ Circle and Travis on a few projects.  Which do people prefer?  It would be great to standardize, especially to move forward on [aggregating CI for app IPFS projects into a single place](https://github.com/ipfs/infrastructure/issues/25#issuecomment-116476092).\r\n\r\n"}}