{"action":"created","issue":{"url":"https://api.github.com/repos/servo/servo/issues/8587","labels_url":"https://api.github.com/repos/servo/servo/issues/8587/labels{/name}","comments_url":"https://api.github.com/repos/servo/servo/issues/8587/comments","events_url":"https://api.github.com/repos/servo/servo/issues/8587/events","html_url":"https://github.com/servo/servo/issues/8587","id":117608136,"number":8587,"title":"Check that regenerating the test manifest does not change it","user":{"login":"jdm","id":27658,"avatar_url":"https://avatars.githubusercontent.com/u/27658?v=3","gravatar_id":"","url":"https://api.github.com/users/jdm","html_url":"https://github.com/jdm","followers_url":"https://api.github.com/users/jdm/followers","following_url":"https://api.github.com/users/jdm/following{/other_user}","gists_url":"https://api.github.com/users/jdm/gists{/gist_id}","starred_url":"https://api.github.com/users/jdm/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jdm/subscriptions","organizations_url":"https://api.github.com/users/jdm/orgs","repos_url":"https://api.github.com/users/jdm/repos","events_url":"https://api.github.com/users/jdm/events{/privacy}","received_events_url":"https://api.github.com/users/jdm/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/servo/servo/labels/A-infrastructure","name":"A-infrastructure","color":"d7e102"},{"url":"https://api.github.com/repos/servo/servo/labels/E-easy","name":"E-easy","color":"02e10c"}],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":1,"created_at":"2015-11-18T15:14:45Z","updated_at":"2015-11-19T08:56:54Z","closed_at":null,"body":"We have a check that runs on TravisCI that ensures that our Cargo.lock files do not change as part of the build: https://github.com/servo/servo/blob/master/etc/ci/lockfile_changed.sh\r\nWe should run a similar check that `./mach test-wpt --manifest-update` does not change either of the `MANIFEST.json` files under `tests/wpt`. This requires adding a script to this repository, then adding it to the [list of commands](https://github.com/servo/saltfs/blob/master/buildbot/master/master.cfg#L190) to run on the build machines.\r\n\r\nThis can be tested locally by adding a new test to `tests/wpt/mozilla/tests/mozilla` and making sure the new script reports a failure."},"comment":{"url":"https://api.github.com/repos/servo/servo/issues/comments/157993321","html_url":"https://github.com/servo/servo/issues/8587#issuecomment-157993321","issue_url":"https://api.github.com/repos/servo/servo/issues/8587","id":157993321,"user":{"login":"mfeckie","id":1583673,"avatar_url":"https://avatars.githubusercontent.com/u/1583673?v=3","gravatar_id":"","url":"https://api.github.com/users/mfeckie","html_url":"https://github.com/mfeckie","followers_url":"https://api.github.com/users/mfeckie/followers","following_url":"https://api.github.com/users/mfeckie/following{/other_user}","gists_url":"https://api.github.com/users/mfeckie/gists{/gist_id}","starred_url":"https://api.github.com/users/mfeckie/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/mfeckie/subscriptions","organizations_url":"https://api.github.com/users/mfeckie/orgs","repos_url":"https://api.github.com/users/mfeckie/repos","events_url":"https://api.github.com/users/mfeckie/events{/privacy}","received_events_url":"https://api.github.com/users/mfeckie/received_events","type":"User","site_admin":false},"created_at":"2015-11-19T08:56:54Z","updated_at":"2015-11-19T08:56:54Z","body":"@jdm I'm keen to try this one"}}