{"action":"closed","issue":{"url":"https://api.github.com/repos/haskell/directory/issues/19","labels_url":"https://api.github.com/repos/haskell/directory/issues/19/labels{/name}","comments_url":"https://api.github.com/repos/haskell/directory/issues/19/comments","events_url":"https://api.github.com/repos/haskell/directory/issues/19/events","html_url":"https://github.com/haskell/directory/issues/19","id":58478254,"number":19,"title":"Not one, but two test suites?","user":{"login":"Rufflewind","id":6571068,"avatar_url":"https://avatars.githubusercontent.com/u/6571068?v=3","gravatar_id":"","url":"https://api.github.com/users/Rufflewind","html_url":"https://github.com/Rufflewind","followers_url":"https://api.github.com/users/Rufflewind/followers","following_url":"https://api.github.com/users/Rufflewind/following{/other_user}","gists_url":"https://api.github.com/users/Rufflewind/gists{/gist_id}","starred_url":"https://api.github.com/users/Rufflewind/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/Rufflewind/subscriptions","organizations_url":"https://api.github.com/users/Rufflewind/orgs","repos_url":"https://api.github.com/users/Rufflewind/repos","events_url":"https://api.github.com/users/Rufflewind/events{/privacy}","received_events_url":"https://api.github.com/users/Rufflewind/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/haskell/directory/labels/enhancement","name":"enhancement","color":"84b6eb"}],"state":"closed","locked":false,"assignee":{"login":"Rufflewind","id":6571068,"avatar_url":"https://avatars.githubusercontent.com/u/6571068?v=3","gravatar_id":"","url":"https://api.github.com/users/Rufflewind","html_url":"https://github.com/Rufflewind","followers_url":"https://api.github.com/users/Rufflewind/followers","following_url":"https://api.github.com/users/Rufflewind/following{/other_user}","gists_url":"https://api.github.com/users/Rufflewind/gists{/gist_id}","starred_url":"https://api.github.com/users/Rufflewind/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/Rufflewind/subscriptions","organizations_url":"https://api.github.com/users/Rufflewind/orgs","repos_url":"https://api.github.com/users/Rufflewind/repos","events_url":"https://api.github.com/users/Rufflewind/events{/privacy}","received_events_url":"https://api.github.com/users/Rufflewind/received_events","type":"User","site_admin":false},"milestone":{"url":"https://api.github.com/repos/haskell/directory/milestones/2","html_url":"https://github.com/haskell/directory/milestones/1.2.2","labels_url":"https://api.github.com/repos/haskell/directory/milestones/2/labels","id":936686,"number":2,"title":"1.2.2","description":"","creator":{"login":"hvr","id":285533,"avatar_url":"https://avatars.githubusercontent.com/u/285533?v=3","gravatar_id":"","url":"https://api.github.com/users/hvr","html_url":"https://github.com/hvr","followers_url":"https://api.github.com/users/hvr/followers","following_url":"https://api.github.com/users/hvr/following{/other_user}","gists_url":"https://api.github.com/users/hvr/gists{/gist_id}","starred_url":"https://api.github.com/users/hvr/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/hvr/subscriptions","organizations_url":"https://api.github.com/users/hvr/orgs","repos_url":"https://api.github.com/users/hvr/repos","events_url":"https://api.github.com/users/hvr/events{/privacy}","received_events_url":"https://api.github.com/users/hvr/received_events","type":"User","site_admin":false},"open_issues":0,"closed_issues":7,"state":"open","created_at":"2015-01-15T12:10:02Z","updated_at":"2015-03-06T09:17:13Z","due_on":"2015-03-11T04:00:00Z","closed_at":null},"comments":10,"created_at":"2015-02-21T22:38:36Z","updated_at":"2015-03-06T09:17:13Z","closed_at":"2015-03-06T09:17:13Z","body":"Currently, the majority of the tests require the framework that's bundled with the GHC repository, which makes testing *directory* independently rather difficult.  All such tests are located under `tests`.\r\n\r\n@snoyberg has recently started a stub for tests that can be run under Cabal without the GHC test framework. It could use some love right now.\r\n\r\nFrom here, there are two options I can think of:\r\n\r\n  - **Option A**: Port all the tests from GHC framework to the Cabal framework.  Figure out a way to integrate the Cabal tests into GHC's test suite (somehow?).\r\n  - **Option B**: Keep all the tests in the GHC framework.  Figure out a way to run these tests without GHC.\r\n\r\nI think Option A is more elegant and less difficult than Option B, since in B one would have to embed/install a minimal GHC framework (somehow).\r\n\r\nWhat might be lost in Option A is the fine-grainedness of the tests: from GHC's perspective it will probably be an \"all-or-nothing\" test.\r\n\r\nQuestions:\r\n\r\n  - Is there any reason for sticking to GHC's test framework?\r\n  - Any strong feelings about which option is better? (I'm biased to A)\r\n  - Is there's a better idea?\r\n\r\n---\r\n\r\n**To do**\r\n\r\n  - [ ] Make tests parallelization-safe"}}