{"action":"created","issue":{"url":"https://api.github.com/repos/egap/registration/issues/10","labels_url":"https://api.github.com/repos/egap/registration/issues/10/labels{/name}","comments_url":"https://api.github.com/repos/egap/registration/issues/10/comments","events_url":"https://api.github.com/repos/egap/registration/issues/10/events","html_url":"https://github.com/egap/registration/issues/10","id":89946727,"number":10,"title":"a new simulate_experiment() function","user":{"login":"graemeblair","id":3320015,"avatar_url":"https://avatars.githubusercontent.com/u/3320015?v=3","gravatar_id":"","url":"https://api.github.com/users/graemeblair","html_url":"https://github.com/graemeblair","followers_url":"https://api.github.com/users/graemeblair/followers","following_url":"https://api.github.com/users/graemeblair/following{/other_user}","gists_url":"https://api.github.com/users/graemeblair/gists{/gist_id}","starred_url":"https://api.github.com/users/graemeblair/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/graemeblair/subscriptions","organizations_url":"https://api.github.com/users/graemeblair/orgs","repos_url":"https://api.github.com/users/graemeblair/repos","events_url":"https://api.github.com/users/graemeblair/events{/privacy}","received_events_url":"https://api.github.com/users/graemeblair/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":{"url":"https://api.github.com/repos/egap/registration/milestones/1","html_url":"https://github.com/egap/registration/milestones/version%200.2","labels_url":"https://api.github.com/repos/egap/registration/milestones/1/labels","id":1174115,"number":1,"title":"version 0.2","description":null,"creator":{"login":"graemeblair","id":3320015,"avatar_url":"https://avatars.githubusercontent.com/u/3320015?v=3","gravatar_id":"","url":"https://api.github.com/users/graemeblair","html_url":"https://github.com/graemeblair","followers_url":"https://api.github.com/users/graemeblair/followers","following_url":"https://api.github.com/users/graemeblair/following{/other_user}","gists_url":"https://api.github.com/users/graemeblair/gists{/gist_id}","starred_url":"https://api.github.com/users/graemeblair/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/graemeblair/subscriptions","organizations_url":"https://api.github.com/users/graemeblair/orgs","repos_url":"https://api.github.com/users/graemeblair/repos","events_url":"https://api.github.com/users/graemeblair/events{/privacy}","received_events_url":"https://api.github.com/users/graemeblair/received_events","type":"User","site_admin":false},"open_issues":1,"closed_issues":0,"state":"open","created_at":"2015-06-21T18:55:03Z","updated_at":"2015-06-21T18:59:07Z","due_on":null,"closed_at":null},"comments":0,"created_at":"2015-06-21T18:59:07Z","updated_at":"2015-06-21T19:01:12Z","closed_at":null,"body":"Following the discussion of bias assessment, which I like a lot, propose the following reworking of various parts of the package that will return a number of frequentist assessments of the design. I think we should get \"version 0.1\" working before we do this, because it entails throwing a few existing functions that almost work under the bus.\r\n\r\nsimulate_experiment() is a new function that returns a matrix where a row is a replicate and there are three columns per comparison that are:\r\n- true sample ATE\r\n- estimated sample ATE\r\n- estimated sample standard error\r\n\r\nand then there are two or more summary columns at the end of the matrix, at least:\r\n- test_success that is arbitrary set of conditions based on all the comparisons in the row\r\n- sample RMSE\r\n\r\nsimulate_experiment() returns that matrix\r\n\r\nsummary(simulate_experiment()) is a new function that summarizes the matrix.\r\n- by default, it gets (1) the power of the design for each comparison based on two-tailed tests for each comparison; and (2) the probability that within a particular run all k comparisons are jointly significant\r\n- it can also accept user-written test_success functions\r\n\r\ndeclare_analysis() is rewritten so it just returns an analysis function, i.e. lm; the test_success function is handled entirely in simulate_experiment()\r\n\r\nget_power() becomes a wrapper of simulate_experiment() that calls simulate_experiment() and returns only the power"},"comment":{"url":"https://api.github.com/repos/egap/registration/issues/comments/113941729","html_url":"https://github.com/egap/registration/issues/10#issuecomment-113941729","issue_url":"https://api.github.com/repos/egap/registration/issues/10","id":113941729,"user":{"login":"graemeblair","id":3320015,"avatar_url":"https://avatars.githubusercontent.com/u/3320015?v=3","gravatar_id":"","url":"https://api.github.com/users/graemeblair","html_url":"https://github.com/graemeblair","followers_url":"https://api.github.com/users/graemeblair/followers","following_url":"https://api.github.com/users/graemeblair/following{/other_user}","gists_url":"https://api.github.com/users/graemeblair/gists{/gist_id}","starred_url":"https://api.github.com/users/graemeblair/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/graemeblair/subscriptions","organizations_url":"https://api.github.com/users/graemeblair/orgs","repos_url":"https://api.github.com/users/graemeblair/repos","events_url":"https://api.github.com/users/graemeblair/events{/privacy}","received_events_url":"https://api.github.com/users/graemeblair/received_events","type":"User","site_admin":false},"created_at":"2015-06-21T19:01:12Z","updated_at":"2015-06-21T19:01:12Z","body":"Sample error, not sample RMSE"}}