{"action":"created","issue":{"url":"https://api.github.com/repos/marl/jams/issues/16","labels_url":"https://api.github.com/repos/marl/jams/issues/16/labels{/name}","comments_url":"https://api.github.com/repos/marl/jams/issues/16/comments","events_url":"https://api.github.com/repos/marl/jams/issues/16/events","html_url":"https://github.com/marl/jams/issues/16","id":56129717,"number":16,"title":"mir_eval integration","user":{"login":"bmcfee","id":1190540,"avatar_url":"https://avatars.githubusercontent.com/u/1190540?v=3","gravatar_id":"","url":"https://api.github.com/users/bmcfee","html_url":"https://github.com/bmcfee","followers_url":"https://api.github.com/users/bmcfee/followers","following_url":"https://api.github.com/users/bmcfee/following{/other_user}","gists_url":"https://api.github.com/users/bmcfee/gists{/gist_id}","starred_url":"https://api.github.com/users/bmcfee/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/bmcfee/subscriptions","organizations_url":"https://api.github.com/users/bmcfee/orgs","repos_url":"https://api.github.com/users/bmcfee/repos","events_url":"https://api.github.com/users/bmcfee/events{/privacy}","received_events_url":"https://api.github.com/users/bmcfee/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/marl/jams/labels/enhancement","name":"enhancement","color":"84b6eb"},{"url":"https://api.github.com/repos/marl/jams/labels/pyjams","name":"pyjams","color":"bfe5bf"}],"state":"open","locked":false,"assignee":{"login":"bmcfee","id":1190540,"avatar_url":"https://avatars.githubusercontent.com/u/1190540?v=3","gravatar_id":"","url":"https://api.github.com/users/bmcfee","html_url":"https://github.com/bmcfee","followers_url":"https://api.github.com/users/bmcfee/followers","following_url":"https://api.github.com/users/bmcfee/following{/other_user}","gists_url":"https://api.github.com/users/bmcfee/gists{/gist_id}","starred_url":"https://api.github.com/users/bmcfee/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/bmcfee/subscriptions","organizations_url":"https://api.github.com/users/bmcfee/orgs","repos_url":"https://api.github.com/users/bmcfee/repos","events_url":"https://api.github.com/users/bmcfee/events{/privacy}","received_events_url":"https://api.github.com/users/bmcfee/received_events","type":"User","site_admin":false},"milestone":{"url":"https://api.github.com/repos/marl/jams/milestones/1","html_url":"https://github.com/marl/jams/milestones/0.2","labels_url":"https://api.github.com/repos/marl/jams/milestones/1/labels","id":1112647,"number":1,"title":"0.2","description":"","creator":{"login":"bmcfee","id":1190540,"avatar_url":"https://avatars.githubusercontent.com/u/1190540?v=3","gravatar_id":"","url":"https://api.github.com/users/bmcfee","html_url":"https://github.com/bmcfee","followers_url":"https://api.github.com/users/bmcfee/followers","following_url":"https://api.github.com/users/bmcfee/following{/other_user}","gists_url":"https://api.github.com/users/bmcfee/gists{/gist_id}","starred_url":"https://api.github.com/users/bmcfee/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/bmcfee/subscriptions","organizations_url":"https://api.github.com/users/bmcfee/orgs","repos_url":"https://api.github.com/users/bmcfee/repos","events_url":"https://api.github.com/users/bmcfee/events{/privacy}","received_events_url":"https://api.github.com/users/bmcfee/received_events","type":"User","site_admin":false},"open_issues":6,"closed_issues":3,"state":"open","created_at":"2015-05-15T19:27:50Z","updated_at":"2015-05-20T19:10:15Z","due_on":null,"closed_at":null},"comments":4,"created_at":"2015-01-31T16:15:52Z","updated_at":"2015-05-28T20:33:42Z","closed_at":null,"body":"Quick thoughts about making integration with mir_eval simple:\r\n\r\n* Provide functionality to generate and populate Annotation objects from .lab files\r\n* Provide wrapper functions for all mir_eval submodules\r\n  * This can be implemented via a handful of transparent decorators\r\n  * The decorated evaluators accept two Annotation objects `(ref_annotation, est_annotation)`, does the necessary unpacking into `mir_eval` array/list format, and returns the result\r\n  * We may need multiple decorators: events, labeled events, intervals, and labeled intervals.  Possibly more may be necessary depending on the task/metric.\r\n  * We may also need to do docstring mangling to change the function signature while retaining the description."},"comment":{"url":"https://api.github.com/repos/marl/jams/issues/comments/106587723","html_url":"https://github.com/marl/jams/issues/16#issuecomment-106587723","issue_url":"https://api.github.com/repos/marl/jams/issues/16","id":106587723,"user":{"login":"bmcfee","id":1190540,"avatar_url":"https://avatars.githubusercontent.com/u/1190540?v=3","gravatar_id":"","url":"https://api.github.com/users/bmcfee","html_url":"https://github.com/bmcfee","followers_url":"https://api.github.com/users/bmcfee/followers","following_url":"https://api.github.com/users/bmcfee/following{/other_user}","gists_url":"https://api.github.com/users/bmcfee/gists{/gist_id}","starred_url":"https://api.github.com/users/bmcfee/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/bmcfee/subscriptions","organizations_url":"https://api.github.com/users/bmcfee/orgs","repos_url":"https://api.github.com/users/bmcfee/repos","events_url":"https://api.github.com/users/bmcfee/events{/privacy}","received_events_url":"https://api.github.com/users/bmcfee/received_events","type":"User","site_admin":false},"created_at":"2015-05-28T20:33:42Z","updated_at":"2015-05-28T20:33:42Z","body":"Finally started implementing tests for the eval module #26 ; this looks to be pretty badly broken.\r\n\r\nThe event-oriented evaluation wrappers (beat and onset) work, since their call signatures fit with `mir_eval`.  The others (chord, segment, tempo) do not work, since the wrapped versions take two annotations as input, while mir_eval takes more than two input arguments (eg, `ref_intervals, ref_labels, est_intervals, est_labels`).\r\n\r\nWe'll probably have to rethink the structuring of this decorator/wrapper stuff."}}