{"action":"created","issue":{"url":"https://api.github.com/repos/craffel/mir_eval/issues/114","labels_url":"https://api.github.com/repos/craffel/mir_eval/issues/114/labels{/name}","comments_url":"https://api.github.com/repos/craffel/mir_eval/issues/114/comments","events_url":"https://api.github.com/repos/craffel/mir_eval/issues/114/events","html_url":"https://github.com/craffel/mir_eval/issues/114","id":65897174,"number":114,"title":"Segmentation evaluation: 'NCE Over' score delivers wrong result","user":{"login":"grrrr","id":163366,"avatar_url":"https://avatars.githubusercontent.com/u/163366?v=3","gravatar_id":"","url":"https://api.github.com/users/grrrr","html_url":"https://github.com/grrrr","followers_url":"https://api.github.com/users/grrrr/followers","following_url":"https://api.github.com/users/grrrr/following{/other_user}","gists_url":"https://api.github.com/users/grrrr/gists{/gist_id}","starred_url":"https://api.github.com/users/grrrr/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/grrrr/subscriptions","organizations_url":"https://api.github.com/users/grrrr/orgs","repos_url":"https://api.github.com/users/grrrr/repos","events_url":"https://api.github.com/users/grrrr/events{/privacy}","received_events_url":"https://api.github.com/users/grrrr/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":8,"created_at":"2015-04-02T10:11:00Z","updated_at":"2015-04-02T18:42:49Z","closed_at":null,"body":"The following code\r\n```\r\nimport numpy as np\r\nimport mir_eval\r\nref_intervals = np.asarray([(0,1),(1,2)],dtype=float)\r\nref_labels = ['A', 'A']\r\nest_intervals = ref_intervals\r\nest_labels = ref_labels\r\nprint mir_eval.segment.evaluate(ref_intervals, ref_labels, est_intervals, est_labels)['NCE Over']\r\n```\r\ndelivers 0 for the NCE over-segmentation score, although it should be 1.\r\nA realistic example where this happens is SALAMI index 32, for the two annotations given as reference and estimate, respectively."},"comment":{"url":"https://api.github.com/repos/craffel/mir_eval/issues/comments/89005694","html_url":"https://github.com/craffel/mir_eval/issues/114#issuecomment-89005694","issue_url":"https://api.github.com/repos/craffel/mir_eval/issues/114","id":89005694,"user":{"login":"craffel","id":417568,"avatar_url":"https://avatars.githubusercontent.com/u/417568?v=3","gravatar_id":"","url":"https://api.github.com/users/craffel","html_url":"https://github.com/craffel","followers_url":"https://api.github.com/users/craffel/followers","following_url":"https://api.github.com/users/craffel/following{/other_user}","gists_url":"https://api.github.com/users/craffel/gists{/gist_id}","starred_url":"https://api.github.com/users/craffel/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/craffel/subscriptions","organizations_url":"https://api.github.com/users/craffel/orgs","repos_url":"https://api.github.com/users/craffel/repos","events_url":"https://api.github.com/users/craffel/events{/privacy}","received_events_url":"https://api.github.com/users/craffel/received_events","type":"User","site_admin":false},"created_at":"2015-04-02T18:42:48Z","updated_at":"2015-04-02T18:42:48Z","body":"> It's not coming up in my search (maybe @craffel can track it down?)\r\n\r\nI'm not finding it either.  This discussion may have happened IRL, so it's good that we are getting it out again here.\r\n\r\n> My first cut at the segment submodule included this eval, but we dropped it when removing the dependency on sklearn.\r\n\r\nI don't think dropping the sklearn dependency removed any functionality, am I wrong? The commit in question: b0cc4e6"}}