{"action":"created","issue":{"url":"https://api.github.com/repos/craffel/mir_eval/issues/115","labels_url":"https://api.github.com/repos/craffel/mir_eval/issues/115/labels{/name}","comments_url":"https://api.github.com/repos/craffel/mir_eval/issues/115/comments","events_url":"https://api.github.com/repos/craffel/mir_eval/issues/115/events","html_url":"https://github.com/craffel/mir_eval/issues/115","id":67173710,"number":115,"title":"Segmentation evaluation - boundary detection: to trim or not to trim / special segment labels","user":{"login":"grrrr","id":163366,"avatar_url":"https://avatars.githubusercontent.com/u/163366?v=3","gravatar_id":"","url":"https://api.github.com/users/grrrr","html_url":"https://github.com/grrrr","followers_url":"https://api.github.com/users/grrrr/followers","following_url":"https://api.github.com/users/grrrr/following{/other_user}","gists_url":"https://api.github.com/users/grrrr/gists{/gist_id}","starred_url":"https://api.github.com/users/grrrr/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/grrrr/subscriptions","organizations_url":"https://api.github.com/users/grrrr/orgs","repos_url":"https://api.github.com/users/grrrr/repos","events_url":"https://api.github.com/users/grrrr/events{/privacy}","received_events_url":"https://api.github.com/users/grrrr/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":1,"created_at":"2015-04-08T16:58:05Z","updated_at":"2015-04-08T17:48:07Z","closed_at":null,"body":"Quite frequently, ground-truth annotations contain leading and/or trailing silence, typically (e.g. in SALAMI) annotated using special segment labels like 'Silence'. When such a special segment label appears at the front, the start time of this segment does not contain a real boundary which boundary detection algorithms would find, conversely for ending times of silent end segments. \r\nCurrently, it seems that the segment.detection function must be tricked by introducing very short silent segments, if those are not already present in the ground-truth, to consistently trim them, or not.\r\n"},"comment":{"url":"https://api.github.com/repos/craffel/mir_eval/issues/comments/90986350","html_url":"https://github.com/craffel/mir_eval/issues/115#issuecomment-90986350","issue_url":"https://api.github.com/repos/craffel/mir_eval/issues/115","id":90986350,"user":{"login":"bmcfee","id":1190540,"avatar_url":"https://avatars.githubusercontent.com/u/1190540?v=3","gravatar_id":"","url":"https://api.github.com/users/bmcfee","html_url":"https://github.com/bmcfee","followers_url":"https://api.github.com/users/bmcfee/followers","following_url":"https://api.github.com/users/bmcfee/following{/other_user}","gists_url":"https://api.github.com/users/bmcfee/gists{/gist_id}","starred_url":"https://api.github.com/users/bmcfee/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/bmcfee/subscriptions","organizations_url":"https://api.github.com/users/bmcfee/orgs","repos_url":"https://api.github.com/users/bmcfee/repos","events_url":"https://api.github.com/users/bmcfee/events{/privacy}","received_events_url":"https://api.github.com/users/bmcfee/received_events","type":"User","site_admin":false},"created_at":"2015-04-08T17:48:07Z","updated_at":"2015-04-08T17:48:07Z","body":"> Quite frequently, ground-truth annotations contain leading and/or trailing silence, typically (e.g. in SALAMI) annotated using special segment labels like 'Silence'. When such a special segment label appears at the front, the start time of this segment does not contain a real boundary which boundary detection algorithms would find, conversely for ending times of silent end segments.\r\n\r\nDo you mean the start or the end of the first segment?\r\n\r\nIn a well-formed annotation, the start time should be 0, which I've argued should never be counted as positive hits.  Setting `trim=True` will discount the first and last segment boundaries: the only reason it's set to `False` is backwards compatibility against mirex by default.\r\n\r\nIf you mean the end time of the first segment, then you're talking about non-trivial manipulation of the annotation data, and I'd be very careful here.\r\n\r\n\r\n\r\n> Currently, it seems that the segment.detection function must be tricked by introducing very short silent segments, if those are not already present in the ground-truth, to consistently trim them, or not.\r\n\r\nI'm not sure what you mean here: are you talking about modifying the reference annotations?  Or the estimated annotations?  I don't see why either should be necessary."}}