{"action":"created","issue":{"url":"https://api.github.com/repos/stanfordnlp/CoreNLP/issues/62","labels_url":"https://api.github.com/repos/stanfordnlp/CoreNLP/issues/62/labels{/name}","comments_url":"https://api.github.com/repos/stanfordnlp/CoreNLP/issues/62/comments","events_url":"https://api.github.com/repos/stanfordnlp/CoreNLP/issues/62/events","html_url":"https://github.com/stanfordnlp/CoreNLP/issues/62","id":59951426,"number":62,"title":"CoNLLMentionExtractor always uses ``auto_conll`` files.","user":{"login":"dragoon","id":490130,"avatar_url":"https://avatars.githubusercontent.com/u/490130?v=3","gravatar_id":"","url":"https://api.github.com/users/dragoon","html_url":"https://github.com/dragoon","followers_url":"https://api.github.com/users/dragoon/followers","following_url":"https://api.github.com/users/dragoon/following{/other_user}","gists_url":"https://api.github.com/users/dragoon/gists{/gist_id}","starred_url":"https://api.github.com/users/dragoon/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/dragoon/subscriptions","organizations_url":"https://api.github.com/users/dragoon/orgs","repos_url":"https://api.github.com/users/dragoon/repos","events_url":"https://api.github.com/users/dragoon/events{/privacy}","received_events_url":"https://api.github.com/users/dragoon/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":4,"created_at":"2015-03-05T13:30:53Z","updated_at":"2015-03-06T10:00:28Z","closed_at":null,"body":"Hello,\r\n\r\nit seems that ``CoNLLMentionExtractor`` always uses ``auto_conll`` to extract entity mentions, even for gold mentions. However, gold mentions are contained in ``gold_conll`` files. This results in the metric scores always being equal to zero.\r\nIn particular, on line 75:\r\n\r\n    if (Constants.USE_CONLL_AUTO) options.setFilter(\".*_auto_conll$\");\r\n\r\nIs this the correct behavior or am I missing something?"},"comment":{"url":"https://api.github.com/repos/stanfordnlp/CoreNLP/issues/comments/77534351","html_url":"https://github.com/stanfordnlp/CoreNLP/issues/62#issuecomment-77534351","issue_url":"https://api.github.com/repos/stanfordnlp/CoreNLP/issues/62","id":77534351,"user":{"login":"dragoon","id":490130,"avatar_url":"https://avatars.githubusercontent.com/u/490130?v=3","gravatar_id":"","url":"https://api.github.com/users/dragoon","html_url":"https://github.com/dragoon","followers_url":"https://api.github.com/users/dragoon/followers","following_url":"https://api.github.com/users/dragoon/following{/other_user}","gists_url":"https://api.github.com/users/dragoon/gists{/gist_id}","starred_url":"https://api.github.com/users/dragoon/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/dragoon/subscriptions","organizations_url":"https://api.github.com/users/dragoon/orgs","repos_url":"https://api.github.com/users/dragoon/repos","events_url":"https://api.github.com/users/dragoon/events{/privacy}","received_events_url":"https://api.github.com/users/dragoon/received_events","type":"User","site_admin":false},"created_at":"2015-03-06T10:00:28Z","updated_at":"2015-03-06T10:00:28Z","body":"Hello Xiao,\r\n\r\nIndeed, my train/dev files also contain coreferences, but I was actually running the system on **test data** as you can see from the config. And the test data does not contain them. Is that a problem?"}}