{"action":"created","issue":{"url":"https://api.github.com/repos/wetneb/dissemin/issues/14","labels_url":"https://api.github.com/repos/wetneb/dissemin/issues/14/labels{/name}","comments_url":"https://api.github.com/repos/wetneb/dissemin/issues/14/comments","events_url":"https://api.github.com/repos/wetneb/dissemin/issues/14/events","html_url":"https://github.com/wetneb/dissemin/issues/14","id":60226164,"number":14,"title":"Implement an heuristic to merge similar papers","user":{"login":"wetneb","id":309908,"avatar_url":"https://avatars.githubusercontent.com/u/309908?v=3","gravatar_id":"","url":"https://api.github.com/users/wetneb","html_url":"https://github.com/wetneb","followers_url":"https://api.github.com/users/wetneb/followers","following_url":"https://api.github.com/users/wetneb/following{/other_user}","gists_url":"https://api.github.com/users/wetneb/gists{/gist_id}","starred_url":"https://api.github.com/users/wetneb/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/wetneb/subscriptions","organizations_url":"https://api.github.com/users/wetneb/orgs","repos_url":"https://api.github.com/users/wetneb/repos","events_url":"https://api.github.com/users/wetneb/events{/privacy}","received_events_url":"https://api.github.com/users/wetneb/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/wetneb/dissemin/labels/enhancement","name":"enhancement","color":"84b6eb"}],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":1,"created_at":"2015-03-07T21:45:03Z","updated_at":"2015-03-08T09:55:21Z","closed_at":null,"body":"This can involve:\r\n- Improving the current fingerprint system (don't think it's enough)\r\n- Adding an heuristic that compares two papers and decides whether they should be merged.\r\n\r\nThis is tricky because a simple edit distance fails, for instance because the two following papers are different:\r\n- Desingularisation de metriques d'Einstein. II\r\n- Désingularisation de metriques d'Einstein. I\r\n\r\nNote that the current fingerprint system already collapses different papers together:\r\n- Preface. (published in 2010)\r\n- Preface. (published in 2012)\r\n\r\nBut adding the date in the fingerprint is not an option (preprints and publication years are often different)."},"comment":{"url":"https://api.github.com/repos/wetneb/dissemin/issues/comments/77741473","html_url":"https://github.com/wetneb/dissemin/issues/14#issuecomment-77741473","issue_url":"https://api.github.com/repos/wetneb/dissemin/issues/14","id":77741473,"user":{"login":"a3nm","id":843551,"avatar_url":"https://avatars.githubusercontent.com/u/843551?v=3","gravatar_id":"","url":"https://api.github.com/users/a3nm","html_url":"https://github.com/a3nm","followers_url":"https://api.github.com/users/a3nm/followers","following_url":"https://api.github.com/users/a3nm/following{/other_user}","gists_url":"https://api.github.com/users/a3nm/gists{/gist_id}","starred_url":"https://api.github.com/users/a3nm/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/a3nm/subscriptions","organizations_url":"https://api.github.com/users/a3nm/orgs","repos_url":"https://api.github.com/users/a3nm/repos","events_url":"https://api.github.com/users/a3nm/events{/privacy}","received_events_url":"https://api.github.com/users/a3nm/received_events","type":"User","site_admin":false},"created_at":"2015-03-08T09:55:21Z","updated_at":"2015-03-08T09:55:21Z","body":"Ideas for this:\n\n- For \"Preface\", maybe the system could detect whenever two papers are\n  clearly different (i.e., entirely different list of authors, year,\n  etc.) but carry the same title. In this case, the title could be\n  understood as not specific so that two papers having this same title\n  are not necessarily the same one.\n\n- For the 'I' and 'II' one possibility would be to tweak the edit\n  distance to give more weight to numerals, but this would be a bit\n  crappy. Ideally you could again notice whenever two papers that are\n  known to be different are assigned very similar titles, so that\n  the differences between those titles are understood as significant,\n  but I don't know an easy way to do this.\n\n-- \nAntoine Amarilli\n\n\nOn Sat, Mar 07, 2015 at 01:45:05PM -0800, Antonin wrote:\n> This can involve:\n> - Improving the current fingerprint system (don't think it's enough)\n> - Adding an heuristic that compares two papers and decides whether they should be merged.\n> \n> This is tricky because a simple edit distance fails, for instance because the two following papers are different:\n> - Desingularisation de metriques d'Einstein. II\n> - Désingularisation de metriques d'Einstein. I\n> \n> Note that the current fingerprint system already collapses different papers together:\n> - Preface. (published in 2010)\n> - Preface. (published in 2012)\n> \n> But adding the date in the fingerprint is not an option (preprints and publication years are often different).\n> \n> ---\n> Reply to this email directly or view it on GitHub:\n> https://github.com/wetneb/dissemin/issues/14\n"}}