{"action":"closed","issue":{"url":"https://api.github.com/repos/datamade/dedupe/issues/333","labels_url":"https://api.github.com/repos/datamade/dedupe/issues/333/labels{/name}","comments_url":"https://api.github.com/repos/datamade/dedupe/issues/333/comments","events_url":"https://api.github.com/repos/datamade/dedupe/issues/333/events","html_url":"https://github.com/datamade/dedupe/issues/333","id":53132008,"number":333,"title":"Canonicalize chokes on large groups of records","user":{"login":"evz","id":551491,"avatar_url":"https://avatars.githubusercontent.com/u/551491?v=3","gravatar_id":"","url":"https://api.github.com/users/evz","html_url":"https://github.com/evz","followers_url":"https://api.github.com/users/evz/followers","following_url":"https://api.github.com/users/evz/following{/other_user}","gists_url":"https://api.github.com/users/evz/gists{/gist_id}","starred_url":"https://api.github.com/users/evz/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/evz/subscriptions","organizations_url":"https://api.github.com/users/evz/orgs","repos_url":"https://api.github.com/users/evz/repos","events_url":"https://api.github.com/users/evz/events{/privacy}","received_events_url":"https://api.github.com/users/evz/received_events","type":"User","site_admin":false},"labels":[],"state":"closed","locked":false,"assignee":null,"milestone":null,"comments":2,"created_at":"2014-12-30T17:33:52Z","updated_at":"2015-02-12T22:49:13Z","closed_at":"2015-02-12T22:49:13Z","body":"Calling [``canonicalize``](https://github.com/datamade/dedupe/blob/master/dedupe/convenience.py#L179) with thousands of records seems to cause it to hang for quite a while. I called it with a group of ~16,000 records and killed it after waiting for about 40 minutes. Let's see if we can do something about this."}}