{"action":"created","issue":{"url":"https://api.github.com/repos/jaimeiniesta/metainspector/issues/131","labels_url":"https://api.github.com/repos/jaimeiniesta/metainspector/issues/131/labels{/name}","comments_url":"https://api.github.com/repos/jaimeiniesta/metainspector/issues/131/comments","events_url":"https://api.github.com/repos/jaimeiniesta/metainspector/issues/131/events","html_url":"https://github.com/jaimeiniesta/metainspector/issues/131","id":73590157,"number":131,"title":"Cleaning/Deduping URIs","user":{"login":"mmmmmrob","id":131297,"avatar_url":"https://avatars.githubusercontent.com/u/131297?v=3","gravatar_id":"","url":"https://api.github.com/users/mmmmmrob","html_url":"https://github.com/mmmmmrob","followers_url":"https://api.github.com/users/mmmmmrob/followers","following_url":"https://api.github.com/users/mmmmmrob/following{/other_user}","gists_url":"https://api.github.com/users/mmmmmrob/gists{/gist_id}","starred_url":"https://api.github.com/users/mmmmmrob/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/mmmmmrob/subscriptions","organizations_url":"https://api.github.com/users/mmmmmrob/orgs","repos_url":"https://api.github.com/users/mmmmmrob/repos","events_url":"https://api.github.com/users/mmmmmrob/events{/privacy}","received_events_url":"https://api.github.com/users/mmmmmrob/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":3,"created_at":"2015-05-06T11:01:25Z","updated_at":"2015-07-02T18:02:48Z","closed_at":null,"body":"We're working on code to spot canonical URLs for pages and use them. In cases where a canonical URL isn't provided, we're also interested removing tracking elements to give us the best chance of having URLs for the same page be the same in our data.\r\n\r\nI'm thinking about something like:\r\n\r\n\"Page.untracked_url returns the url of the page with known tracking elements, such as ?utm=, removed\"\r\n\r\nIs anyone else doing/done this?\r\n\r\nIs metainspector a happy place for this functionality to live?\r\n"},"comment":{"url":"https://api.github.com/repos/jaimeiniesta/metainspector/issues/comments/118111816","html_url":"https://github.com/jaimeiniesta/metainspector/issues/131#issuecomment-118111816","issue_url":"https://api.github.com/repos/jaimeiniesta/metainspector/issues/131","id":118111816,"user":{"login":"jaimeiniesta","id":2629,"avatar_url":"https://avatars.githubusercontent.com/u/2629?v=3","gravatar_id":"","url":"https://api.github.com/users/jaimeiniesta","html_url":"https://github.com/jaimeiniesta","followers_url":"https://api.github.com/users/jaimeiniesta/followers","following_url":"https://api.github.com/users/jaimeiniesta/following{/other_user}","gists_url":"https://api.github.com/users/jaimeiniesta/gists{/gist_id}","starred_url":"https://api.github.com/users/jaimeiniesta/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/jaimeiniesta/subscriptions","organizations_url":"https://api.github.com/users/jaimeiniesta/orgs","repos_url":"https://api.github.com/users/jaimeiniesta/repos","events_url":"https://api.github.com/users/jaimeiniesta/events{/privacy}","received_events_url":"https://api.github.com/users/jaimeiniesta/received_events","type":"User","site_admin":false},"created_at":"2015-07-02T18:02:48Z","updated_at":"2015-07-02T18:02:48Z","body":"@mmmmmrob ping :)"}}