{"action":"created","issue":{"url":"https://api.github.com/repos/cantino/huginn/issues/938","labels_url":"https://api.github.com/repos/cantino/huginn/issues/938/labels{/name}","comments_url":"https://api.github.com/repos/cantino/huginn/issues/938/comments","events_url":"https://api.github.com/repos/cantino/huginn/issues/938/events","html_url":"https://github.com/cantino/huginn/issues/938","id":97371032,"number":938,"title":"Bad Uri","user":{"login":"irfancharania","id":3255038,"avatar_url":"https://avatars.githubusercontent.com/u/3255038?v=3","gravatar_id":"","url":"https://api.github.com/users/irfancharania","html_url":"https://github.com/irfancharania","followers_url":"https://api.github.com/users/irfancharania/followers","following_url":"https://api.github.com/users/irfancharania/following{/other_user}","gists_url":"https://api.github.com/users/irfancharania/gists{/gist_id}","starred_url":"https://api.github.com/users/irfancharania/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/irfancharania/subscriptions","organizations_url":"https://api.github.com/users/irfancharania/orgs","repos_url":"https://api.github.com/users/irfancharania/repos","events_url":"https://api.github.com/users/irfancharania/events{/privacy}","received_events_url":"https://api.github.com/users/irfancharania/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":23,"created_at":"2015-07-27T02:19:14Z","updated_at":"2015-10-31T04:14:26Z","closed_at":null,"body":"The browser seems to be more forgiving with malformed links than ruby.\r\n\r\nI've got a site that I'm trying to extract urls from and because the url is not properly formed, ruby just borks with a `Error when fetching url: bad URI(is not URI?)` and stops parsing the rest of the page.\r\n\r\nExample:\r\n\r\n``` json\r\n{\r\n  \"expected_update_period_in_days\": \"2\",\r\n  \"url\": \"https://dl.dropboxusercontent.com/u/28950293/test.html\",\r\n  \"type\": \"html\",\r\n  \"mode\": \"on_change\",\r\n  \"extract\": {\r\n    \"url\": {\r\n      \"css\": \"a\",\r\n      \"value\": \"@href\"\r\n    },\r\n    \"title\": {\r\n      \"css\": \"a\",\r\n      \"value\": \"normalize-space(.)\"\r\n    }\r\n  }\r\n}\r\n```\r\n\r\nIs there any way to use something like `uri_escape` available for liquid during the extraction?\r\n\r\nAt the very least, I think it should ignore the bad uri, and continue trying to parse the rest of the links on the page."},"comment":{"url":"https://api.github.com/repos/cantino/huginn/issues/comments/152691137","html_url":"https://github.com/cantino/huginn/issues/938#issuecomment-152691137","issue_url":"https://api.github.com/repos/cantino/huginn/issues/938","id":152691137,"user":{"login":"cantino","id":83835,"avatar_url":"https://avatars.githubusercontent.com/u/83835?v=3","gravatar_id":"","url":"https://api.github.com/users/cantino","html_url":"https://github.com/cantino","followers_url":"https://api.github.com/users/cantino/followers","following_url":"https://api.github.com/users/cantino/following{/other_user}","gists_url":"https://api.github.com/users/cantino/gists{/gist_id}","starred_url":"https://api.github.com/users/cantino/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/cantino/subscriptions","organizations_url":"https://api.github.com/users/cantino/orgs","repos_url":"https://api.github.com/users/cantino/repos","events_url":"https://api.github.com/users/cantino/events{/privacy}","received_events_url":"https://api.github.com/users/cantino/received_events","type":"User","site_admin":false},"created_at":"2015-10-31T04:14:25Z","updated_at":"2015-10-31T04:14:25Z","body":"I believe @knu was going to take a look at that PR again."}}