{"action":"created","issue":{"url":"https://api.github.com/repos/codelucas/newspaper/issues/128","labels_url":"https://api.github.com/repos/codelucas/newspaper/issues/128/labels{/name}","comments_url":"https://api.github.com/repos/codelucas/newspaper/issues/128/comments","events_url":"https://api.github.com/repos/codelucas/newspaper/issues/128/events","html_url":"https://github.com/codelucas/newspaper/issues/128","id":60496694,"number":128,"title":"Incorrect article extraction","user":{"login":"attodorov","id":300580,"avatar_url":"https://avatars.githubusercontent.com/u/300580?v=3","gravatar_id":"","url":"https://api.github.com/users/attodorov","html_url":"https://github.com/attodorov","followers_url":"https://api.github.com/users/attodorov/followers","following_url":"https://api.github.com/users/attodorov/following{/other_user}","gists_url":"https://api.github.com/users/attodorov/gists{/gist_id}","starred_url":"https://api.github.com/users/attodorov/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/attodorov/subscriptions","organizations_url":"https://api.github.com/users/attodorov/orgs","repos_url":"https://api.github.com/users/attodorov/repos","events_url":"https://api.github.com/users/attodorov/events{/privacy}","received_events_url":"https://api.github.com/users/attodorov/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":2,"created_at":"2015-03-10T13:10:38Z","updated_at":"2015-11-30T18:44:08Z","closed_at":null,"body":"Hey,\r\n\r\nI really like newspaper - nice job ! It has one major flaw, though - on a lot of sites, like wsj.com, reuters.com, etc. - it doesn't exract the article text precisely, but also includes left/right menus such as \"Top most read articles\" and similar things. If you use a library like the one Instapaper uses, you can extract the actual article text without any extra clutter. Here is one example (written in Java) that works pretty well:\r\n\r\nhttps://code.google.com/p/boilerpipe/\r\n\r\nThanks\r\n--Angel"},"comment":{"url":"https://api.github.com/repos/codelucas/newspaper/issues/comments/160719957","html_url":"https://github.com/codelucas/newspaper/issues/128#issuecomment-160719957","issue_url":"https://api.github.com/repos/codelucas/newspaper/issues/128","id":160719957,"user":{"login":"TwistingTwists","id":11463027,"avatar_url":"https://avatars.githubusercontent.com/u/11463027?v=3","gravatar_id":"","url":"https://api.github.com/users/TwistingTwists","html_url":"https://github.com/TwistingTwists","followers_url":"https://api.github.com/users/TwistingTwists/followers","following_url":"https://api.github.com/users/TwistingTwists/following{/other_user}","gists_url":"https://api.github.com/users/TwistingTwists/gists{/gist_id}","starred_url":"https://api.github.com/users/TwistingTwists/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/TwistingTwists/subscriptions","organizations_url":"https://api.github.com/users/TwistingTwists/orgs","repos_url":"https://api.github.com/users/TwistingTwists/repos","events_url":"https://api.github.com/users/TwistingTwists/events{/privacy}","received_events_url":"https://api.github.com/users/TwistingTwists/received_events","type":"User","site_admin":false},"created_at":"2015-11-30T18:44:07Z","updated_at":"2015-11-30T18:44:07Z","body":"I have compiled a small list of links where it does not work \"properly\".\r\n\r\nhttp://www.nytimes.com/2015/11/30/us/politics/illinois-campaign-money-bruce-rauner.html\r\n--images between articles are not pulled. Sometimes, they are used to reference some graphs. (Possibly, use `.md` format for embedding images in text with images stored in a directory?)\r\n\r\nhttps://medium.com/the-coffeelicious/chronicling-depression-with-photography-cedbeffa79ee#.4jioqqaqo\r\n-- incomplete article extraction.\r\n\r\nhttps://medium.com/the-macroscope/sometimes-a-whale-dies-689720e3e456#.53lrtza7z\r\n-- incomplete article extraction"}}