{"action":"created","issue":{"url":"https://api.github.com/repos/beauvais/twitter_nltk/issues/2","labels_url":"https://api.github.com/repos/beauvais/twitter_nltk/issues/2/labels{/name}","comments_url":"https://api.github.com/repos/beauvais/twitter_nltk/issues/2/comments","events_url":"https://api.github.com/repos/beauvais/twitter_nltk/issues/2/events","html_url":"https://github.com/beauvais/twitter_nltk/issues/2","id":98245792,"number":2,"title":"UnicodeDecodeError","user":{"login":"beauvais","id":724619,"avatar_url":"https://avatars.githubusercontent.com/u/724619?v=3","gravatar_id":"","url":"https://api.github.com/users/beauvais","html_url":"https://github.com/beauvais","followers_url":"https://api.github.com/users/beauvais/followers","following_url":"https://api.github.com/users/beauvais/following{/other_user}","gists_url":"https://api.github.com/users/beauvais/gists{/gist_id}","starred_url":"https://api.github.com/users/beauvais/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/beauvais/subscriptions","organizations_url":"https://api.github.com/users/beauvais/orgs","repos_url":"https://api.github.com/users/beauvais/repos","events_url":"https://api.github.com/users/beauvais/events{/privacy}","received_events_url":"https://api.github.com/users/beauvais/received_events","type":"User","site_admin":false},"labels":[{"url":"https://api.github.com/repos/beauvais/twitter_nltk/labels/bug","name":"bug","color":"fc2929"}],"state":"open","locked":false,"assignee":{"login":"beauvais","id":724619,"avatar_url":"https://avatars.githubusercontent.com/u/724619?v=3","gravatar_id":"","url":"https://api.github.com/users/beauvais","html_url":"https://github.com/beauvais","followers_url":"https://api.github.com/users/beauvais/followers","following_url":"https://api.github.com/users/beauvais/following{/other_user}","gists_url":"https://api.github.com/users/beauvais/gists{/gist_id}","starred_url":"https://api.github.com/users/beauvais/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/beauvais/subscriptions","organizations_url":"https://api.github.com/users/beauvais/orgs","repos_url":"https://api.github.com/users/beauvais/repos","events_url":"https://api.github.com/users/beauvais/events{/privacy}","received_events_url":"https://api.github.com/users/beauvais/received_events","type":"User","site_admin":false},"milestone":null,"comments":2,"created_at":"2015-07-30T19:36:44Z","updated_at":"2015-07-30T19:52:19Z","closed_at":null,"body":"When running *tokens_no_function.py*, Python throws the UnicodeDecodeError exception:\r\n\r\n$twitter_nltk zach$ python tokens_no_function.py \r\nTraceback (most recent call last):\r\n  File \"tokens_no_function.py\", line 9, in <module>\r\n    tokens = word_tokenize(raw.decode('utf-8'))\r\n  File \"/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/encodings/utf_8.py\", line 16, in decode\r\n    return codecs.utf_8_decode(input, errors, True)\r\nUnicodeDecodeError: 'utf8' codec can't decode byte 0x89 in position 66: invalid start byte\r\n"},"comment":{"url":"https://api.github.com/repos/beauvais/twitter_nltk/issues/comments/126455606","html_url":"https://github.com/beauvais/twitter_nltk/issues/2#issuecomment-126455606","issue_url":"https://api.github.com/repos/beauvais/twitter_nltk/issues/2","id":126455606,"user":{"login":"beauvais","id":724619,"avatar_url":"https://avatars.githubusercontent.com/u/724619?v=3","gravatar_id":"","url":"https://api.github.com/users/beauvais","html_url":"https://github.com/beauvais","followers_url":"https://api.github.com/users/beauvais/followers","following_url":"https://api.github.com/users/beauvais/following{/other_user}","gists_url":"https://api.github.com/users/beauvais/gists{/gist_id}","starred_url":"https://api.github.com/users/beauvais/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/beauvais/subscriptions","organizations_url":"https://api.github.com/users/beauvais/orgs","repos_url":"https://api.github.com/users/beauvais/repos","events_url":"https://api.github.com/users/beauvais/events{/privacy}","received_events_url":"https://api.github.com/users/beauvais/received_events","type":"User","site_admin":false},"created_at":"2015-07-30T19:52:19Z","updated_at":"2015-07-30T19:52:19Z","body":"[last commit][1] used enforced utf-8 encoding on the csv file. Then I reran *import.py*, and got it to work.\r\n\r\n[1]: https://github.com/beauvais/twitter_nltk/commit/378eab3a03db96f3871a3fb33cdbdd74f80b33fd"}}