{"action":"created","issue":{"url":"https://api.github.com/repos/kbenoit/quanteda/issues/50","labels_url":"https://api.github.com/repos/kbenoit/quanteda/issues/50/labels{/name}","comments_url":"https://api.github.com/repos/kbenoit/quanteda/issues/50/comments","events_url":"https://api.github.com/repos/kbenoit/quanteda/issues/50/events","html_url":"https://github.com/kbenoit/quanteda/issues/50","id":97304365,"number":50,"title":"ignoredFeatures=stopwords(\"english\") not working","user":{"login":"bfisseler","id":3033970,"avatar_url":"https://avatars.githubusercontent.com/u/3033970?v=3","gravatar_id":"","url":"https://api.github.com/users/bfisseler","html_url":"https://github.com/bfisseler","followers_url":"https://api.github.com/users/bfisseler/followers","following_url":"https://api.github.com/users/bfisseler/following{/other_user}","gists_url":"https://api.github.com/users/bfisseler/gists{/gist_id}","starred_url":"https://api.github.com/users/bfisseler/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/bfisseler/subscriptions","organizations_url":"https://api.github.com/users/bfisseler/orgs","repos_url":"https://api.github.com/users/bfisseler/repos","events_url":"https://api.github.com/users/bfisseler/events{/privacy}","received_events_url":"https://api.github.com/users/bfisseler/received_events","type":"User","site_admin":false},"labels":[],"state":"open","locked":false,"assignee":null,"milestone":null,"comments":1,"created_at":"2015-07-26T10:01:05Z","updated_at":"2015-07-26T10:19:50Z","closed_at":null,"body":"Hi,\r\n\r\nI'm using quanteda to generate ngrams for word prediction. Try the following:\r\n\r\ntest <- \"this is just a test text i'm using\"\r\nmy_dtm <- quanteda::dfm(test, ngrams = 1:3, concatenator = \" \", ignoredFeatures = stopwords(\"english\"))\r\n\r\n\"i'm\" should have been removed, but the dtm still contains it.\r\n\r\nquanteda version is: 0.8.0-3\r\n"},"comment":{"url":"https://api.github.com/repos/kbenoit/quanteda/issues/comments/124967104","html_url":"https://github.com/kbenoit/quanteda/issues/50#issuecomment-124967104","issue_url":"https://api.github.com/repos/kbenoit/quanteda/issues/50","id":124967104,"user":{"login":"kbenoit","id":2182246,"avatar_url":"https://avatars.githubusercontent.com/u/2182246?v=3","gravatar_id":"","url":"https://api.github.com/users/kbenoit","html_url":"https://github.com/kbenoit","followers_url":"https://api.github.com/users/kbenoit/followers","following_url":"https://api.github.com/users/kbenoit/following{/other_user}","gists_url":"https://api.github.com/users/kbenoit/gists{/gist_id}","starred_url":"https://api.github.com/users/kbenoit/starred{/owner}{/repo}","subscriptions_url":"https://api.github.com/users/kbenoit/subscriptions","organizations_url":"https://api.github.com/users/kbenoit/orgs","repos_url":"https://api.github.com/users/kbenoit/repos","events_url":"https://api.github.com/users/kbenoit/events{/privacy}","received_events_url":"https://api.github.com/users/kbenoit/received_events","type":"User","site_admin":false},"created_at":"2015-07-26T10:19:50Z","updated_at":"2015-07-26T10:19:50Z","body":"You're right, that's a bug I will fix. What should be the behaviour for grams containing stopwords? Removing the whole ngram containing any stopword seems to be most appropriate. But we would not want to create non-adjacent ngrams as a result of this removal, e.g. \"text using\"."}}