Everything is lowercase Words less than two letters have not been included (notice there is no 'a' ) ) Punctuation has been removed There are no duplicates By changing from the default arguments when CountVectorizer is instantiated, you can change what was mentioned in the first two bullet points if wanted.