def tokenize ( self , s ) : return [ s [ start : end ] for start , end in self . span_tokenize ( s ) ]
slicing string into sentences in python
Return a list of token strings from the given sentence .
def tokenize(self, s):
        """Return a list of token strings from the given sentence.

        :param string s: The sentence string to tokenize.
        :rtype: iter(str)
        """
        return [s[start:end] for start, end in self.span_tokenize(s)]