Python NLTK | nltk.tokenize.TabTokenizer()
With the help of
nltk.tokenize.TabTokenizer() method, we are able to extract the tokens from string of words on the basis of tabs between them by using
Return : Return the tokens of words.
Example #1 :
In this example we can see that by using
tokenize.TabTokenizer() method, we are able to extract the tokens from stream to words having tabs between them.
[‘Geeksfor’, ‘Geeks..’, ‘.$$&* \nis’, ‘ for geeks’]
Example #2 :
[‘The price’, ‘ of burger ‘, ‘in BurgerKing is Rs.36.\n’]