Posts by Cygnus X-1 • 13 points

• 1

  votes

  1

  answer

  39

  views

  Q: word_tokenize creating tokens with only one character instead of words

  When creating the list below, with the tokens of multiple texts .txt, the for loop tokenize the characters and not the words themselves: import glob import nltk l = [] for file in…

  python nltk

  asked 3 years, 3 months ago Cygnus X-1 13