This is documentation for Mathematica 3, which was
based on an earlier version of the Wolfram Language.
View current documentation (Version 11.2)
 Documentation / Mathematica / Built-in Functions / Input and Output / Data Reading Options  /

  • TokenWords is an option for Read and related functions which gives a list of token words to be used to delimit words.
  • The setting for TokenWords is a list of strings which are used as delimiters for words to be read.
  • The delimiters specified by TokenWords are themselves returned as words.
  • See the Mathematica book: Section 2.11.7.
  • See also: WordSeparators.