This is documentation for Mathematica 5, which was
based on an earlier version of the Wolfram Language.
View current documentation (Version 11.2)

Documentation / Mathematica / Built-in Functions / Input and Output / Data Reading Options /

TokenWords

FilledSmallSquare TokenWords is an option for Read and related functions which gives a list of token words to be used to delimit words.

FilledSmallSquare The setting for TokenWords is a list of strings which are used as delimiters for words to be read.

FilledSmallSquare The delimiters specified by TokenWords are themselves returned as words.

FilledSmallSquare See Section 2.12.8.

FilledSmallSquare See also: WordSeparators.

FilledSmallSquare New in Version 2.