BUILT-IN WOLFRAM LANGUAGE SYMBOL
is an option for Read and related functions which gives a list of token words to be used to delimit words.
- The setting for TokenWords is a list of strings which are used as delimiters for words to be read.
- The delimiters specified by TokenWords are themselves returned as words.
A text file:
Read the file:
Read the file using token words to delimit words in the text: