TokenWords

TokenWords

is an option for Read and related functions which gives a list of token words to be used to delimit words.

Details

  • The setting for TokenWords is a list of strings which are used as delimiters for words to be read.
  • The delimiters specified by TokenWords are themselves returned as words.

Examples

Basic Examples  (1)

A text file:

In[1]:=
Click for copyable input

Read the file:

In[2]:=
Click for copyable input
Out[2]=

Read the file using token words to delimit words in the text:

In[3]:=
Click for copyable input
Out[3]=

See Also

WordSeparators  NullWords

Tutorials

Introduced in 1991
(2.0)