TokenWords

TokenWords

is an option for Read and related functions which gives a list of token words to be used to delimit words.

Details

  • The setting for TokenWords is a list of strings which are used as delimiters for words to be read.
  • The delimiters specified by TokenWords are themselves returned as words.

Examples

Basic Examples  (1)

A text file:

Read the file:

Read the file using token words to delimit words in the text:

Introduced in 1991
 (2.0)