Obtain token table from text

utils::getParseData() is used to obtain a flat parse table from text.

tokenize(text)

Arguments

text	A character vector.

Value

A flat parse table