Following are some token types that occur in NLP++ code.
|
ITEM |
DESCRIPTION |
|
# |
Comment. Text till the end of the line is ignored. |
|
AAA or NNN |
Literal tokens. Completely alphabetic or completely numeric. |
|
_AAA |
Nonliteral tokens must begin with underscore. All the remaining letters MUST be alphabetic. Currently, only alphabetics are allowed after the initial underscore. |
|
"XXX" |
Strings get double quoted. Everything within string taken literally (except backslashed characters). |
|
\X |
Backslash any nonalphanumeric char you want
taken literally. |
|
\\ |
Literal backslash character. |