Navigation:  ThinBASIC Modules > Tokenizer > Tokenizer Module Classes > cTokenizer >


Previous pageReturn to chapter overviewNext page




Inside cTokenizer every single ASCII char is associated to one of the predefined 7 char sets types: NewLine, Space, Delim, Numeric, Alpha, DQuote, Alpha_Single.


A set of characters can be indicated in one go using .Char.Set.<type> method followed by the type.