cTokenizer is a class that implements a fast string tokenizer.
How to use cTokenizer
Inside your script, before calling any module specific keyword, add the following:
This directive will load the Tokenizer module. The module will add all the needed features into current script execution.
Then a variable must be declared and instantiated in this way:
'---Declare a new tokenizer engine
Dim MyParser As cTokenizer
'---Instantiate new tokenizer
MyParser = New cTokenizer()
Declaration just allocate a new variable in the stack.
Instantiation let new variable takes life calling it's internal creation method (if needed).