Alsing.Text.Tokenizer.Tokenizer C# (CSharp) Method

Tokenizer Class Documentation Show file Open project: vchelaru/FlatRedBall

Tokenizer() public method

public Tokenizer ( ) : System
return System 
        public Tokenizer()
        {
            tree = new TokenTree();
        }
Tokenizer
AddPattern
AddToken
MakeImmutable
ThrowIfImmutable
Tokenize
Tokenizer