Toggle navigation
Hot Examples
DE
EN
RU
DE
FR
ES
PT
IT
JP
ZH
KO
C#
PHP
C#
Java
Go
C++
Python
JS
TS
Suchen
Home
Ancestry
QueryProcessor
Parse
Tokenizer
Tokenizer
Ancestry.QueryProcessor.Parse.Tokenizer.Tokenizer C# (CSharp) Method
Tokenizer Class Documentation
Datei anzeigen
Open project: Ancestry/DotQL
Tokenizer()
public
method
public
Tokenizer
(
string
input
) :
System
input
string
return
System
public Tokenizer(string input) : base() { _input = input; ReadNext(); }
Tokenizer
Advance
ExceedsInt32
ExceedsInt32Hex
IsReservedWord
IsSymbol
IsValidIdentifier
NextToken
ReadNext
SkipComments
SkipLineComments
SkipWhiteSpace
Tokenizer