public ProcessPunctationTokens ( |
||
categorizer | The categorizer. | |
quotationCategorizer | The quotation categorizer. | |
level | CheckingLevel | Indicator to determine how much to combine contiguous /// punctuation sequences into patterns. Advanced = All contiguous punctuation and /// whitespace characters form a single pattern; Intermediate = Contiguous punctuation /// forms a single pattern (delimeted by whitespace); Basic = Each punctuation character /// stands alone. In all three modes, whitespace before and/or after a punctuation token /// indicates whether is is word-initial, word-medial, word-final, or isolated |
return | System |