Uses of Class
eu.svjatoslav.commons.string.tokenizer.TokenizerMatch

Packages that use TokenizerMatch

Package	Description
eu.svjatoslav.commons.string.tokenizer	Provides a regex-based tokenizer for parsing structured text.

Uses of TokenizerMatch in eu.svjatoslav.commons.string.tokenizer

Methods in eu.svjatoslav.commons.string.tokenizer that return TokenizerMatch

Modifier and Type	Method	Description
TokenizerMatch	Tokenizer.expectAndConsumeNextTerminatorToken(Terminator terminator)	Consumes the next token and verifies it was matched by the expected terminator.
TokenizerMatch	Tokenizer.findTerminatorMatch()	Finds a terminator that matches at the current position.
TokenizerMatch	Tokenizer.getNextToken()	Returns the next token from the source string.
TokenizerMatch	Tokenizer.peekNextToken()	Returns the next token without consuming it.