Uses of Class
eu.svjatoslav.commons.string.tokenizer.Tokenizer

Packages that use Tokenizer

Package	Description
eu.svjatoslav.commons.string.tokenizer	Provides a regex-based tokenizer for parsing structured text.

Uses of Tokenizer in eu.svjatoslav.commons.string.tokenizer

Methods in eu.svjatoslav.commons.string.tokenizer that return Tokenizer

Modifier and Type	Method	Description
Tokenizer	TokenizerMatch.getTokenizer()	Returns the tokenizer that produced this match.
Tokenizer	Tokenizer.setSource(String source)	Sets or replaces the source string to tokenize.

Constructors in eu.svjatoslav.commons.string.tokenizer with parameters of type Tokenizer

Modifier	Constructor	Description
	TokenizerMatch(String token, Terminator terminator, Matcher matcher, Tokenizer tokenizer)	Creates a new TokenizerMatch with all components.