Uses of Class
org.apache.lucene.analysis.Tokenizer

Packages that use Tokenizer

Package	Description
org.apache.lucene.analysis	API and code to convert text into indexable/searchable tokens.

Uses of Tokenizer in org.apache.lucene.analysis

Fields in org.apache.lucene.analysis declared as Tokenizer

Modifier and Type	Field	Description
protected Tokenizer	Analyzer.TokenStreamComponents.source	Original source of the tokens.

Methods in org.apache.lucene.analysis that return Tokenizer

Modifier and Type	Method	Description
Tokenizer	Analyzer.TokenStreamComponents.getTokenizer()	Returns the component's Tokenizer

Constructors in org.apache.lucene.analysis with parameters of type Tokenizer

Constructor	Description
TokenStreamComponents(Tokenizer source)	Creates a new Analyzer.TokenStreamComponents instance.
TokenStreamComponents(Tokenizer source, TokenStream result)	Creates a new Analyzer.TokenStreamComponents instance.