Uses of Class
org.apache.lucene.analysis.Tokenizer
Packages that use Tokenizer
Package
Description
API and code to convert text into indexable/searchable tokens.
-
Uses of Tokenizer in org.apache.lucene.analysis
Fields in org.apache.lucene.analysis declared as TokenizerModifier and TypeFieldDescriptionprotected final Tokenizer
Analyzer.TokenStreamComponents.source
Original source of the tokens.Methods in org.apache.lucene.analysis that return TokenizerModifier and TypeMethodDescriptionAnalyzer.TokenStreamComponents.getTokenizer()
Returns the component'sTokenizer
Constructors in org.apache.lucene.analysis with parameters of type TokenizerModifierConstructorDescriptionTokenStreamComponents
(Tokenizer source) Creates a newAnalyzer.TokenStreamComponents
instance.TokenStreamComponents
(Tokenizer source, TokenStream result) Creates a newAnalyzer.TokenStreamComponents
instance.