NAME¶
Plucene::Analysis::Analyzer - base class for Analyzers
SYNOPSIS¶
my $analyzer = Plucene::Analysis::Analyzer::Subclass->new;
DESCRIPTION¶
This is an abstract base class of Analyzers.
An Analyzer builds TokenStreams, which analyze text. It thus represents a policy
for extracting index terms from text.
Typical implementations first build a Tokenizer, which breaks the stream of
characters from the Reader into raw Tokens. One or more TokenFilters may then
be applied to the output of the Tokenizer.
METHODS¶
new¶
my $analyzer = Plucene::Analysis::Analyzer::Subclass->new;
tokenstream¶
This must be defined in a subclass