NAME¶
KinoSearch1::Analysis::Analyzer - base class for analyzers
SYNOPSIS¶
# abstract base class -- you probably want PolyAnalyzer, not this.
DESCRIPTION¶
In KinoSearch1, an Analyzer is a filter which processes text, transforming it
from one form into another. For instance, an analyzer might break up a long
text into smaller pieces (Tokenizer), or it might convert text to lowercase
(LCNormalizer).
METHODS¶
analyze (EXPERIMENTAL)¶
$token_batch = $analyzer->analyze($token_batch);
All Analyzer subclasses provide an
"analyze" method.
"analyze()" takes a single TokenBatch as
input, and it returns a TokenBatch, either the same one (probably
transformed in some way), or a new one.
COPYRIGHT¶
Copyright 2005-2010 Marvin Humphrey
LICENSE, DISCLAIMER, BUGS, etc.¶
See KinoSearch1 version 1.01.