Package org.apache.lucene.analysis.cz
Class CzechAnalyzer
- java.lang.Object
-
- org.apache.lucene.analysis.Analyzer
-
- org.apache.lucene.analysis.ReusableAnalyzerBase
-
- org.apache.lucene.analysis.cz.CzechAnalyzer
-
- All Implemented Interfaces:
Closeable
,AutoCloseable
public final class CzechAnalyzer extends org.apache.lucene.analysis.ReusableAnalyzerBase
Analyzer
for Czech language.Supports an external list of stopwords (words that will not be indexed at all). A default set of stopwords is used unless an alternative list is specified.
You must specify the required
Version
compatibility when creating CzechAnalyzer:- As of 3.1, words are stemmed with
CzechStemFilter
- As of 2.9, StopFilter preserves position increments
- As of 2.4, Tokens incorrectly identified as acronyms are corrected (see LUCENE-1068)
-
-
Field Summary
Fields Modifier and Type Field Description static String[]
CZECH_STOP_WORDS
Deprecated.usegetDefaultStopSet()
insteadstatic String
DEFAULT_STOPWORD_FILE
File containing default Czech stopwords.
-
Constructor Summary
Constructors Constructor Description CzechAnalyzer(org.apache.lucene.util.Version matchVersion)
Builds an analyzer with the default stop words (getDefaultStopSet()
).CzechAnalyzer(org.apache.lucene.util.Version matchVersion, File stopwords)
Deprecated.useCzechAnalyzer(Version, Set)
insteadCzechAnalyzer(org.apache.lucene.util.Version matchVersion, String... stopwords)
Deprecated.useCzechAnalyzer(Version, Set)
insteadCzechAnalyzer(org.apache.lucene.util.Version matchVersion, HashSet<?> stopwords)
Deprecated.useCzechAnalyzer(Version, Set)
insteadCzechAnalyzer(org.apache.lucene.util.Version matchVersion, Set<?> stopwords)
Builds an analyzer with the given stop words.CzechAnalyzer(org.apache.lucene.util.Version matchVersion, Set<?> stopwords, Set<?> stemExclusionTable)
Builds an analyzer with the given stop words and a set of work to be excluded from theCzechStemFilter
.
-
Method Summary
All Methods Static Methods Instance Methods Concrete Methods Deprecated Methods Modifier and Type Method Description protected org.apache.lucene.analysis.ReusableAnalyzerBase.TokenStreamComponents
createComponents(String fieldName, Reader reader)
CreatesReusableAnalyzerBase.TokenStreamComponents
used to tokenize all the text in the providedReader
.static Set<?>
getDefaultStopSet()
Returns a set of default Czech-stopwordsvoid
loadStopWords(InputStream wordfile, String encoding)
Deprecated.useWordlistLoader.getWordSet(Reader, String, Version)
andCzechAnalyzer(Version, Set)
instead-
Methods inherited from class org.apache.lucene.analysis.ReusableAnalyzerBase
initReader, reusableTokenStream, tokenStream
-
-
-
-
Field Detail
-
CZECH_STOP_WORDS
@Deprecated public static final String[] CZECH_STOP_WORDS
Deprecated.usegetDefaultStopSet()
insteadList of typical stopwords.
-
DEFAULT_STOPWORD_FILE
public static final String DEFAULT_STOPWORD_FILE
File containing default Czech stopwords.- See Also:
- Constant Field Values
-
-
Constructor Detail
-
CzechAnalyzer
public CzechAnalyzer(org.apache.lucene.util.Version matchVersion)
Builds an analyzer with the default stop words (getDefaultStopSet()
).- Parameters:
matchVersion
- Lucene version to match See {@link above}
-
CzechAnalyzer
public CzechAnalyzer(org.apache.lucene.util.Version matchVersion, Set<?> stopwords)
Builds an analyzer with the given stop words.- Parameters:
matchVersion
- Lucene version to match See {@link above}stopwords
- a stopword set
-
CzechAnalyzer
public CzechAnalyzer(org.apache.lucene.util.Version matchVersion, Set<?> stopwords, Set<?> stemExclusionTable)
Builds an analyzer with the given stop words and a set of work to be excluded from theCzechStemFilter
.- Parameters:
matchVersion
- Lucene version to match See {@link above}stopwords
- a stopword setstemExclusionTable
- a stemming exclusion set
-
CzechAnalyzer
@Deprecated public CzechAnalyzer(org.apache.lucene.util.Version matchVersion, String... stopwords)
Deprecated.useCzechAnalyzer(Version, Set)
insteadBuilds an analyzer with the given stop words.- Parameters:
matchVersion
- Lucene version to match See {@link above}stopwords
- a stopword set
-
CzechAnalyzer
@Deprecated public CzechAnalyzer(org.apache.lucene.util.Version matchVersion, HashSet<?> stopwords)
Deprecated.useCzechAnalyzer(Version, Set)
insteadBuilds an analyzer with the given stop words.- Parameters:
matchVersion
- Lucene version to match See {@link above}stopwords
- a stopword set
-
CzechAnalyzer
@Deprecated public CzechAnalyzer(org.apache.lucene.util.Version matchVersion, File stopwords) throws IOException
Deprecated.useCzechAnalyzer(Version, Set)
insteadBuilds an analyzer with the given stop words.- Parameters:
matchVersion
- Lucene version to match See {@link above}stopwords
- a file containing stopwords- Throws:
IOException
-
-
Method Detail
-
getDefaultStopSet
public static final Set<?> getDefaultStopSet()
Returns a set of default Czech-stopwords- Returns:
- a set of default Czech-stopwords
-
loadStopWords
@Deprecated public void loadStopWords(InputStream wordfile, String encoding)
Deprecated.useWordlistLoader.getWordSet(Reader, String, Version)
andCzechAnalyzer(Version, Set)
insteadLoads stopwords hash from resource stream (file, database...).- Parameters:
wordfile
- File containing the wordlistencoding
- Encoding used (win-1250, iso-8859-2, ...), null for default system encoding
-
createComponents
protected org.apache.lucene.analysis.ReusableAnalyzerBase.TokenStreamComponents createComponents(String fieldName, Reader reader)
CreatesReusableAnalyzerBase.TokenStreamComponents
used to tokenize all the text in the providedReader
.- Specified by:
createComponents
in classorg.apache.lucene.analysis.ReusableAnalyzerBase
- Returns:
ReusableAnalyzerBase.TokenStreamComponents
built from aStandardTokenizer
filtered withStandardFilter
,LowerCaseFilter
,StopFilter
, andCzechStemFilter
(only if version is >= LUCENE_31). If a version is >= LUCENE_31 and a stem exclusion set is provided viaCzechAnalyzer(Version, Set, Set)
aKeywordMarkerFilter
is added beforeCzechStemFilter
.
-
-