Package org.apache.lucene.analysis.ko
Class KoreanPartOfSpeechStopFilter
java.lang.Object
org.apache.lucene.util.AttributeSource
org.apache.lucene.analysis.TokenStream
org.apache.lucene.analysis.TokenFilter
org.apache.lucene.analysis.FilteringTokenFilter
org.apache.lucene.analysis.ko.KoreanPartOfSpeechStopFilter
- All Implemented Interfaces:
Closeable
,AutoCloseable
,Unwrappable<TokenStream>
Removes tokens that match a set of part-of-speech tags.
-
Nested Class Summary
Nested classes/interfaces inherited from class org.apache.lucene.util.AttributeSource
AttributeSource.State
-
Field Summary
FieldsModifier and TypeFieldDescriptionDefault list of tags to filter.private final PartOfSpeechAttribute
Fields inherited from class org.apache.lucene.analysis.TokenFilter
input
Fields inherited from class org.apache.lucene.analysis.TokenStream
DEFAULT_TOKEN_ATTRIBUTE_FACTORY
-
Constructor Summary
ConstructorsConstructorDescriptionCreate a newKoreanPartOfSpeechStopFilter
with the default list of stop tagsDEFAULT_STOP_TAGS
.KoreanPartOfSpeechStopFilter
(TokenStream input, Set<POS.Tag> stopTags) Create a newKoreanPartOfSpeechStopFilter
. -
Method Summary
Modifier and TypeMethodDescriptionprotected boolean
accept()
Override this method and return if the current input token should be returned byFilteringTokenFilter.incrementToken()
.Methods inherited from class org.apache.lucene.analysis.FilteringTokenFilter
end, incrementToken, reset
Methods inherited from class org.apache.lucene.analysis.TokenFilter
close, unwrap
Methods inherited from class org.apache.lucene.util.AttributeSource
addAttribute, addAttributeImpl, captureState, clearAttributes, cloneAttributes, copyTo, endAttributes, equals, getAttribute, getAttributeClassesIterator, getAttributeFactory, getAttributeImplsIterator, hasAttribute, hasAttributes, hashCode, reflectAsString, reflectWith, removeAllAttributes, restoreState, toString
-
Field Details
-
stopTags
-
posAtt
-
DEFAULT_STOP_TAGS
Default list of tags to filter.
-
-
Constructor Details
-
KoreanPartOfSpeechStopFilter
Create a newKoreanPartOfSpeechStopFilter
with the default list of stop tagsDEFAULT_STOP_TAGS
.- Parameters:
input
- theTokenStream
to consume
-
KoreanPartOfSpeechStopFilter
Create a newKoreanPartOfSpeechStopFilter
.- Parameters:
input
- theTokenStream
to consumestopTags
- the part-of-speech tags that should be removed
-
-
Method Details
-
accept
protected boolean accept()Description copied from class:FilteringTokenFilter
Override this method and return if the current input token should be returned byFilteringTokenFilter.incrementToken()
.- Specified by:
accept
in classFilteringTokenFilter
-