org.apache.lucene.analysis.standard
Class StandardFilter

java.lang.Object
  org.apache.lucene.analysis.TokenStream
      org.apache.lucene.analysis.TokenFilter
          org.apache.lucene.analysis.standard.StandardFilter

public final class StandardFilter
extends TokenFilter

Normalizes tokens extracted with StandardTokenizer.

Field Summary

Fields inherited from class org.apache.lucene.analysis.TokenFilter

input

Constructor Summary

StandardFilter(TokenStream in)
Construct filtering in.

Method Summary

Token

next(Token reusableToken) Returns the next token in the stream, or null at EOS.

Methods inherited from class org.apache.lucene.analysis.TokenFilter

close, reset

Methods inherited from class org.apache.lucene.analysis.TokenStream

next

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

StandardFilter

public StandardFilter(TokenStream in)

Construct filtering in.

Method Detail

next

public final Token next(Token reusableToken)
                 throws java.io.IOException

Returns the next token in the stream, or null at EOS.

Removes 's from the end of words.

Removes dots from acronyms.

Overrides:

next in class TokenStream

Parameters:

reusableToken - a Token that may or may not be used to return; this parameter should never be null (the callee is not required to check for null before using it, but it is a good idea to assert that it is not null.)

Returns:

next token in the stream or null if end-of-stream was hit

Throws:

java.io.IOException