Class TokenProcessor<D,T>

java.lang.Object
eu.bandm.tools.lexic.TokenProcessor<D,T>
Type Parameters:
D - the type of source document identifiers
T - the type of token types
All Implemented Interfaces:
TokenSource<D,T>, Supplier<Token<D,T>>
Direct Known Subclasses:
TokenFilter

public abstract class TokenProcessor<D,T> extends Object implements TokenSource<D,T>
Abstract base class for secondary token sources that feed on other token sources.
  • Field Details

    • input

      protected final TokenSource<D,T> input
      The input token source.
  • Constructor Details

    • TokenProcessor

      protected TokenProcessor(TokenSource<D,T> input)
      Creates a new instance.
      Parameters:
      input - the input token source