Package eu.bandm.tools.lexic

Class TokenProcessor<D,T>

java.lang.Object

eu.bandm.tools.lexic.LookaheadTokenProcessor<D,T,Void>

eu.bandm.tools.lexic.TokenProcessor<D,T>

Type Parameters:

D - the type of source document identifiers

T - the type of token types

All Implemented Interfaces:

LookaheadTokenSource<D,T,Void>, TokenSource<D,T>, Supplier<Token<D,T>>

public abstract class TokenProcessor<D,T>
extends LookaheadTokenProcessor<D,T,Void>
implements TokenSource<D,T>

Abstract base class for secondary token sources that feed on other token sources.

Field Summary

Fields inherited from class eu.bandm.tools.lexic.LookaheadTokenProcessor

input

Constructor Summary

Constructors

Modifier	Constructor	Description
protected	TokenProcessor(TokenSource<D,T> input)	Creates a new instance.

Method Summary

Methods inherited from class eu.bandm.tools.lexic.LookaheadTokenProcessor

relinquishLookahead, takeOverLookahead

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface eu.bandm.tools.lexic.LookaheadTokenSource

forgetLookahead

Methods inherited from interface java.util.function.Supplier

get

Methods inherited from interface eu.bandm.tools.lexic.TokenSource

relinquishLookahead, removeTypes, removeTypes, takeOverLookahead, with

Constructor Details

TokenProcessor

protected TokenProcessor(TokenSource<D,T> input)

Creates a new instance.

Parameters:

input - the input token source