Package eu.bandm.tools.lexic

Class LookaheadTokenProcessor<D,T,L>

java.lang.Object

eu.bandm.tools.lexic.LookaheadTokenProcessor<D,T,L>

Type Parameters:

D - the type of source document identifiers

T - the type of token types

L - the type of lookahead data

All Implemented Interfaces:

LookaheadTokenSource<D,T,L>, Supplier<Token<D,T>>

Direct Known Subclasses:

LookaheadTokenFilter, Screener, TokenProcessor

public abstract class LookaheadTokenProcessor<D,T,L>
extends Object
implements LookaheadTokenSource<D,T,L>

Abstract base class for secondary token sources that feed on other token sources.

Field Summary

Fields

Modifier and Type	Field	Description
protected final LookaheadTokenSource<D,T,L>	input	The input token source.

Constructor Summary

Constructors

Modifier	Constructor	Description
protected	LookaheadTokenProcessor(LookaheadTokenSource<D,T,L> input)	Creates a new instance.

Method Summary

Modifier and Type	Method	Description
L	relinquishLookahead()	Clear the internal lookahead buffer and return its contents.
void	takeOverLookahead(L lookaheadData)	Fill the internal lookahead buffer with data.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface eu.bandm.tools.lexic.LookaheadTokenSource

forgetLookahead, removeTypes, removeTypes

Methods inherited from interface java.util.function.Supplier

get

Field Details

input

protected final LookaheadTokenSource<D,T,L> input

The input token source.

Constructor Details

LookaheadTokenProcessor

protected LookaheadTokenProcessor(LookaheadTokenSource<D,T,L> input)

Creates a new instance.

Parameters:

input - the input token source

Method Details

relinquishLookahead

public L relinquishLookahead()

Description copied from interface: LookaheadTokenSource

Clear the internal lookahead buffer and return its contents.

Specified by:

relinquishLookahead in interface LookaheadTokenSource<D,T,L>

Returns:

the former contents of the internal lookahead buffer

takeOverLookahead

public void takeOverLookahead(L lookaheadData)

Description copied from interface: LookaheadTokenSource

Fill the internal lookahead buffer with data.

The buffer must be empty before this method is invoked. After return, the given data will be consumed from the buffer before the usual input is considered.

Specified by:

takeOverLookahead in interface LookaheadTokenSource<D,T,L>

Parameters:

lookaheadData - the lookahead data to fill in