Uses of Interface
eu.bandm.tools.lexic.TokenSource

Packages that use TokenSource

Package	Description
eu.bandm.tools.d2d2.parser2
eu.bandm.tools.lexic	Toolkit for the dynamic construction of lexical analyzers.

Uses of TokenSource in eu.bandm.tools.d2d2.parser2

Methods in eu.bandm.tools.d2d2.parser2 that return TokenSource

Modifier and Type	Method	Description
static TokenSource<XMLDocumentIdentifier,D2dLexer.TokenType>	Parser2.tokenSource(Reader reader, String sourceIndication)

Uses of TokenSource in eu.bandm.tools.lexic

Classes in eu.bandm.tools.lexic that implement TokenSource

Modifier and Type	Class	Description
class	TokenFilter<D,T>	Abstract base class for token processors that filter out certain tokens.
class	TokenProcessor<D,T>	Abstract base class for secondary token sources that feed on other token sources.

Methods in eu.bandm.tools.lexic that return TokenSource

Modifier and Type	Method	Description
default TokenSource<D,T>	LookaheadTokenSource.forgetLookahead()
default TokenSource<D,T>	TokenSource.removeTypes(Set<T> types)	Returns a secondary token source that forwards all tokens from this token source that have none of the given types.
default TokenSource<D,T>	TokenSource.removeTypes(T... types)	Returns a secondary token source that forwards all tokens from this token source that have none of the given types.
default TokenSource<D,T>	TokenSource.with(Function<? super TokenSource<D,T>,? extends TokenProcessor<D,T>> processor)	Creates a new token processor by applying a given factory function to this source.

Methods in eu.bandm.tools.lexic with parameters of type TokenSource

Modifier and Type	Method	Description
static <D, T> TokenFilter<D,T>	TokenFilter.discard(TokenSource<D,T> input, Predicate<? super Token<D,T>> pred)
static <D, T> TokenFilter<D,T>	TokenFilter.removeTypes(TokenSource<D,T> input, Set<? extends T> types)

Method parameters in eu.bandm.tools.lexic with type arguments of type TokenSource

Modifier and Type	Method	Description
default TokenSource<D,T>	TokenSource.with(Function<? super TokenSource<D,T>,? extends TokenProcessor<D,T>> processor)	Creates a new token processor by applying a given factory function to this source.

Constructors in eu.bandm.tools.lexic with parameters of type TokenSource

Modifier	Constructor	Description
protected	TokenFilter(TokenSource<D,T> input, Predicate<? super Token<D,T>> acceptable)	Creates a new instance.
protected	TokenProcessor(TokenSource<D,T> input)	Creates a new instance.