Uses of Interface
eu.bandm.tools.lexic.TokenSource

Packages that use TokenSource

Package	Description
eu.bandm.tools.lexic	Toolkit for the dynamic construction of lexical analyzers.

Uses of TokenSource in eu.bandm.tools.lexic

Classes in eu.bandm.tools.lexic that implement TokenSource

Modifier and Type	Class	Description
class	TokenFilter<D,T>	Abstract base class for token processors that filter out certain tokens.
class	TokenProcessor<D,T>	Abstract base class for secondary token sources that feed on other token sources.

Fields in eu.bandm.tools.lexic declared as TokenSource

Modifier and Type	Field	Description
protected final TokenSource<D,T>	TokenProcessor.input	The input token source.

Methods in eu.bandm.tools.lexic that return TokenSource

Modifier and Type	Method	Description
<D> TokenSource<D,T>	Lexer.lex(CodePointSource input)	Returns a token source that produces tokens from the given input source.
<D> TokenSource<D,T>	Lexer.lex(CodePointSource input, D documentId, int firstLine, int firstColumn)	Returns a token source that produces tokens from the given input source.
default TokenSource<D,T>	TokenSource.removeTypes(Set<T> types)	Returns a secondary token source that forwards all tokens from this token source that have none of the given types.
default TokenSource<D,T>	TokenSource.removeTypes(T... types)	Returns a secondary token source that forwards all tokens from this token source that have none of the given types.
default TokenSource<D,T>	TokenSource.with(Function<? super TokenSource<D,T>,? extends TokenProcessor<D,T>> processor)	Creates a new token processor by applying a given factory function to this source.

Methods in eu.bandm.tools.lexic with parameters of type TokenSource

Modifier and Type	Method	Description
static <D, T> TokenFilter<D,T>	TokenFilter.discard(TokenSource<D,T> input, Predicate<? super Token<D,T>> pred)	Returns a token filter that forwards those tokens from a given input source that do not match a given predicate.
static <D, T> TokenFilter<D,T>	TokenFilter.forward(TokenSource<D,T> input, Predicate<? super Token<D,T>> pred)	Returns a token filter that forwards those tokens from a given input source that match a given predicate.
static <D, T> TokenFilter<D,T>	TokenFilter.removeTypes(TokenSource<D,T> input, Set<T> types)	Returns a secondary token source that forwards all tokens from a given token source that have none of the given types.

Method parameters in eu.bandm.tools.lexic with type arguments of type TokenSource

Modifier and Type	Method	Description
default TokenSource<D,T>	TokenSource.with(Function<? super TokenSource<D,T>,? extends TokenProcessor<D,T>> processor)	Creates a new token processor by applying a given factory function to this source.

Constructors in eu.bandm.tools.lexic with parameters of type TokenSource

Modifier	Constructor	Description
protected	TokenFilter(TokenSource<D,T> input)	Creates a new instance.
protected	TokenProcessor(TokenSource<D,T> input)	Creates a new instance.