Uses of Interface
org.canova.nlp.tokenization.tokenizer.TokenPreProcess

Packages that use TokenPreProcess

Package	Description
org.canova.nlp.tokenization.tokenizer
org.canova.nlp.tokenization.tokenizer.preprocessor
org.canova.nlp.tokenization.tokenizerfactory

Uses of TokenPreProcess in org.canova.nlp.tokenization.tokenizer

Methods in org.canova.nlp.tokenization.tokenizer with parameters of type TokenPreProcess

Modifier and Type	Method and Description
void	UimaTokenizer.setTokenPreProcessor(TokenPreProcess tokenPreProcessor)
void	DefaultTokenizer.setTokenPreProcessor(TokenPreProcess tokenPreProcessor)
void	PosUimaTokenizer.setTokenPreProcessor(TokenPreProcess tokenPreProcessor)
void	Tokenizer.setTokenPreProcessor(TokenPreProcess tokenPreProcessor) Set the token pre process
void	DefaultStreamTokenizer.setTokenPreProcessor(TokenPreProcess tokenPreProcessor)

Uses of TokenPreProcess in org.canova.nlp.tokenization.tokenizer.preprocessor

Classes in org.canova.nlp.tokenization.tokenizer.preprocessor that implement TokenPreProcess

Modifier and Type	Class and Description
class	EndingPreProcessor Gets rid of endings: ed,ing, ly, s, .

Uses of TokenPreProcess in org.canova.nlp.tokenization.tokenizerfactory

Methods in org.canova.nlp.tokenization.tokenizerfactory with parameters of type TokenPreProcess

Modifier and Type	Method and Description
void	PosUimaTokenizerFactory.setTokenPreProcessor(TokenPreProcess preProcessor)
void	UimaTokenizerFactory.setTokenPreProcessor(TokenPreProcess preProcessor)
void	TokenizerFactory.setTokenPreProcessor(TokenPreProcess preProcessor) Sets a token pre processor to be used with every tokenizer
void	DefaultTokenizerFactory.setTokenPreProcessor(TokenPreProcess preProcessor)