Uses of Interface
org.canova.nlp.tokenization.tokenizerfactory.TokenizerFactory

Packages that use TokenizerFactory

Package	Description
org.canova.nlp.movingwindow
org.canova.nlp.tokenization.tokenizerfactory
org.canova.nlp.vectorizer

Uses of TokenizerFactory in org.canova.nlp.movingwindow

Methods in org.canova.nlp.movingwindow with parameters of type TokenizerFactory

Modifier and Type	Method and Description
static Pair<String,MultiDimensionalMap<Integer,Integer,String>>	ContextLabelRetriever.stringWithLabels(String sentence, TokenizerFactory tokenizerFactory) Returns a stripped sentence with the indices of words with certain kinds of labels.
static List<Window>	Windows.windows(InputStream words, TokenizerFactory tokenizerFactory, int windowSize) Constructs a list of window of size windowSize.
static List<Window>	Windows.windows(String words, TokenizerFactory tokenizerFactory) Constructs a list of window of size windowSize.
static List<Window>	Windows.windows(String words, TokenizerFactory tokenizerFactory, int windowSize) Constructs a list of window of size windowSize.

Uses of TokenizerFactory in org.canova.nlp.tokenization.tokenizerfactory

Classes in org.canova.nlp.tokenization.tokenizerfactory that implement TokenizerFactory

Modifier and Type	Class and Description
class	DefaultTokenizerFactory Default tokenizer based on string tokenizer or stream tokenizer
class	PosUimaTokenizerFactory Creates a tokenizer that filters by part of speech tags
class	UimaTokenizerFactory Uses a uima AnalysisEngine to tokenize text.

Uses of TokenizerFactory in org.canova.nlp.vectorizer

Fields in org.canova.nlp.vectorizer declared as TokenizerFactory

Modifier and Type	Field and Description
protected TokenizerFactory	TextVectorizer.tokenizerFactory

Methods in org.canova.nlp.vectorizer that return TokenizerFactory

Modifier and Type	Method and Description
abstract TokenizerFactory	TextVectorizer.createTokenizerFactory(Configuration conf) Create tokenizer factory based on the configuration
TokenizerFactory	TfidfVectorizer.createTokenizerFactory(Configuration conf)