A C D E F G H I M N O P R S T U V W

A

asTokens() - Method in class org.canova.nlp.movingwindow.Window

C

cache - Variable in class org.canova.nlp.vectorizer.TextVectorizer

ConcurrentTokenizer - Class in org.canova.nlp.tokenization.tokenizer

OpenNLP Tokenizer annotator.

ConcurrentTokenizer() - Constructor for class org.canova.nlp.tokenization.tokenizer.ConcurrentTokenizer

Initializes a new instance.

ContextLabelRetriever - Class in org.canova.nlp.movingwindow

Context Label Retriever

countTokens() - Method in class org.canova.nlp.tokenization.tokenizer.DefaultStreamTokenizer

countTokens() - Method in class org.canova.nlp.tokenization.tokenizer.DefaultTokenizer

countTokens() - Method in class org.canova.nlp.tokenization.tokenizer.PosUimaTokenizer

countTokens() - Method in interface org.canova.nlp.tokenization.tokenizer.Tokenizer

The number of tokens in the tokenizer

countTokens() - Method in class org.canova.nlp.tokenization.tokenizer.UimaTokenizer

create(String) - Method in class org.canova.nlp.tokenization.tokenizerfactory.DefaultTokenizerFactory

create(InputStream) - Method in class org.canova.nlp.tokenization.tokenizerfactory.DefaultTokenizerFactory

create(String) - Method in class org.canova.nlp.tokenization.tokenizerfactory.PosUimaTokenizerFactory

create(InputStream) - Method in class org.canova.nlp.tokenization.tokenizerfactory.PosUimaTokenizerFactory

create(String) - Method in interface org.canova.nlp.tokenization.tokenizerfactory.TokenizerFactory

The tokenizer to createComplex

create(InputStream) - Method in interface org.canova.nlp.tokenization.tokenizerfactory.TokenizerFactory

Create a tokenizer based on an input stream

create(String) - Method in class org.canova.nlp.tokenization.tokenizerfactory.UimaTokenizerFactory

create(InputStream) - Method in class org.canova.nlp.tokenization.tokenizerfactory.UimaTokenizerFactory

createTokenizerFactory(Configuration) - Method in class org.canova.nlp.vectorizer.TextVectorizer

Create tokenizer factory based on the configuration

createTokenizerFactory(Configuration) - Method in class org.canova.nlp.vectorizer.TfidfVectorizer

createVector(Object[]) - Method in class org.canova.nlp.vectorizer.TfidfVectorizer

D

defaultAnalysisEngine() - Static method in class org.canova.nlp.tokenization.tokenizer.PosUimaTokenizer

defaultAnalysisEngine() - Static method in class org.canova.nlp.tokenization.tokenizerfactory.PosUimaTokenizerFactory

defaultAnalysisEngine() - Static method in class org.canova.nlp.tokenization.tokenizerfactory.UimaTokenizerFactory

Creates a tokenization,/stemming pipeline

DefaultStreamTokenizer - Class in org.canova.nlp.tokenization.tokenizer

Tokenizer based on the StreamTokenizer

DefaultStreamTokenizer(InputStream) - Constructor for class org.canova.nlp.tokenization.tokenizer.DefaultStreamTokenizer

DefaultTokenizer - Class in org.canova.nlp.tokenization.tokenizer

Default tokenizer

DefaultTokenizer(String) - Constructor for class org.canova.nlp.tokenization.tokenizer.DefaultTokenizer

DefaultTokenizerFactory - Class in org.canova.nlp.tokenization.tokenizerfactory

Default tokenizer based on string tokenizer or stream tokenizer

DefaultTokenizerFactory() - Constructor for class org.canova.nlp.tokenization.tokenizerfactory.DefaultTokenizerFactory

DefaultVocabCache - Class in org.canova.nlp.metadata

Vocab cache uswed for storing information about vocab

DefaultVocabCache(int) - Constructor for class org.canova.nlp.metadata.DefaultVocabCache

Instantiate with a given min word frequency

destroy() - Method in class org.canova.nlp.annotator.PoStagger

Releases allocated resources.

destroy() - Method in class org.canova.nlp.tokenization.tokenizer.ConcurrentTokenizer

Releases allocated resources.

disableLogging() - Static method in class org.canova.nlp.movingwindow.Util

doWithTokens(Tokenizer) - Method in class org.canova.nlp.vectorizer.TextVectorizer

Increment counts, add to collection,...

doWithTokens(Tokenizer) - Method in class org.canova.nlp.vectorizer.TfidfVectorizer

E

EndingPreProcessor - Class in org.canova.nlp.tokenization.tokenizer.preprocessor

Gets rid of endings: ed,ing, ly, s, .

EndingPreProcessor() - Constructor for class org.canova.nlp.tokenization.tokenizer.preprocessor.EndingPreProcessor

F

fit(RecordReader) - Method in class org.canova.nlp.vectorizer.TextVectorizer

fit(RecordReader, Vectorizer.RecordCallBack) - Method in class org.canova.nlp.vectorizer.TextVectorizer

fitTransform(RecordReader) - Method in class org.canova.nlp.vectorizer.TfidfVectorizer

G

getAnalysisEngine() - Method in class org.canova.nlp.uima.UimaResource

getBegin() - Method in class org.canova.nlp.movingwindow.Window

getCasPool() - Method in class org.canova.nlp.uima.UimaResource

getDescription(String) - Static method in class org.canova.nlp.annotator.PoStagger

getDescription() - Static method in class org.canova.nlp.annotator.SentenceAnnotator

getDescription() - Static method in class org.canova.nlp.annotator.StemmerAnnotator

getDescription(String) - Static method in class org.canova.nlp.annotator.StemmerAnnotator

getDescription(String) - Static method in class org.canova.nlp.annotator.TokenizerAnnotator

getDescription() - Static method in class org.canova.nlp.annotator.TokenizerAnnotator

getEnd() - Method in class org.canova.nlp.movingwindow.Window

getFocusWord() - Method in class org.canova.nlp.movingwindow.Window

getLabel() - Method in class org.canova.nlp.movingwindow.Window

getMedian() - Method in class org.canova.nlp.movingwindow.Window

getMinWordFrequency() - Method in class org.canova.nlp.metadata.DefaultVocabCache

getStopWords() - Static method in class org.canova.nlp.stopwords.StopWords

getTokens() - Method in class org.canova.nlp.tokenization.tokenizer.DefaultStreamTokenizer

getTokens() - Method in class org.canova.nlp.tokenization.tokenizer.DefaultTokenizer

getTokens() - Method in class org.canova.nlp.tokenization.tokenizer.PosUimaTokenizer

getTokens() - Method in interface org.canova.nlp.tokenization.tokenizer.Tokenizer

Returns a list of all the tokens

getTokens() - Method in class org.canova.nlp.tokenization.tokenizer.UimaTokenizer

getUimaResource() - Method in class org.canova.nlp.tokenization.tokenizerfactory.UimaTokenizerFactory

getWindowSize() - Method in class org.canova.nlp.movingwindow.Window

getWord(int) - Method in class org.canova.nlp.movingwindow.Window

getWords() - Method in class org.canova.nlp.movingwindow.Window

H

hasMoreTokens() - Method in class org.canova.nlp.tokenization.tokenizer.DefaultStreamTokenizer

hasMoreTokens() - Method in class org.canova.nlp.tokenization.tokenizer.DefaultTokenizer

hasMoreTokens() - Method in class org.canova.nlp.tokenization.tokenizer.PosUimaTokenizer

hasMoreTokens() - Method in interface org.canova.nlp.tokenization.tokenizer.Tokenizer

An iterator for tracking whether more tokens are left in the iterator not

hasMoreTokens() - Method in class org.canova.nlp.tokenization.tokenizer.UimaTokenizer

I

idf(String) - Method in class org.canova.nlp.metadata.DefaultVocabCache

idf(String) - Method in interface org.canova.nlp.metadata.VocabCache

Number of documents word has occurred in

incrementCount(String) - Method in class org.canova.nlp.metadata.DefaultVocabCache

incrementCount(String, double) - Method in class org.canova.nlp.metadata.DefaultVocabCache

incrementCount(String) - Method in interface org.canova.nlp.metadata.VocabCache

Increment a word count by 1

incrementCount(String, double) - Method in interface org.canova.nlp.metadata.VocabCache

Increment count for a word

incrementDocCount(String) - Method in class org.canova.nlp.metadata.DefaultVocabCache

incrementDocCount(String, double) - Method in class org.canova.nlp.metadata.DefaultVocabCache

incrementDocCount(String) - Method in interface org.canova.nlp.metadata.VocabCache

Increment the doc count for a word by 1

incrementDocCount(String, double) - Method in interface org.canova.nlp.metadata.VocabCache

Increment the document count for a particular word

incrementNumDocs(double) - Method in class org.canova.nlp.metadata.DefaultVocabCache

incrementNumDocs(double) - Method in interface org.canova.nlp.metadata.VocabCache

Increment the number of documents

initialize(UimaContext) - Method in class org.canova.nlp.annotator.PoStagger

Initializes the current instance with the given context.

initialize(Configuration) - Method in class org.canova.nlp.metadata.DefaultVocabCache

initialize(Configuration) - Method in interface org.canova.nlp.metadata.VocabCache

Configuration for initializing

initialize(UimaContext) - Method in class org.canova.nlp.tokenization.tokenizer.ConcurrentTokenizer

Initializes the current instance with the given context.

initialize(Configuration) - Method in class org.canova.nlp.vectorizer.TextVectorizer

isBeginLabel() - Method in class org.canova.nlp.movingwindow.Window

isEndLabel() - Method in class org.canova.nlp.movingwindow.Window

M

matchesAnyStopWord(List<String>, String) - Static method in class org.canova.nlp.movingwindow.Util

MIN_WORD_FREQUENCY - Static variable in class org.canova.nlp.vectorizer.TextVectorizer

minWordFrequency() - Method in class org.canova.nlp.metadata.DefaultVocabCache

minWordFrequency() - Method in interface org.canova.nlp.metadata.VocabCache

The min word frequency needed to be included in the vocab (default 5)

minWordFrequency - Variable in class org.canova.nlp.vectorizer.TextVectorizer

N

nextToken() - Method in class org.canova.nlp.tokenization.tokenizer.DefaultStreamTokenizer

nextToken() - Method in class org.canova.nlp.tokenization.tokenizer.DefaultTokenizer

nextToken() - Method in class org.canova.nlp.tokenization.tokenizer.PosUimaTokenizer

nextToken() - Method in interface org.canova.nlp.tokenization.tokenizer.Tokenizer

The next token (word usually) in the string

nextToken() - Method in class org.canova.nlp.tokenization.tokenizer.UimaTokenizer

numDocs() - Method in class org.canova.nlp.metadata.DefaultVocabCache

numDocs() - Method in interface org.canova.nlp.metadata.VocabCache

Number of documents

O

org.canova.nlp.annotator - package org.canova.nlp.annotator

org.canova.nlp.metadata - package org.canova.nlp.metadata

org.canova.nlp.movingwindow - package org.canova.nlp.movingwindow

org.canova.nlp.stopwords - package org.canova.nlp.stopwords

org.canova.nlp.tokenization.tokenizer - package org.canova.nlp.tokenization.tokenizer

org.canova.nlp.tokenization.tokenizer.preprocessor - package org.canova.nlp.tokenization.tokenizer.preprocessor

org.canova.nlp.tokenization.tokenizerfactory - package org.canova.nlp.tokenization.tokenizerfactory

org.canova.nlp.uima - package org.canova.nlp.uima

org.canova.nlp.vectorizer - package org.canova.nlp.vectorizer

P

parallelCounter() - Static method in class org.canova.nlp.movingwindow.Util

Returns a thread safe counter

PoStagger - Class in org.canova.nlp.annotator

PoStagger() - Constructor for class org.canova.nlp.annotator.PoStagger

Initializes a new instance.

postProcessAnnotations(Span[], AnnotationFS[]) - Method in class org.canova.nlp.tokenization.tokenizer.ConcurrentTokenizer

PosUimaTokenizer - Class in org.canova.nlp.tokenization.tokenizer

Filter by part of speech tag.

PosUimaTokenizer(String, AnalysisEngine, Collection<String>) - Constructor for class org.canova.nlp.tokenization.tokenizer.PosUimaTokenizer

PosUimaTokenizerFactory - Class in org.canova.nlp.tokenization.tokenizerfactory

Creates a tokenizer that filters by part of speech tags

PosUimaTokenizerFactory(Collection<String>) - Constructor for class org.canova.nlp.tokenization.tokenizerfactory.PosUimaTokenizerFactory

PosUimaTokenizerFactory(AnalysisEngine, Collection<String>) - Constructor for class org.canova.nlp.tokenization.tokenizerfactory.PosUimaTokenizerFactory

preProcess(String) - Method in class org.canova.nlp.tokenization.tokenizer.preprocessor.EndingPreProcessor

preProcess(String) - Method in interface org.canova.nlp.tokenization.tokenizer.TokenPreProcess

Pre process a token

process(CAS) - Method in class org.canova.nlp.annotator.PoStagger

Performs pos-tagging on the given tcas object.

process(JCas) - Method in class org.canova.nlp.annotator.SentenceAnnotator

process(JCas) - Method in class org.canova.nlp.annotator.StemmerAnnotator

process(CAS) - Method in class org.canova.nlp.tokenization.tokenizer.ConcurrentTokenizer

process(String) - Method in class org.canova.nlp.uima.UimaResource

Use the given analysis engine and process the given text You must release the return cas yourself

R

release(CAS) - Method in class org.canova.nlp.uima.UimaResource

retrieve() - Method in class org.canova.nlp.uima.UimaResource

S

SentenceAnnotator - Class in org.canova.nlp.annotator

SentenceAnnotator() - Constructor for class org.canova.nlp.annotator.SentenceAnnotator

setAnalysisEngine(AnalysisEngine) - Method in class org.canova.nlp.uima.UimaResource

setBegin(int) - Method in class org.canova.nlp.movingwindow.Window

setCasPool(CasPool) - Method in class org.canova.nlp.uima.UimaResource

setEnd(int) - Method in class org.canova.nlp.movingwindow.Window

setLabel(String) - Method in class org.canova.nlp.movingwindow.Window

setMinWordFrequency(int) - Method in class org.canova.nlp.metadata.DefaultVocabCache

setStem(Token, String) - Method in class org.canova.nlp.annotator.StemmerAnnotator

setTokenPreProcessor(TokenPreProcess) - Method in class org.canova.nlp.tokenization.tokenizer.DefaultStreamTokenizer

setTokenPreProcessor(TokenPreProcess) - Method in class org.canova.nlp.tokenization.tokenizer.DefaultTokenizer

setTokenPreProcessor(TokenPreProcess) - Method in class org.canova.nlp.tokenization.tokenizer.PosUimaTokenizer

setTokenPreProcessor(TokenPreProcess) - Method in interface org.canova.nlp.tokenization.tokenizer.Tokenizer

Set the token pre process

setTokenPreProcessor(TokenPreProcess) - Method in class org.canova.nlp.tokenization.tokenizer.UimaTokenizer

setTokenPreProcessor(TokenPreProcess) - Method in class org.canova.nlp.tokenization.tokenizerfactory.DefaultTokenizerFactory

setTokenPreProcessor(TokenPreProcess) - Method in class org.canova.nlp.tokenization.tokenizerfactory.PosUimaTokenizerFactory

setTokenPreProcessor(TokenPreProcess) - Method in interface org.canova.nlp.tokenization.tokenizerfactory.TokenizerFactory

Sets a token pre processor to be used with every tokenizer

setTokenPreProcessor(TokenPreProcess) - Method in class org.canova.nlp.tokenization.tokenizerfactory.UimaTokenizerFactory

setWords(List<String>) - Method in class org.canova.nlp.movingwindow.Window

StemmerAnnotator - Class in org.canova.nlp.annotator

StemmerAnnotator() - Constructor for class org.canova.nlp.annotator.StemmerAnnotator

STOP_WORDS - Static variable in class org.canova.nlp.vectorizer.TextVectorizer

StopWords - Class in org.canova.nlp.stopwords

Loads stop words from the class path

StopWords() - Constructor for class org.canova.nlp.stopwords.StopWords

stopWords - Variable in class org.canova.nlp.vectorizer.TextVectorizer

stringWithLabels(String, TokenizerFactory) - Static method in class org.canova.nlp.movingwindow.ContextLabelRetriever

Returns a stripped sentence with the indices of words with certain kinds of labels.

T

TextVectorizer<VECTOR_TYPE> - Class in org.canova.nlp.vectorizer

Baseline text vectorizer that includes some common elements to text analysis such as the tokenizer factory

TextVectorizer() - Constructor for class org.canova.nlp.vectorizer.TextVectorizer

tfidf(String, double) - Method in class org.canova.nlp.metadata.DefaultVocabCache

tfidf(String, double) - Method in interface org.canova.nlp.metadata.VocabCache

Calculate the tfidf of the word given the document frequency

TfidfVectorizer<VECTOR_TYPE> - Class in org.canova.nlp.vectorizer

Tf idf vectorizer

TfidfVectorizer() - Constructor for class org.canova.nlp.vectorizer.TfidfVectorizer

tokenize(CAS, AnnotationFS) - Method in class org.canova.nlp.tokenization.tokenizer.ConcurrentTokenizer

Tokenizer - Interface in org.canova.nlp.tokenization.tokenizer

A representation of a tokenizer.

TOKENIZER - Static variable in class org.canova.nlp.vectorizer.TextVectorizer

TokenizerAnnotator - Class in org.canova.nlp.annotator

Overrides OpenNLP tokenizer to be thread safe

TokenizerAnnotator() - Constructor for class org.canova.nlp.annotator.TokenizerAnnotator

TokenizerFactory - Interface in org.canova.nlp.tokenization.tokenizerfactory

Generates a tokenizer for a given string

tokenizerFactory - Variable in class org.canova.nlp.vectorizer.TextVectorizer

TokenPreProcess - Interface in org.canova.nlp.tokenization.tokenizer

Token preprocessing

toString() - Method in class org.canova.nlp.movingwindow.Window

toString(Collection<Writable>) - Method in class org.canova.nlp.vectorizer.TextVectorizer

transform(Collection<Writable>) - Method in class org.canova.nlp.vectorizer.TfidfVectorizer

typeSystemInit(TypeSystem) - Method in class org.canova.nlp.annotator.PoStagger

Initializes the type system.

typeSystemInit(TypeSystem) - Method in class org.canova.nlp.tokenization.tokenizer.ConcurrentTokenizer

Initializes the type system.

U

UimaResource - Class in org.canova.nlp.uima

Resource holder for uima

UimaResource(AnalysisEngine) - Constructor for class org.canova.nlp.uima.UimaResource

UimaResource(AnalysisEngine, CasPool) - Constructor for class org.canova.nlp.uima.UimaResource

UimaTokenizer - Class in org.canova.nlp.tokenization.tokenizer

Tokenizer based on the passed in analysis engine

UimaTokenizer(String, UimaResource, boolean) - Constructor for class org.canova.nlp.tokenization.tokenizer.UimaTokenizer

UimaTokenizerFactory - Class in org.canova.nlp.tokenization.tokenizerfactory

Uses a uima AnalysisEngine to tokenize text.

UimaTokenizerFactory() - Constructor for class org.canova.nlp.tokenization.tokenizerfactory.UimaTokenizerFactory

UimaTokenizerFactory(UimaResource) - Constructor for class org.canova.nlp.tokenization.tokenizerfactory.UimaTokenizerFactory

UimaTokenizerFactory(AnalysisEngine) - Constructor for class org.canova.nlp.tokenization.tokenizerfactory.UimaTokenizerFactory

UimaTokenizerFactory(UimaResource, boolean) - Constructor for class org.canova.nlp.tokenization.tokenizerfactory.UimaTokenizerFactory

UimaTokenizerFactory(boolean) - Constructor for class org.canova.nlp.tokenization.tokenizerfactory.UimaTokenizerFactory

UimaTokenizerFactory(AnalysisEngine, boolean) - Constructor for class org.canova.nlp.tokenization.tokenizerfactory.UimaTokenizerFactory

Util - Class in org.canova.nlp.movingwindow

Util() - Constructor for class org.canova.nlp.movingwindow.Util

V

VocabCache - Interface in org.canova.nlp.metadata

Track metadata about vocabs

vocabWords() - Method in class org.canova.nlp.metadata.DefaultVocabCache

vocabWords() - Method in interface org.canova.nlp.metadata.VocabCache

All of the vocab words (ordered) note that these are not all the possible tokens

W

Window - Class in org.canova.nlp.movingwindow

A representation of a sliding window.

Window(Collection<String>, int, int) - Constructor for class org.canova.nlp.movingwindow.Window

Creates a window with a context of size 3

Window(Collection<String>, int, int, int) - Constructor for class org.canova.nlp.movingwindow.Window

Initialize a window with the given size

windowForWordInPosition(int, int, List<String>) - Static method in class org.canova.nlp.movingwindow.Windows

Creates a sliding window from text

Windows - Class in org.canova.nlp.movingwindow

Static utility class for textual based windowing functions

Windows() - Constructor for class org.canova.nlp.movingwindow.Windows

windows(InputStream, int) - Static method in class org.canova.nlp.movingwindow.Windows

Constructs a list of window of size windowSize.

windows(InputStream, TokenizerFactory, int) - Static method in class org.canova.nlp.movingwindow.Windows

Constructs a list of window of size windowSize.

windows(String, int) - Static method in class org.canova.nlp.movingwindow.Windows

Constructs a list of window of size windowSize.

windows(String, TokenizerFactory, int) - Static method in class org.canova.nlp.movingwindow.Windows

Constructs a list of window of size windowSize.

windows(String) - Static method in class org.canova.nlp.movingwindow.Windows

Constructs a list of window of size windowSize.

windows(String, TokenizerFactory) - Static method in class org.canova.nlp.movingwindow.Windows

Constructs a list of window of size windowSize.

windows(List<String>, int) - Static method in class org.canova.nlp.movingwindow.Windows

Constructs a list of window of size windowSize

wordAt(int) - Method in class org.canova.nlp.metadata.DefaultVocabCache

wordAt(int) - Method in interface org.canova.nlp.metadata.VocabCache

Returns a word in the vocab at a particular index

wordFrequenciesForRecord(Collection<Writable>) - Method in class org.canova.nlp.vectorizer.TextVectorizer

wordFrequency(String) - Method in class org.canova.nlp.metadata.DefaultVocabCache

wordFrequency(String) - Method in interface org.canova.nlp.metadata.VocabCache

Get the word frequency for a word

A C D E F G H I M N O P R S T U V W