Uses of Class
com.atilika.kuromoji.ipadic.Tokenizer.Builder

Packages that use Tokenizer.Builder

Package	Description
com.atilika.kuromoji.ipadic	A Japanese morphological analyzer based on the IPADIC dictionary.

Uses of Tokenizer.Builder in com.atilika.kuromoji.ipadic

Methods in com.atilika.kuromoji.ipadic that return Tokenizer.Builder

Modifier and Type	Method and Description
Tokenizer.Builder	Tokenizer.Builder.isSplitOnNakaguro(boolean split) Predictate that splits unknown words on the middle dot character (U+30FB KATAKANA MIDDLE DOT)
Tokenizer.Builder	Tokenizer.Builder.kanjiPenalty(int lengthThreshold, int penalty) Sets a custom kanji penalty
Tokenizer.Builder	Tokenizer.Builder.mode(TokenizerBase.Mode mode) Sets the tokenization mode
Tokenizer.Builder	Tokenizer.Builder.otherPenalty(int lengthThreshold, int penalty) Sets a custom non-kanji penalty