See: Description
| Class | Description |
|---|---|
| Token |
IPADIC token produced by the IPADIC tokenizer with various morphological features
|
| Tokenizer |
A tokenizer based on the IPADIC dictionary
|
| Tokenizer.Builder |
Builder class for creating a customized tokenizer instance
|
This dictionary provides a basic set of features and suits many tasks. If you are not sure about which dictionary to use, this one is a good starting point.
The following token features are supported:
Copyright © 2015 Atilika Inc.. All rights reserved.