com.atilika.kuromoji.ipadic

Class Token

java.lang.Object

com.atilika.kuromoji.TokenBase

com.atilika.kuromoji.ipadic.Token

public class Token
extends TokenBase

IPADIC token produced by the IPADIC tokenizer with various morphological features

Constructor Summary

Constructors

Constructor and Description
Token(int wordId, String surface, ViterbiNode.Type type, int position, Dictionary dictionary)

Method Summary

Methods

Modifier and Type	Method and Description
String	getBaseForm() Gets the base form (also called dictionary form) for this token (基本形)
String	getConjugationForm() Gets the conjugation form for this token (活用形), if applicable
String	getConjugationType() Gets the conjugation type for this token (活用型), if applicable
String	getPartOfSpeechLevel1() Gets the 1st level part-of-speech tag for this token (品詞細分類1)
String	getPartOfSpeechLevel2() Gets the 2nd level part-of-speech tag for this token (品詞細分類2)
String	getPartOfSpeechLevel3() Gets the 3rd level part-of-speech tag for this token (品詞細分類3)
String	getPartOfSpeechLevel4() Gets the 4th level part-of-speech tag for this token (品詞細分類4)
String	getPronunciation() Gets the pronunciation for this token (発音)
String	getReading() Gets the reading for this token (読み) in katakana script

Methods inherited from class com.atilika.kuromoji.TokenBase

getAllFeatures, getAllFeaturesArray, getFeature, getPosition, getSurface, isKnown, isUser, toString

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

Token

public Token(int wordId,
     String surface,
     ViterbiNode.Type type,
     int position,
     Dictionary dictionary)

Method Detail

getPartOfSpeechLevel1

public String getPartOfSpeechLevel1()

Gets the 1st level part-of-speech tag for this token (品詞細分類1)

Returns:

1st level part-of-speech tag, not null

getPartOfSpeechLevel2

public String getPartOfSpeechLevel2()

Gets the 2nd level part-of-speech tag for this token (品詞細分類2)

Returns:

2nd level part-of-speech tag, not null

getPartOfSpeechLevel3

public String getPartOfSpeechLevel3()

Gets the 3rd level part-of-speech tag for this token (品詞細分類3)

Returns:

3rd level part-of-speech tag, not null

getPartOfSpeechLevel4

public String getPartOfSpeechLevel4()

Gets the 4th level part-of-speech tag for this token (品詞細分類4)

Returns:

4th level part-of-speech tag, not null

getConjugationType

public String getConjugationType()

Gets the conjugation type for this token (活用型), if applicable

If this token does not have a conjugation type, return *

Returns:

conjugation type, not null

getConjugationForm

public String getConjugationForm()

Gets the conjugation form for this token (活用形), if applicable

If this token does not have a conjugation form, return *

Returns:

conjugation form, not null

getBaseForm

public String getBaseForm()

Gets the base form (also called dictionary form) for this token (基本形)

Returns:

base form, not null

getReading

public String getReading()

Gets the reading for this token (読み) in katakana script

Returns:

reading, not null

getPronunciation

public String getPronunciation()

Gets the pronunciation for this token (発音)

Returns:

pronunciation, not null