Constructor Detail

Method Detail

• getDescriptor

   final static Descriptors.Descriptor getDescriptor()

• clear

   SentencepieceModel.NormalizerSpec.Builder clear()

• getDescriptorForType

   Descriptors.Descriptor getDescriptorForType()

• getDefaultInstanceForType

   SentencepieceModel.NormalizerSpec getDefaultInstanceForType()

• build

   SentencepieceModel.NormalizerSpec build()

• buildPartial

   SentencepieceModel.NormalizerSpec buildPartial()

• clone

   SentencepieceModel.NormalizerSpec.Builder clone()

• setField

   SentencepieceModel.NormalizerSpec.Builder setField(Descriptors.FieldDescriptor field, Object value)

• clearField

   SentencepieceModel.NormalizerSpec.Builder clearField(Descriptors.FieldDescriptor field)

• clearOneof

   SentencepieceModel.NormalizerSpec.Builder clearOneof(Descriptors.OneofDescriptor oneof)

• setRepeatedField

   SentencepieceModel.NormalizerSpec.Builder setRepeatedField(Descriptors.FieldDescriptor field, int index, Object value)

• addRepeatedField

   SentencepieceModel.NormalizerSpec.Builder addRepeatedField(Descriptors.FieldDescriptor field, Object value)

• setExtension

   <Type> SentencepieceModel.NormalizerSpec.Builder setExtension(GeneratedMessage.GeneratedExtension<SentencepieceModel.NormalizerSpec, Type> extension, Type value)

• setExtension

   <Type> SentencepieceModel.NormalizerSpec.Builder setExtension(GeneratedMessage.GeneratedExtension<SentencepieceModel.NormalizerSpec, List<Type>> extension, int index, Type value)

• addExtension

   <Type> SentencepieceModel.NormalizerSpec.Builder addExtension(GeneratedMessage.GeneratedExtension<SentencepieceModel.NormalizerSpec, List<Type>> extension, Type value)

• clearExtension

   <T> SentencepieceModel.NormalizerSpec.Builder clearExtension(GeneratedMessage.GeneratedExtension<SentencepieceModel.NormalizerSpec, T> extension)

• mergeFrom

   SentencepieceModel.NormalizerSpec.Builder mergeFrom(Message other)

• mergeFrom

   SentencepieceModel.NormalizerSpec.Builder mergeFrom(SentencepieceModel.NormalizerSpec other)

• isInitialized

   final boolean isInitialized()

• mergeFrom

   SentencepieceModel.NormalizerSpec.Builder mergeFrom(CodedInputStream input, ExtensionRegistryLite extensionRegistry)

• hasName

   boolean hasName()

  name of normalization rule.
  

  optional string name = 1;

  Returns:

  Whether the name field is set.

• getName

   String getName()

  name of normalization rule.
  

  optional string name = 1;

  Returns:

  The name.

• getNameBytes

   ByteString getNameBytes()

  name of normalization rule.
  

  optional string name = 1;

  Returns:

  The bytes for name.

• setName

   SentencepieceModel.NormalizerSpec.Builder setName(String value)

  name of normalization rule.
  

  optional string name = 1;

  Parameters:

  value - The name to set.

  Returns:

  This builder for chaining.

• clearName

   SentencepieceModel.NormalizerSpec.Builder clearName()

  name of normalization rule.
  

  optional string name = 1;

  Returns:

  This builder for chaining.

• setNameBytes

   SentencepieceModel.NormalizerSpec.Builder setNameBytes(ByteString value)

  name of normalization rule.
  

  optional string name = 1;

  Parameters:

  value - The bytes for name to set.

  Returns:

  This builder for chaining.

• hasPrecompiledCharsmap

   boolean hasPrecompiledCharsmap()

  Pre-compiled normalization rule created by
  Builder::GetPrecompiledCharsMap() or Builder::CompileCharsMap() method.
  Usually this field is set by Builder::GetNormalizerSpec() method.
  

  optional bytes precompiled_charsmap = 2;

  Returns:

  Whether the precompiledCharsmap field is set.

• getPrecompiledCharsmap

   ByteString getPrecompiledCharsmap()

  Pre-compiled normalization rule created by
  Builder::GetPrecompiledCharsMap() or Builder::CompileCharsMap() method.
  Usually this field is set by Builder::GetNormalizerSpec() method.
  

  optional bytes precompiled_charsmap = 2;

  Returns:

  The precompiledCharsmap.

• setPrecompiledCharsmap

   SentencepieceModel.NormalizerSpec.Builder setPrecompiledCharsmap(ByteString value)

  Pre-compiled normalization rule created by
  Builder::GetPrecompiledCharsMap() or Builder::CompileCharsMap() method.
  Usually this field is set by Builder::GetNormalizerSpec() method.
  

  optional bytes precompiled_charsmap = 2;

  Parameters:

  value - The precompiledCharsmap to set.

  Returns:

  This builder for chaining.

• clearPrecompiledCharsmap

   SentencepieceModel.NormalizerSpec.Builder clearPrecompiledCharsmap()

  Pre-compiled normalization rule created by
  Builder::GetPrecompiledCharsMap() or Builder::CompileCharsMap() method.
  Usually this field is set by Builder::GetNormalizerSpec() method.
  

  optional bytes precompiled_charsmap = 2;

  Returns:

  This builder for chaining.

• hasAddDummyPrefix

   boolean hasAddDummyPrefix()

  Adds dummy whitespace at the beginning of text in order to
  treat "world" in "world" and "hello world" in the same way.
  

  optional bool add_dummy_prefix = 3 [default = true];

  Returns:

  Whether the addDummyPrefix field is set.

• getAddDummyPrefix

   boolean getAddDummyPrefix()

  Adds dummy whitespace at the beginning of text in order to
  treat "world" in "world" and "hello world" in the same way.
  

  optional bool add_dummy_prefix = 3 [default = true];

  Returns:

  The addDummyPrefix.

• setAddDummyPrefix

   SentencepieceModel.NormalizerSpec.Builder setAddDummyPrefix(boolean value)

  Adds dummy whitespace at the beginning of text in order to
  treat "world" in "world" and "hello world" in the same way.
  

  optional bool add_dummy_prefix = 3 [default = true];

  Parameters:

  value - The addDummyPrefix to set.

  Returns:

  This builder for chaining.

• clearAddDummyPrefix

   SentencepieceModel.NormalizerSpec.Builder clearAddDummyPrefix()

  Adds dummy whitespace at the beginning of text in order to
  treat "world" in "world" and "hello world" in the same way.
  

  optional bool add_dummy_prefix = 3 [default = true];

  Returns:

  This builder for chaining.

• hasRemoveExtraWhitespaces

   boolean hasRemoveExtraWhitespaces()

  Removes leading, trailing, and duplicate internal whitespace.
  

  optional bool remove_extra_whitespaces = 4 [default = true];

  Returns:

  Whether the removeExtraWhitespaces field is set.

• getRemoveExtraWhitespaces

   boolean getRemoveExtraWhitespaces()

  Removes leading, trailing, and duplicate internal whitespace.
  

  optional bool remove_extra_whitespaces = 4 [default = true];

  Returns:

  The removeExtraWhitespaces.

• setRemoveExtraWhitespaces

   SentencepieceModel.NormalizerSpec.Builder setRemoveExtraWhitespaces(boolean value)

  Removes leading, trailing, and duplicate internal whitespace.
  

  optional bool remove_extra_whitespaces = 4 [default = true];

  Parameters:

  value - The removeExtraWhitespaces to set.

  Returns:

  This builder for chaining.

• clearRemoveExtraWhitespaces

   SentencepieceModel.NormalizerSpec.Builder clearRemoveExtraWhitespaces()

  Removes leading, trailing, and duplicate internal whitespace.
  

  optional bool remove_extra_whitespaces = 4 [default = true];

  Returns:

  This builder for chaining.

• hasEscapeWhitespaces

   boolean hasEscapeWhitespaces()

  Replaces whitespace with meta symbol.
  This field must be true to train sentence piece model.
  

  optional bool escape_whitespaces = 5 [default = true];

  Returns:

  Whether the escapeWhitespaces field is set.

• getEscapeWhitespaces

   boolean getEscapeWhitespaces()

  Replaces whitespace with meta symbol.
  This field must be true to train sentence piece model.
  

  optional bool escape_whitespaces = 5 [default = true];

  Returns:

  The escapeWhitespaces.

• setEscapeWhitespaces

   SentencepieceModel.NormalizerSpec.Builder setEscapeWhitespaces(boolean value)

  Replaces whitespace with meta symbol.
  This field must be true to train sentence piece model.
  

  optional bool escape_whitespaces = 5 [default = true];

  Parameters:

  value - The escapeWhitespaces to set.

  Returns:

  This builder for chaining.

• clearEscapeWhitespaces

   SentencepieceModel.NormalizerSpec.Builder clearEscapeWhitespaces()

  Replaces whitespace with meta symbol.
  This field must be true to train sentence piece model.
  

  optional bool escape_whitespaces = 5 [default = true];

  Returns:

  This builder for chaining.

• hasNormalizationRuleTsv

   boolean hasNormalizationRuleTsv()

  Custom normalization rule file in TSV format.
  https://github.com/google/sentencepiece/blob/master/doc/normalization.md
  This field is only used in SentencePieceTrainer::Train() method, which
  compiles the rule into the binary rule stored in `precompiled_charsmap`.
  

  optional string normalization_rule_tsv = 6;

  Returns:

  Whether the normalizationRuleTsv field is set.

• getNormalizationRuleTsv

   String getNormalizationRuleTsv()

  Custom normalization rule file in TSV format.
  https://github.com/google/sentencepiece/blob/master/doc/normalization.md
  This field is only used in SentencePieceTrainer::Train() method, which
  compiles the rule into the binary rule stored in `precompiled_charsmap`.
  

  optional string normalization_rule_tsv = 6;

  Returns:

  The normalizationRuleTsv.

• getNormalizationRuleTsvBytes

   ByteString getNormalizationRuleTsvBytes()

  Custom normalization rule file in TSV format.
  https://github.com/google/sentencepiece/blob/master/doc/normalization.md
  This field is only used in SentencePieceTrainer::Train() method, which
  compiles the rule into the binary rule stored in `precompiled_charsmap`.
  

  optional string normalization_rule_tsv = 6;

  Returns:

  The bytes for normalizationRuleTsv.

• setNormalizationRuleTsv

   SentencepieceModel.NormalizerSpec.Builder setNormalizationRuleTsv(String value)

  Custom normalization rule file in TSV format.
  https://github.com/google/sentencepiece/blob/master/doc/normalization.md
  This field is only used in SentencePieceTrainer::Train() method, which
  compiles the rule into the binary rule stored in `precompiled_charsmap`.
  

  optional string normalization_rule_tsv = 6;

  Parameters:

  value - The normalizationRuleTsv to set.

  Returns:

  This builder for chaining.

• clearNormalizationRuleTsv

   SentencepieceModel.NormalizerSpec.Builder clearNormalizationRuleTsv()

  Custom normalization rule file in TSV format.
  https://github.com/google/sentencepiece/blob/master/doc/normalization.md
  This field is only used in SentencePieceTrainer::Train() method, which
  compiles the rule into the binary rule stored in `precompiled_charsmap`.
  

  optional string normalization_rule_tsv = 6;

  Returns:

  This builder for chaining.

• setNormalizationRuleTsvBytes

   SentencepieceModel.NormalizerSpec.Builder setNormalizationRuleTsvBytes(ByteString value)

  Custom normalization rule file in TSV format.
  https://github.com/google/sentencepiece/blob/master/doc/normalization.md
  This field is only used in SentencePieceTrainer::Train() method, which
  compiles the rule into the binary rule stored in `precompiled_charsmap`.
  

  optional string normalization_rule_tsv = 6;

  Parameters:

  value - The bytes for normalizationRuleTsv to set.

  Returns:

  This builder for chaining.

• setUnknownFields

   final SentencepieceModel.NormalizerSpec.Builder setUnknownFields(UnknownFieldSet unknownFields)

• mergeUnknownFields

   final SentencepieceModel.NormalizerSpec.Builder mergeUnknownFields(UnknownFieldSet unknownFields)