Class AgentPromptVariantInferenceConfigurationText


  • public final class AgentPromptVariantInferenceConfigurationText
    extends java.lang.Object
    • Method Detail

      • maxTokens

        public java.util.Optional<java.lang.Integer> maxTokens()
        Returns:
        Maximum number of tokens to return in the response.
      • stopSequences

        public java.util.List<java.lang.String> stopSequences()
        Returns:
        List of strings that define sequences after which the model will stop generating.
      • temperature

        public java.util.Optional<java.lang.Double> temperature()
        Returns:
        Controls the randomness of the response. Choose a lower value for more predictable outputs and a higher value for more surprising outputs.
      • topP

        public java.util.Optional<java.lang.Double> topP()
        Returns:
        Percentage of most-likely candidates that the model considers for the next token.