Class AgentAgentPromptOverrideConfigurationPromptConfigurationInferenceConfiguration


  • public final class AgentAgentPromptOverrideConfigurationPromptConfigurationInferenceConfiguration
    extends java.lang.Object
    • Method Detail

      • maxLength

        public java.lang.Integer maxLength()
        Returns:
        Maximum number of tokens to allow in the generated response.
      • stopSequences

        public java.util.List<java.lang.String> stopSequences()
        Returns:
        List of stop sequences. A stop sequence is a sequence of characters that causes the model to stop generating the response.
      • temperature

        public java.lang.Double temperature()
        Returns:
        Likelihood of the model selecting higher-probability options while generating a response. A lower value makes the model more likely to choose higher-probability options, while a higher value makes the model more likely to choose lower-probability options.
      • topK

        public java.lang.Integer topK()
        Returns:
        Number of top most-likely candidates, between 0 and 500, from which the model chooses the next token in the sequence.
      • topP

        public java.lang.Double topP()
        Returns:
        Top percentage of the probability distribution of next tokens, between 0 and 1 (denoting 0% and 100%), from which the model chooses the next token in the sequence.