Package com.pulumi.aws.sagemaker.inputs
Class EndpointConfigurationShadowProductionVariantArgs
- java.lang.Object
-
- com.pulumi.resources.InputArgs
-
- com.pulumi.resources.ResourceArgs
-
- com.pulumi.aws.sagemaker.inputs.EndpointConfigurationShadowProductionVariantArgs
-
public final class EndpointConfigurationShadowProductionVariantArgs extends com.pulumi.resources.ResourceArgs
-
-
Nested Class Summary
Nested Classes Modifier and Type Class Description static classEndpointConfigurationShadowProductionVariantArgs.Builder
-
Field Summary
Fields Modifier and Type Field Description static EndpointConfigurationShadowProductionVariantArgsEmpty
-
Method Summary
All Methods Static Methods Instance Methods Concrete Methods Modifier and Type Method Description java.util.Optional<com.pulumi.core.Output<java.lang.String>>acceleratorType()static EndpointConfigurationShadowProductionVariantArgs.Builderbuilder()static EndpointConfigurationShadowProductionVariantArgs.Builderbuilder(EndpointConfigurationShadowProductionVariantArgs defaults)java.util.Optional<com.pulumi.core.Output<EndpointConfigurationShadowProductionVariantCapacityReservationConfigArgs>>capacityReservationConfig()java.util.Optional<com.pulumi.core.Output<java.lang.Integer>>containerStartupHealthCheckTimeoutInSeconds()java.util.Optional<com.pulumi.core.Output<EndpointConfigurationShadowProductionVariantCoreDumpConfigArgs>>coreDumpConfig()java.util.Optional<com.pulumi.core.Output<java.lang.Boolean>>enableSsmAccess()java.util.Optional<com.pulumi.core.Output<java.lang.String>>inferenceAmiVersion()java.util.Optional<com.pulumi.core.Output<java.lang.Integer>>initialInstanceCount()java.util.Optional<com.pulumi.core.Output<java.lang.Double>>initialVariantWeight()java.util.Optional<com.pulumi.core.Output<java.lang.String>>instanceType()java.util.Optional<com.pulumi.core.Output<EndpointConfigurationShadowProductionVariantManagedInstanceScalingArgs>>managedInstanceScaling()java.util.Optional<com.pulumi.core.Output<java.lang.Integer>>modelDataDownloadTimeoutInSeconds()java.util.Optional<com.pulumi.core.Output<java.lang.String>>modelName()java.util.Optional<com.pulumi.core.Output<java.util.List<EndpointConfigurationShadowProductionVariantRoutingConfigArgs>>>routingConfigs()java.util.Optional<com.pulumi.core.Output<EndpointConfigurationShadowProductionVariantServerlessConfigArgs>>serverlessConfig()java.util.Optional<com.pulumi.core.Output<java.lang.String>>variantName()java.util.Optional<com.pulumi.core.Output<java.lang.Integer>>volumeSizeInGb()
-
-
-
Field Detail
-
Empty
public static final EndpointConfigurationShadowProductionVariantArgs Empty
-
-
Method Detail
-
acceleratorType
public java.util.Optional<com.pulumi.core.Output<java.lang.String>> acceleratorType()
- Returns:
- Size of the Elastic Inference (EI) instance to use for the production variant.
-
capacityReservationConfig
public java.util.Optional<com.pulumi.core.Output<EndpointConfigurationShadowProductionVariantCapacityReservationConfigArgs>> capacityReservationConfig()
- Returns:
- Settings for the capacity reservation for the compute instances that SageMaker AI reserves for an endpoint. See capacityReservationConfig below.
-
containerStartupHealthCheckTimeoutInSeconds
public java.util.Optional<com.pulumi.core.Output<java.lang.Integer>> containerStartupHealthCheckTimeoutInSeconds()
- Returns:
- Timeout value, in seconds, for your inference container to pass health check by SageMaker AI Hosting. For more information about health check, see [How Your Container Should Respond to Health Check (Ping) Requests](https://docs.aws.amazon.com/sagemaker/latest/dg/your-algorithms-inference-code.html#your-algorithms-inference-algo-ping-requests). Valid values between `60` and `3600`.
-
coreDumpConfig
public java.util.Optional<com.pulumi.core.Output<EndpointConfigurationShadowProductionVariantCoreDumpConfigArgs>> coreDumpConfig()
- Returns:
- Core dump configuration from the model container when the process crashes. Fields are documented below.
-
enableSsmAccess
public java.util.Optional<com.pulumi.core.Output<java.lang.Boolean>> enableSsmAccess()
- Returns:
- Whether to turn on native AWS SSM access for a production variant behind an endpoint. By default, SSM access is disabled for all production variants behind endpoints. Ignored if `modelName` is not set (Inference Components endpoint).
-
inferenceAmiVersion
public java.util.Optional<com.pulumi.core.Output<java.lang.String>> inferenceAmiVersion()
- Returns:
- Option from a collection of preconfigured AMI images. Each image is configured by AWS with a set of software and driver versions. AWS optimizes these configurations for different machine learning workloads.
-
initialInstanceCount
public java.util.Optional<com.pulumi.core.Output<java.lang.Integer>> initialInstanceCount()
- Returns:
- Initial number of instances used for auto-scaling.
-
initialVariantWeight
public java.util.Optional<com.pulumi.core.Output<java.lang.Double>> initialVariantWeight()
- Returns:
- Initial traffic distribution among all of the models that you specify in the endpoint configuration. If unspecified, defaults to `1.0`. Ignored if `modelName` is not set (Inference Components endpoint).
-
instanceType
public java.util.Optional<com.pulumi.core.Output<java.lang.String>> instanceType()
- Returns:
- Type of instance to start.
-
managedInstanceScaling
public java.util.Optional<com.pulumi.core.Output<EndpointConfigurationShadowProductionVariantManagedInstanceScalingArgs>> managedInstanceScaling()
- Returns:
- Control the range in the number of instances that the endpoint provisions as it scales up or down to accommodate traffic.
-
modelDataDownloadTimeoutInSeconds
public java.util.Optional<com.pulumi.core.Output<java.lang.Integer>> modelDataDownloadTimeoutInSeconds()
- Returns:
- Timeout value, in seconds, to download and extract the model that you want to host from S3 to the individual inference instance associated with this production variant. Valid values between `60` and `3600`.
-
modelName
public java.util.Optional<com.pulumi.core.Output<java.lang.String>> modelName()
- Returns:
- Name of the model to use. Required unless using Inference Components (in which case `executionRoleArn` must be specified at the endpoint configuration level).
-
routingConfigs
public java.util.Optional<com.pulumi.core.Output<java.util.List<EndpointConfigurationShadowProductionVariantRoutingConfigArgs>>> routingConfigs()
- Returns:
- How the endpoint routes incoming traffic. See routingConfig below.
-
serverlessConfig
public java.util.Optional<com.pulumi.core.Output<EndpointConfigurationShadowProductionVariantServerlessConfigArgs>> serverlessConfig()
- Returns:
- How an endpoint performs asynchronous inference.
-
variantName
public java.util.Optional<com.pulumi.core.Output<java.lang.String>> variantName()
- Returns:
- Name of the variant. If omitted, the provider will assign a random, unique name.
-
volumeSizeInGb
public java.util.Optional<com.pulumi.core.Output<java.lang.Integer>> volumeSizeInGb()
- Returns:
- Size, in GB, of the ML storage volume attached to individual inference instance associated with the production variant. Valid values between `1` and `512`.
-
builder
public static EndpointConfigurationShadowProductionVariantArgs.Builder builder()
-
builder
public static EndpointConfigurationShadowProductionVariantArgs.Builder builder(EndpointConfigurationShadowProductionVariantArgs defaults)
-
-