Package com.pulumi.aws.emr
Class Cluster
- java.lang.Object
-
- com.pulumi.resources.Resource
-
- com.pulumi.resources.CustomResource
-
- com.pulumi.aws.emr.Cluster
-
public class Cluster extends com.pulumi.resources.CustomResourceProvides an Elastic MapReduce Cluster, a web service that makes it easy to process large amounts of data efficiently. See [Amazon Elastic MapReduce Documentation](https://aws.amazon.com/documentation/elastic-mapreduce/) for more information. To configure [Instance Groups](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-instance-group-configuration.html#emr-plan-instance-groups) for [task nodes](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-master-core-task-nodes.html#emr-plan-task), see the `aws.emr.InstanceGroup` resource. ## Example Usage
The `aws.emr.Cluster` resource typically requires two IAM roles, one for the EMR Cluster to use as a service role, and another is assigned to every EC2 instance in a cluster and each application process that runs on a cluster assumes this role for permissions to interact with other AWS services. An additional role, the Auto Scaling role, is required if your cluster uses automatic scaling in Amazon EMR. The default AWS managed EMR service role is called `EMR_DefaultRole` with Amazon managed policy `AmazonEMRServicePolicy_v2` attached. The name of default instance profile role is `EMR_EC2_DefaultRole` with default managed policy `AmazonElasticMapReduceforEC2Role` attached, but it is on the path to deprecation and will not be replaced with another default managed policy. You'll need to create and specify an instance profile to replace the deprecated role and default policy. See the [Configure IAM service roles for Amazon EMR](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-iam-roles.html) guide for more information on these IAM roles. There is also a fully-bootable example Pulumi configuration at the bottom of this page. ### Instance Fleetpackage generated_program; import com.pulumi.Context; import com.pulumi.Pulumi; import com.pulumi.core.Output; import com.pulumi.aws.emr.Cluster; import com.pulumi.aws.emr.ClusterArgs; import com.pulumi.aws.emr.inputs.ClusterEc2AttributesArgs; import com.pulumi.aws.emr.inputs.ClusterMasterInstanceGroupArgs; import com.pulumi.aws.emr.inputs.ClusterCoreInstanceGroupArgs; import com.pulumi.aws.emr.inputs.ClusterCoreInstanceGroupEbsConfigArgs; import com.pulumi.aws.emr.inputs.ClusterBootstrapActionArgs; import java.util.ArrayList; import java.util.Arrays; import java.util.Map; import java.io.File; import java.nio.file.Files; import java.nio.file.Paths; public class App { public static void main(String[] args) { Pulumi.run(App::stack); } public static void stack(Context ctx) { var cluster = new Cluster("cluster", ClusterArgs.builder() .ec2Attributes(ClusterEc2AttributesArgs.builder() .subnetId(main.id()) .emrManagedMasterSecurityGroup(sg.id()) .emrManagedSlaveSecurityGroup(sg.id()) .instanceProfile(emrProfile.arn()) .build()) .masterInstanceGroup(ClusterMasterInstanceGroupArgs.builder() .instanceType("m4.large") .build()) .coreInstanceGroup(ClusterCoreInstanceGroupArgs.builder() .ebsConfigs(ClusterCoreInstanceGroupEbsConfigArgs.builder() .size(40) .type("gp2") .volumesPerInstance(1) .build()) .instanceType("c4.large") .instanceCount(1) .bidPrice("0.30") .autoscalingPolicy(""" { \"Constraints\": { \"MinCapacity\": 1, \"MaxCapacity\": 2 }, \"Rules\": [ { \"Name\": \"ScaleOutMemoryPercentage\", \"Description\": \"Scale out if YARNMemoryAvailablePercentage is less than 15\", \"Action\": { \"SimpleScalingPolicyConfiguration\": { \"AdjustmentType\": \"CHANGE_IN_CAPACITY\", \"ScalingAdjustment\": 1, \"CoolDown\": 300 } }, \"Trigger\": { \"CloudWatchAlarmDefinition\": { \"ComparisonOperator\": \"LESS_THAN\", \"EvaluationPeriods\": 1, \"MetricName\": \"YARNMemoryAvailablePercentage\", \"Namespace\": \"AWS/ElasticMapReduce\", \"Period\": 300, \"Statistic\": \"AVERAGE\", \"Threshold\": 15.0, \"Unit\": \"PERCENT\" } } } ] } """) .build()) .bootstrapActions(ClusterBootstrapActionArgs.builder() .path("s3://elasticmapreduce/bootstrap-actions/run-if") .name("runif") .args( "instance.isMaster=true", "echo running on master node") .build()) .name("emr-test-arn") .releaseLabel("emr-4.6.0") .applications("Spark") .additionalInfo(""" { \"instanceAwsClientConfiguration\": { \"proxyPort\": 8099, \"proxyHost\": \"myproxy.example.com\" } } """) .terminationProtection(false) .keepJobFlowAliveWhenNoSteps(true) .ebsRootVolumeSize(100) .tags(Map.ofEntries( Map.entry("role", "rolename"), Map.entry("env", "env") )) .configurationsJson(""" [ { \"Classification\": \"hadoop-env\", \"Configurations\": [ { \"Classification\": \"export\", \"Properties\": { \"JAVA_HOME\": \"/usr/lib/jvm/java-1.8.0\" } } ], \"Properties\": {} }, { \"Classification\": \"spark-env\", \"Configurations\": [ { \"Classification\": \"export\", \"Properties\": { \"JAVA_HOME\": \"/usr/lib/jvm/java-1.8.0\" } } ], \"Properties\": {} } ] """) .serviceRole(iamEmrServiceRole.arn()) .build()); } }
### Enable Debug Logging [Debug logging in EMR](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-plan-debugging.html) is implemented as a step. It is highly recommended that you utilize the resource options configuration with `ignoreChanges` if other steps are being managed outside of this provider.package generated_program; import com.pulumi.Context; import com.pulumi.Pulumi; import com.pulumi.core.Output; import com.pulumi.aws.emr.Cluster; import com.pulumi.aws.emr.ClusterArgs; import com.pulumi.aws.emr.inputs.ClusterMasterInstanceFleetArgs; import com.pulumi.aws.emr.inputs.ClusterMasterInstanceFleetInstanceTypeConfigArgs; import com.pulumi.aws.emr.inputs.ClusterCoreInstanceFleetArgs; import com.pulumi.aws.emr.inputs.ClusterCoreInstanceFleetLaunchSpecificationsArgs; import com.pulumi.aws.emr.inputs.ClusterCoreInstanceFleetLaunchSpecificationsSpotSpecificationArgs; import com.pulumi.aws.emr.inputs.ClusterCoreInstanceFleetInstanceTypeConfigArgs; import com.pulumi.aws.emr.inputs.ClusterCoreInstanceFleetInstanceTypeConfigEbsConfigArgs; import com.pulumi.aws.emr.InstanceFleet; import com.pulumi.aws.emr.InstanceFleetArgs; import com.pulumi.aws.emr.inputs.InstanceFleetLaunchSpecificationsArgs; import com.pulumi.aws.emr.inputs.InstanceFleetLaunchSpecificationsSpotSpecificationArgs; import com.pulumi.aws.emr.inputs.InstanceFleetInstanceTypeConfigArgs; import com.pulumi.aws.emr.inputs.InstanceFleetInstanceTypeConfigEbsConfigArgs; import java.util.ArrayList; import java.util.Arrays; import java.util.Map; import java.io.File; import java.nio.file.Files; import java.nio.file.Paths; public class App { public static void main(String[] args) { Pulumi.run(App::stack); } public static void stack(Context ctx) { var example = new Cluster("example", ClusterArgs.builder() .masterInstanceFleet(ClusterMasterInstanceFleetArgs.builder() .instanceTypeConfigs(ClusterMasterInstanceFleetInstanceTypeConfigArgs.builder() .instanceType("m4.xlarge") .build()) .targetOnDemandCapacity(1) .build()) .coreInstanceFleet(ClusterCoreInstanceFleetArgs.builder() .launchSpecifications(ClusterCoreInstanceFleetLaunchSpecificationsArgs.builder() .spotSpecifications(ClusterCoreInstanceFleetLaunchSpecificationsSpotSpecificationArgs.builder() .allocationStrategy("capacity-optimized") .blockDurationMinutes(0) .timeoutAction("SWITCH_TO_ON_DEMAND") .timeoutDurationMinutes(10) .build()) .build()) .instanceTypeConfigs( ClusterCoreInstanceFleetInstanceTypeConfigArgs.builder() .ebsConfigs(ClusterCoreInstanceFleetInstanceTypeConfigEbsConfigArgs.builder() .size(100) .type("gp2") .volumesPerInstance(1) .build()) .bidPriceAsPercentageOfOnDemandPrice(80.0) .instanceType("m3.xlarge") .weightedCapacity(1) .build(), ClusterCoreInstanceFleetInstanceTypeConfigArgs.builder() .ebsConfigs(ClusterCoreInstanceFleetInstanceTypeConfigEbsConfigArgs.builder() .size(100) .type("gp2") .volumesPerInstance(1) .build()) .bidPriceAsPercentageOfOnDemandPrice(100.0) .instanceType("m4.xlarge") .weightedCapacity(1) .build(), ClusterCoreInstanceFleetInstanceTypeConfigArgs.builder() .ebsConfigs(ClusterCoreInstanceFleetInstanceTypeConfigEbsConfigArgs.builder() .size(100) .type("gp2") .volumesPerInstance(1) .build()) .bidPriceAsPercentageOfOnDemandPrice(100.0) .instanceType("m4.2xlarge") .weightedCapacity(2) .build()) .name("core fleet") .targetOnDemandCapacity(2) .targetSpotCapacity(2) .build()) .build()); var task = new InstanceFleet("task", InstanceFleetArgs.builder() .launchSpecifications(InstanceFleetLaunchSpecificationsArgs.builder() .spotSpecifications(InstanceFleetLaunchSpecificationsSpotSpecificationArgs.builder() .allocationStrategy("capacity-optimized") .blockDurationMinutes(0) .timeoutAction("TERMINATE_CLUSTER") .timeoutDurationMinutes(10) .build()) .build()) .instanceTypeConfigs( InstanceFleetInstanceTypeConfigArgs.builder() .ebsConfigs(InstanceFleetInstanceTypeConfigEbsConfigArgs.builder() .size(100) .type("gp2") .volumesPerInstance(1) .build()) .bidPriceAsPercentageOfOnDemandPrice(100.0) .instanceType("m4.xlarge") .weightedCapacity(1) .build(), InstanceFleetInstanceTypeConfigArgs.builder() .ebsConfigs(InstanceFleetInstanceTypeConfigEbsConfigArgs.builder() .size(100) .type("gp2") .volumesPerInstance(1) .build()) .bidPriceAsPercentageOfOnDemandPrice(100.0) .instanceType("m4.2xlarge") .weightedCapacity(2) .build()) .clusterId(example.id()) .name("task fleet") .targetOnDemandCapacity(1) .targetSpotCapacity(1) .build()); } }
### Multiple Node Master Instance Group Available in EMR version 5.23.0 and later, an EMR Cluster can be launched with three master nodes for high availability. Additional information about this functionality and its requirements can be found in the [EMR Management Guide](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-plan-ha.html).package generated_program; import com.pulumi.Context; import com.pulumi.Pulumi; import com.pulumi.core.Output; import com.pulumi.aws.emr.Cluster; import com.pulumi.aws.emr.ClusterArgs; import com.pulumi.aws.emr.inputs.ClusterStepArgs; import com.pulumi.aws.emr.inputs.ClusterStepHadoopJarStepArgs; import com.pulumi.resources.CustomResourceOptions; import java.util.ArrayList; import java.util.Arrays; import java.util.Map; import java.io.File; import java.nio.file.Files; import java.nio.file.Paths; public class App { public static void main(String[] args) { Pulumi.run(App::stack); } public static void stack(Context ctx) { var example = new Cluster("example", ClusterArgs.builder() .steps(ClusterStepArgs.builder() .hadoopJarStep(ClusterStepHadoopJarStepArgs.builder() .jar("command-runner.jar") .args("state-pusher-script") .build()) .actionOnFailure("TERMINATE_CLUSTER") .name("Setup Hadoop Debugging") .build()) .build(), CustomResourceOptions.builder() .ignoreChanges("steps") .build()); } }
## Import Using `pulumi import`, import EMR clusters using the `id`. For example: ```sh $ pulumi import aws:emr/cluster:Cluster cluster j-123456ABCDEF ``` Since the API does not return the actual values for Kerberos configurations, environments with those options set will need to use the `lifecycle` configuration block `ignoreChanges` argument available to all Pulumi resources to prevent perpetual differences. For example:package generated_program; import com.pulumi.Context; import com.pulumi.Pulumi; import com.pulumi.core.Output; import com.pulumi.aws.ec2.Subnet; import com.pulumi.aws.ec2.SubnetArgs; import com.pulumi.aws.emr.Cluster; import com.pulumi.aws.emr.ClusterArgs; import com.pulumi.aws.emr.inputs.ClusterEc2AttributesArgs; import com.pulumi.aws.emr.inputs.ClusterMasterInstanceGroupArgs; import com.pulumi.aws.emr.inputs.ClusterCoreInstanceGroupArgs; import java.util.ArrayList; import java.util.Arrays; import java.util.Map; import java.io.File; import java.nio.file.Files; import java.nio.file.Paths; public class App { public static void main(String[] args) { Pulumi.run(App::stack); } public static void stack(Context ctx) { // This configuration is for illustrative purposes and highlights // only relevant configurations for working with this functionality. // Map public IP on launch must be enabled for public (Internet accessible) subnets var example = new Subnet("example", SubnetArgs.builder() .mapPublicIpOnLaunch(true) .build()); var exampleCluster = new Cluster("exampleCluster", ClusterArgs.builder() .ec2Attributes(ClusterEc2AttributesArgs.builder() .subnetId(example.id()) .build()) .masterInstanceGroup(ClusterMasterInstanceGroupArgs.builder() .instanceCount(3) .build()) .coreInstanceGroup(ClusterCoreInstanceGroupArgs.builder() .build()) .releaseLabel("emr-5.24.1") .terminationProtection(true) .build()); } }package generated_program; import com.pulumi.Context; import com.pulumi.Pulumi; import com.pulumi.core.Output; import com.pulumi.aws.emr.Cluster; import com.pulumi.aws.emr.ClusterArgs; import com.pulumi.resources.CustomResourceOptions; import java.util.ArrayList; import java.util.Arrays; import java.util.Map; import java.io.File; import java.nio.file.Files; import java.nio.file.Paths; public class App { public static void main(String[] args) { Pulumi.run(App::stack); } public static void stack(Context ctx) { var example = new Cluster("example", ClusterArgs.Empty, CustomResourceOptions.builder() .ignoreChanges("kerberosAttributes") .build()); } }
-
-
Constructor Summary
Constructors Constructor Description Cluster(java.lang.String name)Cluster(java.lang.String name, ClusterArgs args)Cluster(java.lang.String name, ClusterArgs args, com.pulumi.resources.CustomResourceOptions options)
-
Method Summary
All Methods Static Methods Instance Methods Concrete Methods Modifier and Type Method Description com.pulumi.core.Output<java.util.Optional<java.lang.String>>additionalInfo()com.pulumi.core.Output<java.util.Optional<java.util.List<java.lang.String>>>applications()com.pulumi.core.Output<java.lang.String>arn()com.pulumi.core.Output<java.util.Optional<java.lang.String>>autoscalingRole()com.pulumi.core.Output<java.util.Optional<ClusterAutoTerminationPolicy>>autoTerminationPolicy()com.pulumi.core.Output<java.util.Optional<java.util.List<ClusterBootstrapAction>>>bootstrapActions()com.pulumi.core.Output<java.lang.String>clusterState()com.pulumi.core.Output<java.util.Optional<java.lang.String>>configurations()com.pulumi.core.Output<java.util.Optional<java.lang.String>>configurationsJson()com.pulumi.core.Output<ClusterCoreInstanceFleet>coreInstanceFleet()com.pulumi.core.Output<ClusterCoreInstanceGroup>coreInstanceGroup()com.pulumi.core.Output<java.util.Optional<java.lang.String>>customAmiId()com.pulumi.core.Output<java.util.Optional<java.lang.Integer>>ebsRootVolumeSize()com.pulumi.core.Output<java.util.Optional<ClusterEc2Attributes>>ec2Attributes()static Clusterget(java.lang.String name, com.pulumi.core.Output<java.lang.String> id, ClusterState state, com.pulumi.resources.CustomResourceOptions options)Get an existing Host resource's state with the given name, ID, and optional extra properties used to qualify the lookup.com.pulumi.core.Output<java.lang.Boolean>keepJobFlowAliveWhenNoSteps()com.pulumi.core.Output<java.util.Optional<ClusterKerberosAttributes>>kerberosAttributes()com.pulumi.core.Output<java.util.Optional<java.util.List<java.lang.String>>>listStepsStates()com.pulumi.core.Output<java.util.Optional<java.lang.String>>logEncryptionKmsKeyId()com.pulumi.core.Output<java.util.Optional<java.lang.String>>logUri()com.pulumi.core.Output<ClusterMasterInstanceFleet>masterInstanceFleet()com.pulumi.core.Output<ClusterMasterInstanceGroup>masterInstanceGroup()com.pulumi.core.Output<java.lang.String>masterPublicDns()com.pulumi.core.Output<java.lang.String>name()com.pulumi.core.Output<java.util.Optional<java.lang.String>>osReleaseLabel()com.pulumi.core.Output<java.util.Optional<java.util.List<ClusterPlacementGroupConfig>>>placementGroupConfigs()com.pulumi.core.Output<java.lang.String>region()com.pulumi.core.Output<java.lang.String>releaseLabel()com.pulumi.core.Output<java.lang.String>scaleDownBehavior()com.pulumi.core.Output<java.util.Optional<java.lang.String>>securityConfiguration()com.pulumi.core.Output<java.lang.String>serviceRole()com.pulumi.core.Output<java.util.Optional<java.lang.Integer>>stepConcurrencyLevel()com.pulumi.core.Output<java.util.List<ClusterStep>>steps()com.pulumi.core.Output<java.util.Optional<java.util.Map<java.lang.String,java.lang.String>>>tags()com.pulumi.core.Output<java.util.Map<java.lang.String,java.lang.String>>tagsAll()com.pulumi.core.Output<java.lang.Boolean>terminationProtection()com.pulumi.core.Output<java.util.Optional<java.lang.Boolean>>unhealthyNodeReplacement()com.pulumi.core.Output<java.util.Optional<java.lang.Boolean>>visibleToAllUsers()
-
-
-
Constructor Detail
-
Cluster
public Cluster(java.lang.String name)
- Parameters:
name- The _unique_ name of the resulting resource.
-
Cluster
public Cluster(java.lang.String name, ClusterArgs args)- Parameters:
name- The _unique_ name of the resulting resource.args- The arguments to use to populate this resource's properties.
-
Cluster
public Cluster(java.lang.String name, ClusterArgs args, @Nullable com.pulumi.resources.CustomResourceOptions options)- Parameters:
name- The _unique_ name of the resulting resource.args- The arguments to use to populate this resource's properties.options- A bag of options that control this resource's behavior.
-
-
Method Detail
-
additionalInfo
public com.pulumi.core.Output<java.util.Optional<java.lang.String>> additionalInfo()
- Returns:
- JSON string for selecting additional features such as adding proxy information. Note: Currently there is no API to retrieve the value of this argument after EMR cluster creation from provider, therefore the provider cannot detect drift from the actual EMR cluster if its value is changed outside the provider.
-
applications
public com.pulumi.core.Output<java.util.Optional<java.util.List<java.lang.String>>> applications()
- Returns:
- A case-insensitive list of applications for Amazon EMR to install and configure when launching the cluster. For a list of applications available for each Amazon EMR release version, see the [Amazon EMR Release Guide](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-release-components.html).
-
arn
public com.pulumi.core.Output<java.lang.String> arn()
- Returns:
- ARN of the cluster.
-
autoTerminationPolicy
public com.pulumi.core.Output<java.util.Optional<ClusterAutoTerminationPolicy>> autoTerminationPolicy()
- Returns:
- An auto-termination policy for an Amazon EMR cluster. An auto-termination policy defines the amount of idle time in seconds after which a cluster automatically terminates. See Auto Termination Policy Below.
-
autoscalingRole
public com.pulumi.core.Output<java.util.Optional<java.lang.String>> autoscalingRole()
- Returns:
- IAM role for automatic scaling policies. The IAM role provides permissions that the automatic scaling feature requires to launch and terminate EC2 instances in an instance group.
-
bootstrapActions
public com.pulumi.core.Output<java.util.Optional<java.util.List<ClusterBootstrapAction>>> bootstrapActions()
- Returns:
- Ordered list of bootstrap actions that will be run before Hadoop is started on the cluster nodes. See below.
-
clusterState
public com.pulumi.core.Output<java.lang.String> clusterState()
-
configurations
public com.pulumi.core.Output<java.util.Optional<java.lang.String>> configurations()
- Returns:
- List of configurations supplied for the EMR cluster you are creating, expressed as a string: an HTTP(S) URL to a JSON file, a path to a local `.json` file, or a raw JSON string. To supply configuration objects using Pulumi syntax instead, use `configurationsJson`. See [AWS Documentation](https://docs.aws.amazon.com/emr/latest/ReleaseGuide/emr-configure-apps.html) for more information.
-
configurationsJson
public com.pulumi.core.Output<java.util.Optional<java.lang.String>> configurationsJson()
- Returns:
- JSON string for supplying list of configurations for the EMR cluster.
> **NOTE on `configurationsJson`:** If the `Configurations` value is empty then you should skip the `Configurations` field instead of providing an empty list as a value, `"Configurations": []`.
package generated_program; import com.pulumi.Context; import com.pulumi.Pulumi; import com.pulumi.core.Output; import com.pulumi.aws.emr.Cluster; import com.pulumi.aws.emr.ClusterArgs; import java.util.ArrayList; import java.util.Arrays; import java.util.Map; import java.io.File; import java.nio.file.Files; import java.nio.file.Paths; public class App { public static void main(String[] args) { Pulumi.run(App::stack); } public static void stack(Context ctx) { var cluster = new Cluster("cluster", ClusterArgs.builder() .configurationsJson(""" [ { \"Classification\": \"hadoop-env\", \"Configurations\": [ { \"Classification\": \"export\", \"Properties\": { \"JAVA_HOME\": \"/usr/lib/jvm/java-1.8.0\" } } ], \"Properties\": {} } ] """) .build()); } }
-
coreInstanceFleet
public com.pulumi.core.Output<ClusterCoreInstanceFleet> coreInstanceFleet()
- Returns:
- Configuration block to use an [Instance Fleet](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-instance-fleet.html) for the core node type. Cannot be specified if any `coreInstanceGroup` configuration blocks are set. Detailed below.
-
coreInstanceGroup
public com.pulumi.core.Output<ClusterCoreInstanceGroup> coreInstanceGroup()
- Returns:
- Configuration block to use an [Instance Group](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-instance-group-configuration.html#emr-plan-instance-groups) for the [core node type](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-master-core-task-nodes.html#emr-plan-core).
-
customAmiId
public com.pulumi.core.Output<java.util.Optional<java.lang.String>> customAmiId()
- Returns:
- Custom Amazon Linux AMI for the cluster (instead of an EMR-owned AMI). Available in Amazon EMR version 5.7.0 and later.
-
ebsRootVolumeSize
public com.pulumi.core.Output<java.util.Optional<java.lang.Integer>> ebsRootVolumeSize()
- Returns:
- Size in GiB of the EBS root device volume of the Linux AMI that is used for each EC2 instance. Available in Amazon EMR version 4.x and later.
-
ec2Attributes
public com.pulumi.core.Output<java.util.Optional<ClusterEc2Attributes>> ec2Attributes()
- Returns:
- Attributes for the EC2 instances running the job flow. See below.
-
keepJobFlowAliveWhenNoSteps
public com.pulumi.core.Output<java.lang.Boolean> keepJobFlowAliveWhenNoSteps()
- Returns:
- Switch on/off run cluster with no steps or when all steps are complete (default is on)
-
kerberosAttributes
public com.pulumi.core.Output<java.util.Optional<ClusterKerberosAttributes>> kerberosAttributes()
- Returns:
- Kerberos configuration for the cluster. See below.
-
listStepsStates
public com.pulumi.core.Output<java.util.Optional<java.util.List<java.lang.String>>> listStepsStates()
- Returns:
- List of [step states](https://docs.aws.amazon.com/emr/latest/APIReference/API_StepStatus.html) used to filter returned steps
-
logEncryptionKmsKeyId
public com.pulumi.core.Output<java.util.Optional<java.lang.String>> logEncryptionKmsKeyId()
- Returns:
- AWS KMS customer master key (CMK) key ID or ARN used for encrypting log files. This attribute is only available with EMR version 5.30.0 and later, excluding EMR 6.0.0.
-
logUri
public com.pulumi.core.Output<java.util.Optional<java.lang.String>> logUri()
- Returns:
- S3 bucket to write the log files of the job flow. If a value is not provided, logs are not created.
-
masterInstanceFleet
public com.pulumi.core.Output<ClusterMasterInstanceFleet> masterInstanceFleet()
- Returns:
- Configuration block to use an [Instance Fleet](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-instance-fleet.html) for the master node type. Cannot be specified if any `masterInstanceGroup` configuration blocks are set. Detailed below.
-
masterInstanceGroup
public com.pulumi.core.Output<ClusterMasterInstanceGroup> masterInstanceGroup()
- Returns:
- Configuration block to use an [Instance Group](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-instance-group-configuration.html#emr-plan-instance-groups) for the [master node type](https://docs.aws.amazon.com/emr/latest/ManagementGuide/emr-master-core-task-nodes.html#emr-plan-master).
-
masterPublicDns
public com.pulumi.core.Output<java.lang.String> masterPublicDns()
- Returns:
- The DNS name of the master node. If the cluster is on a private subnet, this is the private DNS name. On a public subnet, this is the public DNS name.
-
name
public com.pulumi.core.Output<java.lang.String> name()
- Returns:
- Name of the job flow.
-
osReleaseLabel
public com.pulumi.core.Output<java.util.Optional<java.lang.String>> osReleaseLabel()
- Returns:
- Amazon Linux release for all nodes in a cluster launch RunJobFlow request. If not specified, Amazon EMR uses the latest validated Amazon Linux release for cluster launch.
-
placementGroupConfigs
public com.pulumi.core.Output<java.util.Optional<java.util.List<ClusterPlacementGroupConfig>>> placementGroupConfigs()
- Returns:
- The specified placement group configuration for an Amazon EMR cluster.
-
region
public com.pulumi.core.Output<java.lang.String> region()
- Returns:
- Region where this resource will be [managed](https://docs.aws.amazon.com/general/latest/gr/rande.html#regional-endpoints). Defaults to the Region set in the provider configuration.
-
releaseLabel
public com.pulumi.core.Output<java.lang.String> releaseLabel()
- Returns:
- Release label for the Amazon EMR release.
-
scaleDownBehavior
public com.pulumi.core.Output<java.lang.String> scaleDownBehavior()
- Returns:
- Way that individual Amazon EC2 instances terminate when an automatic scale-in activity occurs or an `instance group` is resized.
-
securityConfiguration
public com.pulumi.core.Output<java.util.Optional<java.lang.String>> securityConfiguration()
- Returns:
- Security configuration name to attach to the EMR cluster. Only valid for EMR clusters with `releaseLabel` 4.8.0 or greater.
-
serviceRole
public com.pulumi.core.Output<java.lang.String> serviceRole()
- Returns:
- IAM role that will be assumed by the Amazon EMR service to access AWS resources. The following arguments are optional:
-
stepConcurrencyLevel
public com.pulumi.core.Output<java.util.Optional<java.lang.Integer>> stepConcurrencyLevel()
- Returns:
- Number of steps that can be executed concurrently. You can specify a maximum of 256 steps. Only valid for EMR clusters with `releaseLabel` 5.28.0 or greater (default is 1).
-
steps
public com.pulumi.core.Output<java.util.List<ClusterStep>> steps()
- Returns:
- List of steps to run when creating the cluster. See below. It is highly recommended to utilize the lifecycle resource options block with `ignoreChanges` if other steps are being managed outside of this provider.
-
tags
public com.pulumi.core.Output<java.util.Optional<java.util.Map<java.lang.String,java.lang.String>>> tags()
- Returns:
- list of tags to apply to the EMR Cluster. If configured with a provider `defaultTags` configuration block present, tags with matching keys will overwrite those defined at the provider-level.
-
tagsAll
public com.pulumi.core.Output<java.util.Map<java.lang.String,java.lang.String>> tagsAll()
- Returns:
- Map of tags assigned to the resource, including those inherited from the provider `defaultTags` configuration block.
-
terminationProtection
public com.pulumi.core.Output<java.lang.Boolean> terminationProtection()
- Returns:
- Switch on/off termination protection (default is `false`, except when using multiple master nodes). Before attempting to destroy the resource when termination protection is enabled, this configuration must be applied with its value set to `false`.
-
unhealthyNodeReplacement
public com.pulumi.core.Output<java.util.Optional<java.lang.Boolean>> unhealthyNodeReplacement()
- Returns:
- Whether whether Amazon EMR should gracefully replace core nodes that have degraded within the cluster. Default value is `false`.
-
visibleToAllUsers
public com.pulumi.core.Output<java.util.Optional<java.lang.Boolean>> visibleToAllUsers()
- Returns:
- Whether the job flow is visible to all IAM users of the AWS account associated with the job flow. Default value is `true`. **NOTE:** As per the [Amazon EMR API Reference](https://docs.aws.amazon.com/emr/latest/APIReference/API_RunJobFlow.html#EMR-RunJobFlow-request-VisibleToAllUsers), this argument is no longer supported. Do not set this argument, particularly to `false`, as it would lead to perpetual differences.
-
get
public static Cluster get(java.lang.String name, com.pulumi.core.Output<java.lang.String> id, @Nullable ClusterState state, @Nullable com.pulumi.resources.CustomResourceOptions options)
Get an existing Host resource's state with the given name, ID, and optional extra properties used to qualify the lookup.- Parameters:
name- The _unique_ name of the resulting resource.id- The _unique_ provider ID of the resource to lookup.state-options- Optional settings to control the behavior of the CustomResource.
-
-