How to pass multiple bootstrap actions in AWS EMR using Terraform?

The name of the pictureThe name of the pictureThe name of the pictureClash Royale CLAN TAG#URR8PPP



How to pass multiple bootstrap actions in AWS EMR using Terraform?



I am trying to create a terraform module for AWS EMR cluster. I need to run multiple bootstrap scripts in EMR, where I am having errors.
For example:



main.tf


...
variable bootstrap_actions type = "list"
...
resource "aws_emr_cluster" "emr-cluster"
name = "$var.emr_name"

release_label = "$var.release_label"
applications = "$var.applications"

termination_protection = true

ec2_attributes
subnet_id = "$data.aws_subnet.subnet.id"
emr_managed_master_security_group = "$data.aws_security_group.emr_managed_master_security_group.id"
emr_managed_slave_security_group = "$data.aws_security_group.emr_managed_slave_security_group.id"
service_access_security_group = "$data.aws_security_group.service_access_security_group.id"
additional_slave_security_groups = "$var.additional_slave_security_groups_id"
instance_profile = "$var.instance_profile"
key_name = "$var.key_name"


master_instance_type = "$var.master_instance_type"
core_instance_type = "$var.core_instance_type"
core_instance_count = "$var.core_instance_count"

tags
BUSINESS_UNIT = "$var.BUSINESS_UNIT"
BUSINESS_REGION = "$var.BUSINESS_REGION"
CLIENT = "$var.CLIENT"
ENVIRONMENT = "$var.env"
PLATFORM = "$var.PLATFORM"
Name = "$var.emr_name"



bootstrap_action = "$var.bootstrap_actions"

configurations = "test-fixtures/emr_configurations.json"

service_role = "$var.service_role"
autoscaling_role = "$var.autoscaling_role"




I passed all the variables including bootstrap as :


bootstrap_actions = [ "path=s3://bucket/bootstrap/hive/metastore/JSON41.sh,name=SERDE","path=s3://bucket/bootstrap/hive/hive-nofile-nproc-increase.sh,name=ulimit" ]



When I am applying the plan, I am getting error:


* aws_emr_cluster.emr-cluster: bootstrap_action.0: expected object, got invalid
* aws_emr_cluster.emr-cluster: bootstrap_action.1: expected object, got invalid



Does anyone have any idea on it? How can I pass multiple bootstrap actions here.
Please advise.



Thanks.




2 Answers
2



Doc: bootstrap_action - (Optional) list of bootstrap actions that will be run before Hadoop is started on the cluster nodes.


bootstrap_action



Your variable is list of strings, not list of objects. This variable is probably ok (not tested):


bootstrap_actions = [

path = "s3://bucket/bootstrap/hive/metastore/JSON41.sh"
name = "SERDE"
,

path = "s3://bucket/bootstrap/hive/hive-nofile-nproc-increase.sh"
name = "ulimit"
,
]



It works :


bootstrap_action = [

name = "custombootrstrap_test1"
path = "s3://$aws_s3_bucket.bucketlogs.bucket/bootstrap-actions/master/configure-test1.sh"
,

name = "custombootrstrap_test2"
path = "s3://$aws_s3_bucket.bucketlogs.bucket/bootstrap-actions/master/configure-test2.sh"
,
]






By clicking "Post Your Answer", you acknowledge that you have read our updated terms of service, privacy policy and cookie policy, and that your continued use of the website is subject to these policies.

-

Popular posts from this blog

Firebase Auth - with Email and Password - Check user already registered

Image
Clash Royale CLAN TAG #URR8PPP Firebase Auth - with Email and Password - Check user already registered I want to check when a user attempts to signup with createUserWithEmailAndPassword() in Firebase user Authentication method, this user is already registered with my app. createUserWithEmailAndPassword() 8 Answers 8 To detect whether a user with that email address already exists, you can detect when the call to createUserWithEmailAndPassword () fails with auth/email-already-in-use . I see that @Srinivasan just posted an answer for this. createUserWithEmailAndPassword () auth/email-already-in-use Alternatively, you can detect that an email address is already used by calling fetchSignInMethodsForEmail() (previous called fetchProvidersForEmail() ). fetchSignInMethodsForEmail() fetchProvidersForEmail() When the user trying to create an user with same email address, the task response will be "Response: The email address is already in use by another account." mFirebas
Read more

Dynamically update html content plain JS

Image
Clash Royale CLAN TAG #URR8PPP Dynamically update html content plain JS So I have a script bound in my index.html, which literally has to fetch an array of jsons from an api, then dynamically update my page when get response. But as a result I'm getting an as the only update of my page. here is my script fetch(url) .then((resp) => resp.json()) .then((resp) => resp.results.forEach(item => fetch(item.url) .then((response)=> response.json()) .then((response) => pokeArr.push(response)) .catch(console.log) ) ).catch(console.log) const filler = () => if(!pokeArr) return 0 pokeArr.map((i,j)=> return `<tr>$i.name</tr>` ) const pokeindex = () => document.getElementById('a').appendChild(document.createElement(filler())) pokeindex() When I'm consoling it, I can see in the console all the responses I get, so I'm at least doing the fetching part right. What's parberakan ? What's pokeArr ? – T.J. Crowder Aug 8 at 12
Read more

How to determine optimal route across keyboard

Image
Clash Royale CLAN TAG #URR8PPP How to determine optimal route across keyboard I'm trying to automate the typing process in a video game. Players are given an on-screen QWERTY keyboard layout that they can navigate with the control stick (up, down, left, right) in order to select a letter to type. I was wondering if there was a module for Python (or some other resource I could explore) that would help my program find a path across the keyboard as it types each letter in a given message. In other words, if the first letter typed was "A" and the next letter was "B", the module would know that the program should move 1 space down on the keyboard and 4 spaces to the right. Currently, I have the program resetting to the "G" key after each letter is typed (allowing me to use fixed-directions as the program parses each character in the desired message). As you can imagine, this is quite inefficient and defeats the purpose of automating the typing in the fir
Read more