How to Resolve iam:PassRole error message?

Error Message :- When I was working with AWS Glue Interactive session, I got an error User arn:aws:iam::<$aws-account-id>:role/AWSGlueServiceRole-glueworkshop/GlueJobRunnerSession is not authorized to perform iam:PassRole on recsource arn:aws:iam::<$aws-account-id>:role/AWSGlueServiceRole-glueworkshop because no identify-based policy allows the iam:PassRole action. However, you may receive similar error message while working with other services too. Before we move with resolution, let’s understand… Read More How to Resolve iam:PassRole error message?

Create single file in AWS Glue (pySpark) and store as custom file name S3

AWS Glue – AWS Glue is a serverless ETL tool developed by AWS. It is built on top of Spark. As spark is distributed processing engine by default it creates multiple output files states with e.g. Generating a Single file You might have requirement to create single output file. In order for you to create… Read More Create single file in AWS Glue (pySpark) and store as custom file name S3

Serverless – The provided execution role does not have permissions to call CreateNetworkInterface on EC2

Issue – while deploying Serverless Lambda (sls deploy command ) function I got below error message An error occurred: EsLambdaFunction – The provided execution role does not have permissions to call CreateNetworkInterface on EC2 (Service: AWSLambdaInternal; Status Code: 400; Error Code: InvalidParameterValueException; Request ID: xxx). Resolution – In order to resolve the issue; I have… Read More Serverless – The provided execution role does not have permissions to call CreateNetworkInterface on EC2

AWS Lake formation – Error Message

Error Message – User: arn:aws:iam::xxxx:user/admin is not authorized to perform: lakeformation:PutDataLakeSettings with an explicit deny Issue – This issue will occur when you will try add new user as Lake formation admin with IAM user which already added as admin to Lake formation lakeformation:PutDataLakeSettings Denying this permission prevents a data lake administrator from designating other… Read More AWS Lake formation – Error Message

How to copy file from cloudera quickstart docker to local file system ( mac or windows )

  Ensure you quickstart docker vm is running ( you can check by using below command) https://hub.docker.com/r/cloudera/quickstart/ Launch VM container ( Go to terminal and run ) docker run –hostname=quickstart.cloudera –privileged=true -t -i -v            /Users/navnit/Documents/cloudera:/src –publish-all=true -p 8888 cloudera/quickstart /usr/bin/docker-quickstart 2. Run docker ps command to validate if cloudera/quickstart is running… Read More How to copy file from cloudera quickstart docker to local file system ( mac or windows )

How to enable cron schedule in AWS EC2 instance

Step 1 – Connect to your ec2 instance ( follow below article ) https://learnsqlteam.com/2018/11/30/how-to-connect-aws-ec2-instance-through-terminal/ step 2 – go to /etc – ( cd /etc ) step 3 – edit crontab ( nano crontab ) step 4 – define schedule and command e.g.  in this example I am sysning file b/w ec2 instance and s3 bucket… Read More How to enable cron schedule in AWS EC2 instance