emr-diagnostics

name	emr-diagnostics
version	1.0.0
last_updated	2025-04-12
description	Use this skill to investigate and troubleshoot Amazon EMR problems by analyzing cluster launch failures, termination issues, bootstrap actions, step failures, Spark tuning, YARN resource management, shuffle issues, EMRFS/S3 issues, HDFS problems, VPC configuration, security groups, managed scaling, instance fleets, EMR on EKS virtual clusters, job run failures, EMR Serverless application failures, capacity issues, Kerberos authentication, Lake Formation integration, EMR Studio, Jupyter issues, and following structured runbooks. Activate when: cluster won't launch, unexpected termination, bootstrap action failures, step execution errors, Spark performance issues, YARN resource contention, shuffle failures, S3 read/write errors, HDFS capacity issues, VPC connectivity problems, scaling not working, EMR on EKS failures, Serverless job errors, security configuration issues, or the user says something is wrong with EMR.
compatibility	Requires AWS CLI or SDK access with EMR, EC2, S3, IAM, CloudWatch, CloudTrail, and optionally EKS, Lake Formation, and VPC permissions. Some operations require EMR cluster access via SSH or EMR Studio.

Amazon EMR Diagnostics

When to use

Any Amazon EMR investigation where the console alone is insufficient — cluster lifecycle issues, application performance tuning, storage problems, networking configuration, scaling behavior, EMR on EKS, EMR Serverless, security configuration, or notebook/studio access.