| name | syn-spark-dataframe |
| description | Operate, configure, troubleshoot, and manage Apache Spark. Use for Apache Spark engineering tasks, day-to-day operations, and production support. |
Apache Spark: DataFrame transformations
When to use
Use this skill for DataFrame transformations in Apache Spark. This skill
specifically handles DataFrame transformations and nothing else in the
Apache Spark family.
Procedure
Build DataFrame pipelines with select/withColumn/groupBy, use built-in functions over UDFs, and chain transformations lazily.
Notes
This is the Apache Spark skill dedicated to DataFrame transformations.
Sibling skills cover other Apache Spark capabilities; this one
is the right choice only when the task is about DataFrame transformations.