spark-engineer

Name: spark-engineer
Author: Jeffallan

Use when writing Spark jobs, debugging performance issues, or configuring cluster settings for Apache Spark applications, distributed data processing pipelines, or big data workloads. Invoke to write DataFrame transformations, optimize Spark SQL queries, implement RDD pipelines, tune shuffle operations, configure executor memory, process .parquet files, handle data partitioning, or build structured streaming analytics.

spark engineer sql

Content Preview

---
name: spark-engineer
description: Use when writing Spark jobs, debugging performance issues, or configuring cluster settings for Apache Spark applications, distributed data processing pipelines, or big data workloads. Invoke to write DataFrame transformations, optimize Spark SQL queries, implement RDD pipelines, tune shuffle operations, configure executor memory, process .parquet files, handle data partitioning, or build structured streaming analytics.
license: MIT
metadata:
  author: https:

How to Use

Recommended: Install to project (local)

mkdir -p .claude/skills
curl -o .claude/skills/spark-engineer.md \
  https://raw.githubusercontent.com/Jeffallan/claude-skills/main/skills/spark-engineer/SKILL.md

Skill is scoped to this project only. Add .claude/skills/ to your .gitignoreif you don't want to commit it.

Alternative: Clone full repo

git clone https://github.com/Jeffallan/claude-skills

Then reference at skills/spark-engineer/SKILL.md