Overview
spark-optimization is an open-source workflow skill for Claude Code and compatible agents, published by wshobson. Its author describes it as: “Optimize Apache Spark jobs with partitioning, caching, shuffle optimization, and memory tuning. Use when improving Spark performance, debugging slow jobs, or scaling data processing pipelines.”. The project has 39k stars on GitHub and is available under the MIT license. Add it to your setup with `/plugin marketplace add wshobson/agents`.
Installation
Add spark-optimization to your agent with:
/plugin marketplace add wshobson/agentsReview a skill’s source before installing it — skills can instruct your agent to run commands. This command comes from the skill’s public repository, which is the source of truth for setup steps. New to skills? Read how to install Claude Code skills.
Supported agents
- Claude Code — ships a claude code plugin marketplace
- Codex — declared in the repository topics
- Cursor — declared in the repository topics
- Gemini CLI — declared in the repository topics
- OpenCode — declared in the repository topics
- GitHub Copilot — declared in the repository topics
License
spark-optimization is published under the MIT license.
Strengths
- Clear MIT license — safe to read and adapt within its terms
- Ships in wshobson/agents, an established project with 38,529 GitHub stars
- Works with Claude Code, Codex, Cursor, Gemini CLI, OpenCode, GitHub Copilot
- Actively maintained — repository updated in the last 90 days
Author
Topics
Alternatives to spark-optimization
Similar skills from other repositories:
Frequently asked questions
- What does spark-optimization do?
- Optimize Apache Spark jobs with partitioning, caching, shuffle optimization, and memory tuning. Use when improving Spark performance, debugging slow jobs, or scaling data processing pipelines.
- How do I install spark-optimization?
- Run /plugin marketplace add wshobson/agents in your agent, then reload your skills. Review the source at https://github.com/wshobson/agents before installing.
- Is spark-optimization free to use?
- Yes. spark-optimization is free and open source under the MIT license, so you can read, run, and adapt it within that license's terms.
- Which agents does spark-optimization work with?
- spark-optimization lists Claude Code, Codex, Cursor, Gemini CLI, OpenCode, and GitHub Copilot — named in its SKILL.md, its plugin marketplace or its repository topics. Skills use the portable SKILL.md format, so other agents that read that format may load it too.
- Where does spark-optimization come from?
- spark-optimization ships inside wshobson/agents, a repository that contains 54 catalogued skills in total. The repository's 38,529 GitHub stars apply to that whole collection, not to this skill on its own.