Overview
advanced-evaluation is an open-source workflow skill for Claude Code and compatible agents, published by sickn33. Its author describes it as: “This skill should be used when the user asks to "implement LLM-as-judge", "compare model outputs", "create evaluation rubrics", "mitigate evaluation bias", or mentions direct scoring, pairwise comparison, position bia…”. The project has 47k stars on GitHub and is available under the MIT license. Add it to your setup with `/plugin marketplace add sickn33/agentic-awesome-skills`.
What advanced-evaluation does
This skill covers production-grade techniques for evaluating LLM outputs using LLMs as judges. It synthesizes research from academic papers, industry practices, and practical implementation experience into actionable patterns for building reliable evaluation systems.
What’s inside
The SKILL.md for advanced-evaluation is organised into these sections:
- When to Use
- Core Concepts
- The Evaluation Taxonomy
- The Bias Landscape
- Metric Selection Framework
- Evaluation Approaches
- Direct Scoring Implementation
- Pairwise Comparison Implementation
- Rubric Generation
- Practical Guidance
- Evaluation Pipeline Design
- Common Anti-Patterns
Installation
Add advanced-evaluation to your agent with:
/plugin marketplace add sickn33/agentic-awesome-skillsReview a skill’s source before installing it — skills can instruct your agent to run commands. This command comes from the skill’s public repository, which is the source of truth for setup steps. New to skills? Read how to install Claude Code skills.
Supported agents
- Claude Code — ships a claude code plugin marketplace
- Codex — declared in the repository topics
- Cursor — declared in the repository topics
- Gemini CLI — declared in the repository topics
- Antigravity — declared in the repository topics
License
advanced-evaluation is published under the MIT license.
Strengths
- Clear MIT license — safe to read and adapt within its terms
- Ships in sickn33/agentic-awesome-skills, an established project with 46,693 GitHub stars
- Works with Claude Code, Codex, Cursor, Gemini CLI, Antigravity
- Actively maintained — repository updated in the last 30 days
- Its repository gained 2,482 GitHub stars over the last 52 days
Author
Topics
Frequently asked questions
- What does advanced-evaluation do?
- This skill should be used when the user asks to "implement LLM-as-judge", "compare model outputs", "create evaluation rubrics", "mitigate evaluation bias", or mentions direct scoring, pairwise comparison, position bias, evaluation pipelines, or automated quality assessment.
- How do I install advanced-evaluation?
- Run /plugin marketplace add sickn33/agentic-awesome-skills in your agent, then reload your skills. Review the source at https://github.com/sickn33/agentic-awesome-skills before installing.
- Is advanced-evaluation free to use?
- Yes. advanced-evaluation is free and open source under the MIT license, so you can read, run, and adapt it within that license's terms.
- Which agents does advanced-evaluation work with?
- advanced-evaluation lists Claude Code, Codex, Cursor, Gemini CLI, and Antigravity — named in its SKILL.md, its plugin marketplace or its repository topics. Skills use the portable SKILL.md format, so other agents that read that format may load it too.
- Where does advanced-evaluation come from?
- advanced-evaluation ships inside sickn33/agentic-awesome-skills, a repository that contains 70 catalogued skills in total. The repository's 46,693 GitHub stars apply to that whole collection, not to this skill on its own.