agentic-eval

agentic-eval is an open-source workflow skill for Claude Code and compatible agents, published by github. Its author describes it as: “Patterns and techniques for evaluating and improving AI agent outputs. Use this skill when: - Implementing self-critique and reflection loops - Building evaluator-optimizer pipelines for quality-critical generation -…”. The project has 38k stars on GitHub and is available under the MIT license. Add it to your setup with `git clone https://github.com/github/awesome-copilot ~/.claude/skills/agentic-eval`.

What agentic-eval does

Patterns for self-improvement through iterative evaluation and refinement.

Installation

Add agentic-eval to your agent with:

git clone https://github.com/github/awesome-copilot ~/.claude/skills/agentic-eval

Always review a skill's source before installing it. This command comes from the skill's public repository; the linked repo is the source of truth for exact setup steps.

What's inside

The SKILL.md for agentic-eval is organised into these sections:

• Overview
• When to Use
• Pattern 1: Basic Reflection
• Pattern 2: Evaluator-Optimizer
• Pattern 3: Code-Specific Reflection
• Evaluation Strategies
• Outcome-Based
• LLM-as-Judge
• Rubric-Based
• Best Practices
• Quick Start Checklist

When to use it

Reach for agentic-eval when you want workflow help from your agent without writing the same instructions every session. Load the skill and the agent picks it up automatically for relevant tasks.

Strengths

• Clear MIT license — safe to read and adapt
• Ships in github/awesome-copilot, an established project with 37,982 GitHub stars
• Actively maintained (recent commits)

Topics

Frequently asked questions

What does agentic-eval do?

Patterns and techniques for evaluating and improving AI agent outputs. Use this skill when: - Implementing self-critique and reflection loops - Building evaluator-optimizer pipelines for quality-critical generation - Creating test-driven code refinement workflows - Designing rubric-based or LLM-as-judge evaluation systems - Adding iterative improvement to agent outputs (code, reports, analysis) - Measuring and improving agent response quality

How do I install agentic-eval?

Run git clone https://github.com/github/awesome-copilot ~/.claude/skills/agentic-eval in your agent, then reload your skills. Review the source at https://github.com/github/awesome-copilot before installing.

Is agentic-eval free to use?

Yes. agentic-eval is free and open source under the MIT license, so you can read, run, and adapt it within that license's terms.

Where does agentic-eval come from?

agentic-eval ships inside github/awesome-copilot, a repository that contains 41 catalogued skills in total. The repository's 37,982 GitHub stars apply to that whole collection, not to this skill on its own.