Overview
arize-evaluator is an open-source integrations skill for Claude Code and compatible agents, published by github. Its author describes it as: “Handles LLM-as-judge evaluation workflows on Arize including creating/updating evaluators, running evaluations on spans or experiments, managing tasks, trigger-run operations, column mapping, and continuous monitoring…”. The project has 38k stars on GitHub and is available under the MIT license. Add it to your setup with `git clone https://github.com/github/awesome-copilot ~/.claude/skills/arize-evaluator`.
What arize-evaluator does
> **`SPACE`** — All `--space` flags and the `ARIZE_SPACE` env var accept a space **name** (e.g., `my-workspace`) or a base64 space **ID** (e.g., `U3BhY2U6...`). Find yours with `ax spaces list`.
What’s inside
The SKILL.md for arize-evaluator is organised into these sections:
- Prerequisites
- Concepts
- What is an Evaluator?
- What is a Task?
- Data Granularity
- How trace and session aggregation works
- The {conversation} template variable
- Multi-evaluator tasks
- Basic CRUD
- AI Integrations
- Evaluators
- Tasks
Installation
Add arize-evaluator to your agent with:
git clone https://github.com/github/awesome-copilot ~/.claude/skills/arize-evaluatorReview a skill’s source before installing it — skills can instruct your agent to run commands. This command comes from the skill’s public repository, which is the source of truth for setup steps. New to skills? Read how to install Claude Code skills.
Supported agents
- GitHub Copilot — declared in the repository topics
License
arize-evaluator is published under the MIT license.
Strengths
- Clear MIT license — safe to read and adapt within its terms
- Ships in github/awesome-copilot, an established project with 37,982 GitHub stars
- Works with GitHub Copilot
- Actively maintained — repository updated in the last 90 days
Author
Topics
Frequently asked questions
- What does arize-evaluator do?
- Handles LLM-as-judge evaluation workflows on Arize including creating/updating evaluators, running evaluations on spans or experiments, managing tasks, trigger-run operations, column mapping, and continuous monitoring. Use when the user mentions create evaluator, LLM judge, hallucination, faithfulness, correctness, relevance, run eval, score spans, score experiment, trigger-run, column mapping, continuous monitoring, or improve evaluator prompt.
- How do I install arize-evaluator?
- Run git clone https://github.com/github/awesome-copilot ~/.claude/skills/arize-evaluator in your agent, then reload your skills. Review the source at https://github.com/github/awesome-copilot before installing.
- Is arize-evaluator free to use?
- Yes. arize-evaluator is free and open source under the MIT license, so you can read, run, and adapt it within that license's terms.
- Which agents does arize-evaluator work with?
- arize-evaluator lists GitHub Copilot — named in its SKILL.md, its plugin marketplace or its repository topics. Skills use the portable SKILL.md format, so other agents that read that format may load it too.
- Where does arize-evaluator come from?
- arize-evaluator ships inside github/awesome-copilot, a repository that contains 41 catalogued skills in total. The repository's 37,982 GitHub stars apply to that whole collection, not to this skill on its own.