arize-prompt-optimization

Optimizes, improves, and debugs LLM prompts using production trace data, evaluations, and annotations. Extracts prompts from spans, gathers performance signal, and runs a data-driven optimization loop using the ax CLI. Use when the user mentions optimize prompt, improve prompt, make AI respond better, improve output quality, prompt engineering, prompt tuning, or system prompt improvement.

by github 38k GitHub stars MIT Updated Aug 18, 2026
arize-prompt-optimization skill by github
arize-prompt-optimization — Integrations skill by github

Overview

arize-prompt-optimization is an open-source integrations skill for Claude Code and compatible agents, published by github. Its author describes it as: “Optimizes, improves, and debugs LLM prompts using production trace data, evaluations, and annotations. Extracts prompts from spans, gathers performance signal, and runs a data-driven optimization loop using the ax CLI…”. The project has 38k stars on GitHub and is available under the MIT license. Add it to your setup with `git clone https://github.com/github/awesome-copilot ~/.claude/skills/arize-prompt-optimization`.

What arize-prompt-optimization does

> **`SPACE`** — All `--space` flags and the `ARIZE_SPACE` env var accept a space **name** (e.g., `my-workspace`) or a base64 space **ID** (e.g., `U3BhY2U6...`). Find yours with `ax spaces list`.

What’s inside

The SKILL.md for arize-prompt-optimization is organised into these sections:

  • Concepts
  • Where Prompts Live in Trace Data
  • Finding Prompts by Span Kind
  • Performance Signal Columns
  • Prerequisites
  • Phase 1: Extract the Current Prompt
  • Find LLM spans containing prompts
  • Export a trace to inspect prompt structure
  • Extract prompts from exported JSON
  • Reconstruct the prompt as messages
  • Phase 2: Gather Performance Data
  • From traces (production feedback)

Installation

Add arize-prompt-optimization to your agent with:

git clone https://github.com/github/awesome-copilot ~/.claude/skills/arize-prompt-optimization

Review a skill’s source before installing it — skills can instruct your agent to run commands. This command comes from the skill’s public repository, which is the source of truth for setup steps. New to skills? Read how to install Claude Code skills.

Supported agents

License

arize-prompt-optimization is published under the MIT license.

Strengths

  • Clear MIT license — safe to read and adapt within its terms
  • Ships in github/awesome-copilot, an established project with 37,982 GitHub stars
  • Works with GitHub Copilot
  • Actively maintained — repository updated in the last 90 days

Author

github 41 skills in the catalog · GitHub profile ↗
View skills

Topics

Need a skill like this, tailored to your team?Build a custom skill →

Frequently asked questions

What does arize-prompt-optimization do?
Optimizes, improves, and debugs LLM prompts using production trace data, evaluations, and annotations. Extracts prompts from spans, gathers performance signal, and runs a data-driven optimization loop using the ax CLI. Use when the user mentions optimize prompt, improve prompt, make AI respond better, improve output quality, prompt engineering, prompt tuning, or system prompt improvement.
How do I install arize-prompt-optimization?
Run git clone https://github.com/github/awesome-copilot ~/.claude/skills/arize-prompt-optimization in your agent, then reload your skills. Review the source at https://github.com/github/awesome-copilot before installing.
Is arize-prompt-optimization free to use?
Yes. arize-prompt-optimization is free and open source under the MIT license, so you can read, run, and adapt it within that license's terms.
Which agents does arize-prompt-optimization work with?
arize-prompt-optimization lists GitHub Copilot — named in its SKILL.md, its plugin marketplace or its repository topics. Skills use the portable SKILL.md format, so other agents that read that format may load it too.
Where does arize-prompt-optimization come from?
arize-prompt-optimization ships inside github/awesome-copilot, a repository that contains 41 catalogued skills in total. The repository's 37,982 GitHub stars apply to that whole collection, not to this skill on its own.

Create or register a canvas extension in the awesome-copilot repository. Use when asked to scaffold a new canvas extension, create its plugin.json, add a reusable extension to one or more plugins, or migrate extension metadata. Extensions are reusable source under extensions/; shippable plugin manifests belong under plugins/.

Official GitHub Copilot
38k GitHub stars MIT Updated Aug 18, 2026 Free

Run the AgentRC readiness assessment on the current repository and produce a static HTML dashboard at reports/index.html. Wraps `npx github:microsoft/agentrc readiness` and hands off rendering to the @ai-readiness-reporter custom agent. Supports policies (--policy) for org-specific scoring. Use when asked to assess, audit, or score the AI readiness of a repo.

Official GitHub Copilot
38k GitHub stars MIT Updated Aug 18, 2026 Free

Generate tailored AI agent instruction files via AgentRC instructions command. Produces .github/copilot-instructions.md (default, recommended for Copilot in VS Code) plus optional per-area .instructions.md files with applyTo globs for monorepos. Use after running /acreadiness-assess to close gaps in the AI Tooling pillar.

Official GitHub Copilot
38k GitHub stars MIT Updated Aug 18, 2026 Free

Help the user pick, write, or apply an AgentRC policy. Policies customise readiness scoring by disabling irrelevant checks, overriding impact/level, setting pass-rate thresholds, or chaining org baselines with team overrides. Use when the user asks about strict mode, AI-only scoring, custom weights, CI gating, or wants org-wide standardisation.

Official GitHub Copilot
38k GitHub stars MIT Updated Aug 18, 2026 Free

Add educational comments to the file specified, or prompt asking for file to comment if one is not provided.

Official GitHub Copilot
38k GitHub stars MIT Updated Aug 18, 2026 Free