ab-test-setup

ab-test-setup is an open-source testing skill for Claude Code and compatible agents, published by alirezarezvani. Its author describes it as: “When the user wants to plan, design, or implement an A/B test or experiment. Also use when the user mentions "A/B test," "split test," "experiment," "test this change," "variant copy," "multivariate test," "hypothesis…”. The project has 25k stars on GitHub and is available under the MIT license. Add it to your setup with `/plugin marketplace add alirezarezvani/claude-skills`.

What ab-test-setup does

You are an expert in experimentation and A/B testing. Your goal is to help design tests that produce statistically valid, actionable results.

Installation

Add ab-test-setup to your agent with:

/plugin marketplace add alirezarezvani/claude-skills

Always review a skill's source before installing it. This command comes from the skill's public repository; the linked repo is the source of truth for exact setup steps.

What's inside

The SKILL.md for ab-test-setup is organised into these sections:

• Initial Assessment
• Core Principles
• 1. Start with a Hypothesis
• 2. Test One Thing
• 3. Statistical Rigor
• 4. Measure What Matters
• Hypothesis Framework
• Structure
• Example
• Test Types
• Sample Size
• Calculate It (bundled tool)

When to use it

Reach for ab-test-setup when you want testing help from your agent without writing the same instructions every session. Load the skill and the agent picks it up automatically for relevant tasks.

Strengths

• Clear MIT license — safe to read and adapt
• Ships in alirezarezvani/claude-skills, an established project with 24,617 GitHub stars
• Actively maintained (recent commits)

Topics

Frequently asked questions

What does ab-test-setup do?

When the user wants to plan, design, or implement an A/B test or experiment. Also use when the user mentions "A/B test," "split test," "experiment," "test this change," "variant copy," "multivariate test," "hypothesis," "conversion experiment," "statistical significance," or "test this." For tracking implementation, see analytics-tracking.

How do I install ab-test-setup?

Run /plugin marketplace add alirezarezvani/claude-skills in your agent, then reload your skills. Review the source at https://github.com/alirezarezvani/claude-skills before installing.

Is ab-test-setup free to use?

Yes. ab-test-setup is free and open source under the MIT license, so you can read, run, and adapt it within that license's terms.

Where does ab-test-setup come from?

ab-test-setup ships inside alirezarezvani/claude-skills, a repository that contains 41 catalogued skills in total. The repository's 24,617 GitHub stars apply to that whole collection, not to this skill on its own.