When the user wants to plan, design, or implement an A/B test or experiment, or build a growth experimentation program. Also use when the user mentions "A/B test," "split test," "experiment," "test this change," "variant copy," "multivariate test," "hypothesis," "should I test this,"...
ab-test-setup
ab-test-setup is an open-source testing skill for Claude Code and compatible agents, published by sickn33. Its author describes it as: “Structured guide for setting up A/B tests with mandatory gates for hypothesis, metrics, and execution readiness.”. The project has 45k stars on GitHub and is available under the MIT license. Add it to your setup with `/plugin marketplace add sickn33/agentic-awesome-skills`.
What ab-test-setup does
Ensure every A/B test is **valid, rigorous, and safe** before a single line of code is written.
Installation
Add ab-test-setup to your agent with:
/plugin marketplace add sickn33/agentic-awesome-skillsAlways review a skill's source before installing it. This command comes from the skill's public repository; the linked repo is the source of truth for exact setup steps.
What's inside
The SKILL.md for ab-test-setup is organised into these sections:
- 1️⃣ Purpose & Scope
- 2️⃣ Pre-Requisites
- Hypothesis Quality Checklist
- 3️⃣ Hypothesis Lock (Hard Gate)
- 4️⃣ Assumptions & Validity Check (Mandatory)
- 5️⃣ Test Type Selection
- 6️⃣ Metrics Definition
- 7️⃣ Sample Size & Duration
- Tracking Verification (Required before Gate 8)
- 8️⃣ Execution Readiness Gate (Hard Stop)
- Running the Test
- During the Test
When to use it
Reach for ab-test-setup when you want testing help from your agent without writing the same instructions every session. Load the skill and the agent picks it up automatically for relevant tasks.
Strengths
- Clear MIT license — safe to read and adapt
- Ships in sickn33/agentic-awesome-skills, an established project with 45,095 GitHub stars
- Actively maintained (recent commits)
Topics
Frequently asked questions
- What does ab-test-setup do?
- Structured guide for setting up A/B tests with mandatory gates for hypothesis, metrics, and execution readiness.
- How do I install ab-test-setup?
- Run /plugin marketplace add sickn33/agentic-awesome-skills in your agent, then reload your skills. Review the source at https://github.com/sickn33/agentic-awesome-skills before installing.
- Is ab-test-setup free to use?
- Yes. ab-test-setup is free and open source under the MIT license, so you can read, run, and adapt it within that license's terms.
- Where does ab-test-setup come from?
- ab-test-setup ships inside sickn33/agentic-awesome-skills, a repository that contains 66 catalogued skills in total. The repository's 45,095 GitHub stars apply to that whole collection, not to this skill on its own.
Related skills
More Testing →Create, edit, validate, and run Agent QA tests, suites, and hooks through MCP or CLI while preserving canonical IDs and schema contracts.
Debug, patch, and verify failed Agent QA runs from MCP evidence, artifacts, logs, and local code without hiding product or infrastructure defects.
Triage failed Agent QA runs with MCP evidence, artifacts, logs, fixed failure categories, confidence, and actionable next steps.
Master end-to-end testing with Playwright and Cypress to build reliable test suites that catch bugs, improve confidence, and enable fast deployment. Use when implementing E2E tests, debugging flaky tests, or establishing testing standards.