Structured guide for setting up A/B tests with mandatory gates for hypothesis, metrics, and execution readiness.
ab-testing
ab-testing is an open-source testing skill for Claude Code and compatible agents, published by sickn33. Its author describes it as: “When the user wants to plan, design, or implement an A/B test or experiment, or build a growth experimentation program. Also use when the user mentions "A/B test," "split test," "experiment," "test this change," "vari…”. The project has 45k stars on GitHub and is available under the MIT license. Add it to your setup with `/plugin marketplace add sickn33/agentic-awesome-skills`.
What ab-testing does
Use this skill when you need when the user wants to plan, design, or implement an A/B test or experiment, or build a growth experimentation program. Also use when the user mentions "A/B test," "split test," "experiment," "test this change," "variant copy," "multivariate test," "hypothesis," "should I test this,"...
Installation
Add ab-testing to your agent with:
/plugin marketplace add sickn33/agentic-awesome-skills Always review a skill's source before installing it. This command comes from the skill's public repository; the linked repo is the source of truth for exact setup steps.
What's inside
The SKILL.md for ab-testing is organised into these sections:
- When to Use
- Initial Assessment
- Core Principles
- 1. Start with a Hypothesis
- 2. Test One Thing
- 3. Statistical Rigor
- 4. Measure What Matters
- Hypothesis Framework
- Structure
- Example
- Test Types
- Sample Size
When to use it
Reach for ab-testing when you want testing help from your agent without writing the same instructions every session. Load the skill and the agent picks it up automatically for relevant tasks.
Strengths
- Clear MIT license — safe to read and adapt
- Ships in sickn33/agentic-awesome-skills, an established project with 45,095 GitHub stars
- Actively maintained (recent commits)
Topics
Frequently asked questions
- What does ab-testing do?
- When the user wants to plan, design, or implement an A/B test or experiment, or build a growth experimentation program. Also use when the user mentions "A/B test," "split test," "experiment," "test this change," "variant copy," "multivariate test," "hypothesis," "should I test this,"...
- How do I install ab-testing?
- Run /plugin marketplace add sickn33/agentic-awesome-skills in your agent, then reload your skills. Review the source at https://github.com/sickn33/agentic-awesome-skills before installing.
- Is ab-testing free to use?
- Yes. ab-testing is free and open source under the MIT license, so you can read, run, and adapt it within that license's terms.
- Where does ab-testing come from?
- ab-testing ships inside sickn33/agentic-awesome-skills, a repository that contains 66 catalogued skills in total. The repository's 45,095 GitHub stars apply to that whole collection, not to this skill on its own.
Related skills
More Testing →Create, edit, validate, and run Agent QA tests, suites, and hooks through MCP or CLI while preserving canonical IDs and schema contracts.
Debug, patch, and verify failed Agent QA runs from MCP evidence, artifacts, logs, and local code without hiding product or infrastructure defects.
Triage failed Agent QA runs with MCP evidence, artifacts, logs, fixed failure categories, confidence, and actionable next steps.
Master end-to-end testing with Playwright and Cypress to build reliable test suites that catch bugs, improve confidence, and enable fast deployment. Use when implementing E2E tests, debugging flaky tests, or establishing testing standards.