A/B Test Framework

$9.99

Python A/B testing framework: experiment setup, statistical significance, chi-squared and z-test analysis. Know when a winner is real, not noise. Runs on Python 3.10+ stdlib only — no pip installs needed.

• Define experiments with control and variant groups
• Chi-squared test for categorical outcomes (click/no-click)
• Z-test for proportion comparison with confidence intervals
• Configurable significance level (default p < 0.05)
• Sample size calculator for experiment planning
• Multi-variant support (A/B/C/n testing)
• HTML report with test results and recommendations
• JSON experiment definition for reproducible tests

# Analyze an A/B test from experiment data
python ab_test_framework.py --input experiment.json

# Run with custom significance level
python ab_test_framework.py --input experiment.json --alpha 0.01

# Calculate required sample size
python ab_test_framework.py sample-size --baseline 0.12 --mde 0.02 --alpha 0.05