BRAINIAC A/B Testing & Experimentation Statistics
software.brainiac/experimentation · v1.0.1 · MCP 2025-11-25
Paid A/B Testing & Experimentation Statistics API via x402. Unpaid tool calls return 402.
Reachability
reachable
checked 2026-11-21 05:31 UTC
Registry status active
Tools pinned 15
98fad548d448
Tools last changed
2026-11-21
Provenance
Registry namespace software.brainiac
(domain verified by the official registry)
Website
https://www.brainiac.software
Remote endpoints
https://www.brainiac.software/mcp/experimentation (streamable-http)
Observed changes
| When (UTC) | Event | Detail |
|---|---|---|
| 2026-11-21 05:31 | tools changed | 0 added, 0 removed, 15 changed |
| 2026-11-20 05:30 | first capture | 15 tools pinned |
Pinned tool definitions (15)
| Tool | Description |
|---|---|
| experimentation_ab-test-frequentist | Two-arm A/B scorecard for conversion (two-proportion z) or continuous (Welch t) metrics: absolute and relative lift, confidence intervals, p-value and significance when designing or analysing an A/B test. Pure computation on supplied... |
| experimentation_bayesian-ab | Posterior, probability to beat control, probability of being best, expected loss and equal-tailed credible intervals for 2-10 conversion arms when designing or analysing an A/B test. Deterministic: exact Miller sum or quadrature, no... |
| experimentation_sequential-test | Lan-DeMets group-sequential boundaries (O'Brien-Fleming or Pocock spending) for planned looks with a stop/continue decision, or an always-valid mSPRT p-value for continuous monitoring when designing or analysing an A/B test. Call with... |
| experimentation_cuped-adjust | CUPED adjustment with a pre-experiment covariate on unit-level data: theta, variance reduction, and Welch tests on raw and adjusted values when designing or analysing an A/B test. Call with units; optional alpha. Returns theta,... |
| experimentation_sample-ratio-mismatch | Chi-square goodness-of-fit test of observed arm counts against expected traffic shares, with an exact binomial p-value for tiny two-arm counts and generic causes when a mismatch is flagged when designing or analysing an A/B test. Call... |
| experimentation_sample-size-mde | Required users per arm and duration for a target minimum detectable effect, or the MDE for a fixed sample, for proportion or mean metrics with power, multi-arm Bonferroni and unequal allocation when designing or analysing an A/B test.... |
| experimentation_multiple-testing-correct | Bonferroni, Holm and Benjamini-Hochberg adjusted p-values and reject decisions across metrics or arms, returned in input order when designing or analysing an A/B test. Call with pValues; optional methods, alpha. Returns results and... |
| experimentation_delta-method-ratio | Confidence interval for a ratio metric whose analysis unit differs from the randomisation unit, plus the treatment-vs-control difference and relative lift when designing or analysing an A/B test. Accepts unit rows or aggregates. Call... |
| experimentation_bandit-allocate | Next-period traffic weights from arm outcomes: Thompson-sampling probabilities by deterministic quadrature, or UCB1 indices, with an exploration floor when designing or analysing an A/B test. Call with policy and arms; optional prior,... |
| experimentation_bucket-assign | Stateless SHA-256 bucketing of unit ids into an experiment with traffic gating, ordered group shares and an optional layer, documented so any SDK can reproduce it when designing or analysing an A/B test. Call with unitIds and... |
| experimentation_flag-rule-evaluate | Evaluate ordered feature-flag rules (attribute operators, semver comparison, deterministic percentage rollout) for one user context and explain which rule matched when designing or analysing an A/B test. Call with flag and context.... |
| experimentation_novelty-effect-detect | OLS trend test on daily lift with early-versus-late means, classifying the pattern as novelty, primacy or stable when designing or analysing an A/B test. Call with daily; optional liftType, earlyDays, alpha. Returns slopePerDay,... |
| experimentation_segment-lift | Per-segment conversion lift with Benjamini-Hochberg adjusted p-values, a Cochran Q heterogeneity test and suppression of small segments when designing or analysing an A/B test. Call with segments; optional minUsersPerArm, alpha. Returns... |
| experimentation_guardrail-check | One-sided non-inferiority tests of guardrail metrics against caller-supplied relative or absolute margins, with bounds and an overall pass flag when designing or analysing an A/B test. Call with metrics; optional alpha. Returns metrics... |
| experimentation_holdout-impact | Exposed-versus-holdout impact with confidence interval and p-value, plus diluted population-level impact for partial exposure when designing or analysing an A/B test. Call with metricType, holdout, and exposed; optional exposureRate,... |
Get alerted when this changes.
Email the moment software.brainiac/experimentation drifts, dies, or revives.
Status badge
[](https://toolpin.dev/servers/software.brainiac/experimentation)
Maintain this server? Add the badge to your README. It links your users to this live status page.