Toolpin Monitor a server

BRAINIAC A/B Testing & Experimentation Statistics

software.brainiac/experimentation · v1.0.1 · MCP 2025-11-25

Paid A/B Testing & Experimentation Statistics API via x402. Unpaid tool calls return 402.

Reachability reachable
checked 2026-11-21 05:31 UTC
Registry status active
Tools pinned 15
98fad548d448
Tools last changed 2026-11-21

Provenance

Registry namespace software.brainiac (domain verified by the official registry)
Website https://www.brainiac.software
Remote endpoints
https://www.brainiac.software/mcp/experimentation (streamable-http)

Observed changes

When (UTC)EventDetail
2026-11-21 05:31 tools changed 0 added, 0 removed, 15 changed
2026-11-20 05:30 first capture 15 tools pinned

Pinned tool definitions (15)

ToolDescription
experimentation_ab-test-frequentist Two-arm A/B scorecard for conversion (two-proportion z) or continuous (Welch t) metrics: absolute and relative lift, confidence intervals, p-value and significance when designing or analysing an A/B test. Pure computation on supplied...
experimentation_bayesian-ab Posterior, probability to beat control, probability of being best, expected loss and equal-tailed credible intervals for 2-10 conversion arms when designing or analysing an A/B test. Deterministic: exact Miller sum or quadrature, no...
experimentation_sequential-test Lan-DeMets group-sequential boundaries (O'Brien-Fleming or Pocock spending) for planned looks with a stop/continue decision, or an always-valid mSPRT p-value for continuous monitoring when designing or analysing an A/B test. Call with...
experimentation_cuped-adjust CUPED adjustment with a pre-experiment covariate on unit-level data: theta, variance reduction, and Welch tests on raw and adjusted values when designing or analysing an A/B test. Call with units; optional alpha. Returns theta,...
experimentation_sample-ratio-mismatch Chi-square goodness-of-fit test of observed arm counts against expected traffic shares, with an exact binomial p-value for tiny two-arm counts and generic causes when a mismatch is flagged when designing or analysing an A/B test. Call...
experimentation_sample-size-mde Required users per arm and duration for a target minimum detectable effect, or the MDE for a fixed sample, for proportion or mean metrics with power, multi-arm Bonferroni and unequal allocation when designing or analysing an A/B test....
experimentation_multiple-testing-correct Bonferroni, Holm and Benjamini-Hochberg adjusted p-values and reject decisions across metrics or arms, returned in input order when designing or analysing an A/B test. Call with pValues; optional methods, alpha. Returns results and...
experimentation_delta-method-ratio Confidence interval for a ratio metric whose analysis unit differs from the randomisation unit, plus the treatment-vs-control difference and relative lift when designing or analysing an A/B test. Accepts unit rows or aggregates. Call...
experimentation_bandit-allocate Next-period traffic weights from arm outcomes: Thompson-sampling probabilities by deterministic quadrature, or UCB1 indices, with an exploration floor when designing or analysing an A/B test. Call with policy and arms; optional prior,...
experimentation_bucket-assign Stateless SHA-256 bucketing of unit ids into an experiment with traffic gating, ordered group shares and an optional layer, documented so any SDK can reproduce it when designing or analysing an A/B test. Call with unitIds and...
experimentation_flag-rule-evaluate Evaluate ordered feature-flag rules (attribute operators, semver comparison, deterministic percentage rollout) for one user context and explain which rule matched when designing or analysing an A/B test. Call with flag and context....
experimentation_novelty-effect-detect OLS trend test on daily lift with early-versus-late means, classifying the pattern as novelty, primacy or stable when designing or analysing an A/B test. Call with daily; optional liftType, earlyDays, alpha. Returns slopePerDay,...
experimentation_segment-lift Per-segment conversion lift with Benjamini-Hochberg adjusted p-values, a Cochran Q heterogeneity test and suppression of small segments when designing or analysing an A/B test. Call with segments; optional minUsersPerArm, alpha. Returns...
experimentation_guardrail-check One-sided non-inferiority tests of guardrail metrics against caller-supplied relative or absolute margins, with bounds and an overall pass flag when designing or analysing an A/B test. Call with metrics; optional alpha. Returns metrics...
experimentation_holdout-impact Exposed-versus-holdout impact with confidence interval and p-value, plus diluted population-level impact for partial exposure when designing or analysing an A/B test. Call with metricType, holdout, and exposed; optional exposureRate,...
Get alerted when this changes. Email the moment software.brainiac/experimentation drifts, dies, or revives.

Status badge

Toolpin status badge for software.brainiac/experimentation

[![Toolpin](https://toolpin.dev/badge/software.brainiac/experimentation.svg)](https://toolpin.dev/servers/software.brainiac/experimentation)

Maintain this server? Add the badge to your README. It links your users to this live status page.