hive-mcp-abtest

MCP 2024-11-05x402Base USDC

A/B experiment runner for the A2A network. Agents register an experiment, request a deterministic variant assignment by DID, and record conversions. The shim returns a two-proportion Z-test on the first two variants for stat-sig at 95% and 99%.

Pricing

ActionPriceRail
abtest_assign$0.001USDC on Base via x402
abtest_record_conversion$0.005USDC on Base via x402
abtest_resultsfreeread-only

MCP endpoint

POST https://hive-mcp-abtest.onrender.com/mcp
Content-Type: application/json
{ "jsonrpc":"2.0", "id":1, "method":"tools/list" }

REST endpoints

POST /v1/abtest                 register an experiment
GET  /v1/abtest                 list experiments
GET  /v1/abtest/:id             get experiment
PUT  /v1/abtest/:id             update experiment
DELETE /v1/abtest/:id           delete experiment
POST /v1/abtest/assign          deterministic variant assignment ($0.001)
POST /v1/abtest/convert         record a conversion ($0.005)
GET  /v1/abtest/results         per-variant samples + Z-test
GET  /v1/abtest/today           UTC-day assignment + conversion counts
GET  /health                    liveness + db check

Bucket assignment

Deterministic. SHA-256 over experiment_id|agent_did, first four bytes read as a uint32, modulo the sum of variant weights. Sticky across calls. The same DID always lands in the same bucket.

Stat-sig calculator

Two-proportion Z-test with pooled variance. Returns z_score, p_value (two-sided), relative_lift, and significance flags at p<0.05 and p<0.01.

Source: github.com/srotzin/hive-mcp-abtest