AgentRoute / v0.2 / launch showcase
Prove every route.
One deterministic workspace from frozen routing receipts through measured replay, preregistered promotion, operational SLOs, resilience review, and longitudinal evidence.
Illustrative offline conformance evidence — not a live model benchmark or provider-performance claim.
passexperiment decision
passquality gate
eligiblepromotion / no apply
attentionoperations assessment
2hash-chained reviews
10/10connectors fully ready
Open the product
Why attention can be healthy
The experiment and quality gate support the proposed policy, while the provider-outage scenario still changes all twelve routes to their recorded fallback. AgentRoute keeps that operational impact visible instead of turning an eligible promotion into an unconditional “safe” claim.
Preregistered checks
| Scope | Metric | Status | Evidence |
|---|---|---|---|
| global | matched_pairs | pass | global matched pairs: 12; minimum 12 |
| global | mean_quality_delta | pass | global challenger mean quality delta: -0.009167; minimum -0.02 |
| global | quality_win_rate_95ci_low | pass | global challenger quality win-rate 95% lower bound: 0.051368; minimum 0 |
| global | mean_latency_delta_ms | pass | global challenger mean latency delta ms: -890.833333; maximum 0 |
| global | mean_cost_delta_usd | pass | global challenger mean cost delta USD: -0.0255; maximum 0 |
| global | success_rate_delta | pass | global challenger success-rate delta: 0; minimum 0 |
| task_type:code_review | matched_pairs | pass | task_type:code_review matched pairs: 3; minimum 3 |
| task_type:code_review | mean_quality_delta | pass | task_type:code_review challenger mean quality delta: -0.016667; minimum -0.02 |
| task_type:code_review | quality_win_rate_95ci_low | pass | task_type:code_review challenger quality win-rate 95% lower bound: 0; minimum 0 |
| task_type:code_review | mean_latency_delta_ms | pass | task_type:code_review challenger mean latency delta ms: -936.666667; maximum 0 |
| task_type:code_review | mean_cost_delta_usd | pass | task_type:code_review challenger mean cost delta USD: -0.028667; maximum 0 |
| task_type:code_review | success_rate_delta | pass | task_type:code_review challenger success-rate delta: 0; minimum 0 |
| task_type:research | matched_pairs | pass | task_type:research matched pairs: 3; minimum 3 |
| task_type:research | mean_quality_delta | pass | task_type:research challenger mean quality delta: -0.003333; minimum -0.02 |
| task_type:research | quality_win_rate_95ci_low | pass | task_type:research challenger quality win-rate 95% lower bound: 0.061492; minimum 0 |
| task_type:research | mean_latency_delta_ms | pass | task_type:research challenger mean latency delta ms: -1080; maximum 0 |
| task_type:research | mean_cost_delta_usd | pass | task_type:research challenger mean cost delta USD: -0.029333; maximum 0 |
| task_type:research | success_rate_delta | pass | task_type:research challenger success-rate delta: 0; minimum 0 |
| task_type:security | matched_pairs | pass | task_type:security matched pairs: 3; minimum 3 |
| task_type:security | mean_quality_delta | pass | task_type:security challenger mean quality delta: -0.013333; minimum -0.02 |
| task_type:security | quality_win_rate_95ci_low | pass | task_type:security challenger quality win-rate 95% lower bound: 0; minimum 0 |
| task_type:security | mean_latency_delta_ms | pass | task_type:security challenger mean latency delta ms: -950; maximum 0 |
| task_type:security | mean_cost_delta_usd | pass | task_type:security challenger mean cost delta USD: -0.029; maximum 0 |
| task_type:security | success_rate_delta | pass | task_type:security challenger success-rate delta: 0; minimum 0 |
| task_type:summarization | matched_pairs | pass | task_type:summarization matched pairs: 3; minimum 3 |
| task_type:summarization | mean_quality_delta | pass | task_type:summarization challenger mean quality delta: -0.003333; minimum -0.02 |
| task_type:summarization | quality_win_rate_95ci_low | pass | task_type:summarization challenger quality win-rate 95% lower bound: 0.094531; minimum 0 |
| task_type:summarization | mean_latency_delta_ms | pass | task_type:summarization challenger mean latency delta ms: -596.666667; maximum 0 |
| task_type:summarization | mean_cost_delta_usd | pass | task_type:summarization challenger mean cost delta USD: -0.015; maximum 0 |
| task_type:summarization | success_rate_delta | pass | task_type:summarization challenger success-rate delta: 0; minimum 0 |
Evidence chain
- Frozen inputs generate full-fidelity baseline and proposed routing ledgers.
- Fixture-only replay measures both candidates under hard request and cost limits.
- The experiment, quality gate, drift contract, and routing SLO are evaluated independently.
- The dossier compiles review-only vendor configurations; it never applies them.
- The outage scenario uses only recorded fallback evidence and calls no provider.
- The operations review, reliability timeline, capsule, and manifest bind the complete sanitized result.
All 31 bound artifacts
- input-cases.json
- input-experiment-protocol.json
- input-candidate-policy.json
- input-quality-gate.json
- input-operations-drift.json
- input-routing-slo.json
- input-resilience-scenario.json
- input-route-ledger.jsonl
- input-replay-tasks.json
- input-replay-fixtures.json
- operations-baseline.route.jsonl
- operations-current.route.jsonl
- inputs.json
- replay.route.jsonl
- arena-report.json
- experiment-decision.json
- quality-gate.json
- promotion.arpromote
- promotion-verification.json
- evidence.arcap
- capsule-verification.json
- otel-genai.json
- openinference.json
- connector-catalog.json
- operations.arops
- operations-verification.json
- operations-review.html
- reliability.arhistory
- reliability-verification.json
- reliability.html
Integrity anchors
Experiment: sha256:02e66478272850dfad98c9de61fb002dbf1b4ceb66e273b038f6c92dbf069aa5
Dossier: sha256:cfe6b2e003d0749fa6d2ddcd747585f61aff8a35e489c959fa66e4fb896c1532
Operations: sha256:8bb2a7620b99c58bf974c6bb6659ac66667dd394f0dfd1a6481206b27a9be7b9
Timeline: sha256:95d3121b11a02cdae58cb06d2c560ff08c8b52f514b70a73ca4b05a46077c4e9
Capsule: sha256:6fd0bef82d17ab0e7e8e5c3d16158620f12e0bac1921d9b7b6ad3beb8fb56a0e
Dossier: sha256:cfe6b2e003d0749fa6d2ddcd747585f61aff8a35e489c959fa66e4fb896c1532
Operations: sha256:8bb2a7620b99c58bf974c6bb6659ac66667dd394f0dfd1a6481206b27a9be7b9
Timeline: sha256:95d3121b11a02cdae58cb06d2c560ff08c8b52f514b70a73ca4b05a46077c4e9
Capsule: sha256:6fd0bef82d17ab0e7e8e5c3d16158620f12e0bac1921d9b7b6ad3beb8fb56a0e