Lab 11: Shadow Routing Comparator

Series: AI Eval Labs · Phase: Production Pipelines · Depends on: Lab 01, Lab 02

Core scope

• [ ] Proxy mirroring a sample of simulated traffic to a candidate model
• [ ] Diff trajectories between current and candidate
• [ ] Auto-generate a cost/quality report

Stretch

• [ ] Configurable sampling and canary percentage

Links

• Code: series/ai-eval/11-shadow-routing
• Demo: coming soon
• Write-up: coming soon on markrox.ai