
YouTube
The Pragmatic Engineer
Uber's AI infra, from the inside
Uber's AI infra, from the inside
Core points (3)
- Every model request passes one gateway where five guard models enforce policy, billing and audit.
- A context graph with 100+ node types grounds every agent answer, raising quality while cutting cost.
- Background agents produce 15% of production PRs, yet humans review every single one.

