patrick wendell

Enterprises adopting AI coding agents (Cursor, Codex, etc.) face unbounded consumption costs growing exponentially despite 2x productivity gains. Databricks built Unity AI gateway: smart routing to cheaper/efficient models (30% savings), rapid model switching (weekly), and productized the routing layer as asset-light SaaS. Deflationary model improvements + routing = sustainable economics.

Databricks' internal deployment across 10,000+ employees proves AI coding agents are the highest-ROI GenAI use case. Unity AI Gateway's dynamic routing across open/closed models maintains quality while flattening exponential cost curves — a replicable enterprise pattern.

Databricks' internal rollout shows coding agents double developer output, but unbounded token consumption requires active model routing (30% savings), rapid adoption of efficient new models, and the Unity AI gateway product — a growing market with low fixed costs.

As foundation models commoditize (new efficiency frontier weekly), the value accrues to routing layers (Databricks Unity AI gateway, OpenRouter) that automatically direct tasks to optimal cost/quality models. No GPU capex needed; pure software IP in benchmarking, switching, and developer experience. Every enterprise faces this problem.