dylan patel

Inference could absorb multiple percentage points of global GDP as token consumption becomes embedded across economic activity. Continued software and model optimization is simultaneously cutting equivalent-quality inference costs by roughly 60 times per year, expanding viable use cases.

Optimizing hardware, systems software and model architecture independently can produce incremental gains, but designing them together can turn several twofold improvements into a hundredfold result. This favors vertically coordinated labs and semiconductor platforms over isolated point solutions.

Twenty gigawatts of compute should come online this year and more than thirty next year, yet model improvements are expanding the pool of economically valuable tasks even faster. The compute crunch persists while capability growth outpaces capacity deployment.

A single researcher improving training efficiency by 5% saves 5% across the entire inference fleet, making nine-figure compensation economically rational. Talent concentration creates winner-take-all dynamics where process knowledge in few hands determines competitive outcomes.

Next-gen chips (MI455X, Vera Rubin, Jaguar Shores) standardize on HBM4 with 20+ TB/s bandwidth, while Qualcomm's AI 250 pursues compute-near-memory with LPDDR6 — memory bandwidth and capacity becoming the primary differentiation vector for 2026-2027 AI accelerators.

Training and inference demand drives 1-10 GW campus builds costing $50-500B each, creating a new asset class where power, land, and permitting — not just GPUs — are the binding constraints.

Anthropic grew from $1B to $7-8B ARR in months via code generation (Cursor, Copilot, Windsurf) — the $2T software engineer wage pool creates infinite demand for models that match senior engineer capability.

Frontier model labs (Anthropic, OpenAI) are seeing revenue grow 4-5x while compute scales slower, driving gross margins from 30% to 72%+; enterprise customers are rate-limited and willing to pay 5-10x for premium models (Mythos), creating structural scarcity of high-value tokens.