$CORE-AUTOMATION · Core Automation founders bet on test-time learning architectures to replace transformers

episode briefing

extracted intelligence

Sequoia Capital

Building the Automated AGI Lab: Core Automation's Jerry Tworek and Rohan Anil

now viewing▶ 39:41

Core Automation founders bet on test-time learning architectures to replace transformers

2026-07-29 · 1 company · 5 thematic

sentiment

1 bull0 bear0 neu

speakers

rohan anil

One of four pre-training leads for Google's Gemini; worked on fundamental AI research at Google Brain and Anthropic; developed the Shampoo optimizer and N-gram memory architectures; focuses on training algorithm optimization and hardware-software co-design.

quote

“Kernel automation is a lab created to build models that continuously learn and then learn from deployment. We believe as I mentioned that transformers are incapable of continual learning. There there's no way how to put continual learning…”

—rohan anil

now playing · $CORE-AUTOMATION

$CORE-AUTOMATIONbullish· high· posrohan anil

Core Automation founders bet on test-time learning architectures to replace transformers

Transformers fundamentally cannot learn continuously at test time; new architectures enabling continual learning on real-world distributions are needed, and Core Automation is bui…