TickerTain
TickerTain
NewsroomShortsPortfolioConvergence
NewsroomShortsPortfolioConvergence
←
▶ 9:06 · AI Infrastructure · Evals and observability create a compounding data flywheel for agent improvement
episode briefing
Sequoia Capital

Own Your Harness, Own Your Intelligence | Harrison Chase, LangChain

2026-08-13 · 5 company · 7 thematic
sentiment
2 bull0 bear3 neu
speakers
harrison chase

Co-founded LangChain three years ago; the open-source framework has over a billion downloads and provides tools for building LLM applications, agents (LangGraph, Deep Agents), and observability/evaluation platform (LangSmith).

now playing · AI Infrastructure
AI Agentstailwindscore 9/10harrison chase
Agent harness ownership is the key to compounding organizational intelligence
Harrison argues that enterprises must own all three components of agent intelligence — model, context, and harness — with the harness as the critical orchestration layer. He presents a spec…
AI Agentstailwindscore 8/10harrison chase
Agent harnesses evolve from simple loops to customizable middleware stacks
All AI agents share a core LLM-loop architecture, but competitive differentiation comes from customizing the harness via middleware (hooks, plugins) for domain-specific needs like memory, s…
AI Infrastructuretailwindscore 9/10harrison chase
Evals and observability create a compounding data flywheel for agent improvement
Private benchmarks (Harbor), trajectory observability (LangSmith), and automated trace curation (LangSmith Engine) form a closed loop where production data continuously improves the harness…
Open Source AItailwindscore 7/10harrison chase
Harbor emerging as open-source standard for agent eval benchmarking
Harbor, an open-source eval runner from the Terminal Bench 2 team, is becoming the industry standard for defining domain-specific benchmarks. It enables sandboxed, parallel task execution w…
Developer Toolstailwindscore 7/10harrison chase
Harbor emerges as open-standard eval runner for agent benchmarking
Harbor, an open-source eval framework from the Terminal Bench creators, is becoming the industry standard for defining sandboxed agent tasks with verifiers, enabling systematic comparison o…
Enterprise AI Adoptiontailwindscore 7/10harrison chase
Financial services demand predictable custom cognitive architectures over general agents
Harrison reveals that financial services customers reject general-purpose agents (like Deep Agents) as 'too scary' and require custom cognitive architectures with explicit gates and checks…
Enterprise AI Adoptiontailwindscore 7/10harrison chase
Financial services demand predictable cognitive architectures over general agents
Regulated enterprises require deterministic, controllable agent flows — favoring bespoke cognitive architectures with explicit gates over flexible general-purpose harnesses like Deep Agents…