Richard Ho is the Vice President of Hardware at OpenAI, overseeing the design of custom AI chips like Jalapeno.
no scored calls yet — needs a stated position or a categorical verdict, with a matured window vs SPY
OpenAI's first custom inference chip (Jalapeno) uses a blank-slate HBM4+SRAM architecture to achieve high throughput and ultra-low latency simultaneously, reducing data movement; developed with Broadcom and TSMC, it aims to lower infrastructure cost per token by ~1.8x as part of a multi-generational roadmap.