OpenAI’s Jalapeño! Feeling Hot Hot Hot!
OpenAI’s Jalapeño! Feeling Hot Hot Hot!  
Podcast: Semi Doped
Published On: Thu Aug 27 2026
Description: Austin and Vik react to OpenAI's Jalapeño announcement at Hot Chips. Plus extra spicy questions like should OpenAI sell it, how much of this was AI-written RTL, and where is Anthropic's chip?Key Takeaways:- The chip's core design philosophy is "dark silicon is cheaper than idle accelerators" — using one balanced chip and power-gating unused blocks is more efficient than a two-chip (e.g. GPU + LPU) solution.- The unprecedented nine-month RTL-to-tapeout cycle was enabled by AI for EDA tools, serving as a wake-up call that small, expert teams can now develop Rubin-class chips in under a year.- Jalapeño's key innovation is a NUMA-style architecture that gives each accelerator a local HBM slice, solving the memory contention that throttles performance in unified memory systems.- OpenAI chose Broadcom's ESUN for its scale-up network to connect 128 chips in the rack at 600 GB/s and up to 2,048 chips across 16 racks at 200G --- all scale up!- The design's "regret factor" principle justifies generality — the opportunity cost of being unable to support a future model is far higher than the marginal cost of adding hardware flexibility upfront.Chapters:0:00 Hot Chips Reaction2:32 Designing for User Experience11:16 A Generalized Inference Chip14:18 The Foundry-IDM Analogy18:42 The 'Regret Factor'21:02 The 9-Month Design Cycle23:45 Challenging the Two-Chip Solution35:08 Solving HBM Underutilization36:46 The NUMA Architecture Solution39:28 System-Level ESUN Networking42:06 Dark Silicon vs. Idle Accelerators49:08 A Wake-Up Call for the Industry52:59 Where's Anthropic's Chip?Follow Chipstrat:Newsletter: https://www.chipstrat.comX: https://x.com/chipstratFollow Vik:Newsletter: https://www.viksnewsletter.com/X: https://x.com/vikramskrFollow Semi Doped:Get more of Austin and Vik daily, free: https://daily.semidoped.com/