A New Era of Context Memory with Val Bercovici from WEKA
A New Era of Context Memory with Val Bercovici from WEKA  
Podcast: Semi Doped
Published On: Fri Feb 06 2026
Description: Vik and Val Bercovici discuss the evolution of storage solutions in the context of AI, focusing on Weka's innovative approaches to context memory, high bandwidth flash, and the importance of optimizing GPU usage. Val shares insights from his extensive experience in the storage industry, highlighting the challenges and advancements in memory requirements for AI models, the significance of latency, and the future of storage technologies.TakeawaysContext memory is crucial for AI performance.The demand for memory has drastically increased.Latency issues can hinder AI efficiency.High bandwidth flash offers new storage capabilities.Weka's Axon software enhances GPU storage utilization.Token warehouses can significantly reduce costs.Augmented memory grids improve memory access speeds.Networking innovations are essential for AI storage solutions.Understanding memory hierarchies is vital for optimization.The future of storage will involve more advanced technologies.Chapters00:00 Introduction to Weka and AI Storage Solutions05:18 The Evolution of Context Memory in AI09:30 Understanding Memory Hierarchies and Their Impact16:24 Latency Challenges in Modern Storage Solutions21:32 The Role of Networking in AI Storage Efficiency29:42 Dynamic Resource Utilization in AI Networks30:04 Introducing the Context Memory Network31:13 High Bandwidth Flash: A Game Changer32:54 Weka's Neural Mesh and Storage Solutions35:01 Axon: Transforming GPU Storage into Memory39:00 Augmented Memory Grid Explained42:00 Pooling DRAM and CXL Innovations46:02 Token Warehouses and Inference Economics52:10 The Future of Storage InnovationsResourcesManus AI $2B Blog: https://manus.im/blog/Context-Engineering-for-AI-Agents-Lessons-from-Building-ManusAlso listen to this podcast on your favorite platform. https://www.semidoped.fm/Check out Vik's Substack: https://www.viksnewsletter.com/Check out Austin's Substack: https://www.chipstrat.com/