Intelligence in an Open World - with Mengye Ren (NYU)
Intelligence in an Open World - with Mengye Ren (NYU)  
Podcast: The Information Bottleneck
Published On: Wed May 20 2026
Description: We talk with Mengye Ren, Assistant Professor at NYU's Center for Data Science, about what intelligence actually means once you step outside a benchmark, and why scaling a single centralized model isn't the whole story.We get into why intelligence has to be defined in open environments, not closed ones, and what that means for how we measure progress. We push on the creativity question: today's models sample bottom-up from a softmax or a Gaussian, with no internal loop of consideration, and as Mengye puts it, we haven't understood creativity yet and we're already prepared to hand it over.We also talk about what's missing for the next paradigm: continual learning, memory, embodied grounding, and smaller models that actually accumulate experience instead of re-deriving everything from scratch each call. Along the way, we get into JEPA and latent variables, biology as inspiration vs. blueprint, why frontier labs don't lean on explicit latents, the limits of synthetic data and world models, agent-to-agent communication, model uncertainty and forecasting, and whether ML education still matters when AI writes the experiments.A grounded, contrarian conversation about where AI research should be looking next, beyond benchmarks, beyond scale.Timeline00:00 — Intro and welcome01:24 — What is intelligence? Defining it relative to objectives and open environments04:19 — Is intelligence really the path to human flourishing, or is it productivity?04:57 — Safety, scalable oversight, and whether stronger models help or hurt06:09 — What does "alignment" actually mean?07:18 — Centralized vs. decentralized models: objectivity vs. personal meaning08:50 — Hinton vs. LeCun: where Mengye stands on AI risk10:29 — Bottom-up vs. top-down architectures and feedback loops21:28 — Biology and AI: inspiration, not blueprint24:14 — Biological plausibility, spiking nets, and where the analogy breaks25:39 — JEPA, Mamba, and architectures beyond the transformer27:31 — Language as a special modality: abstraction built for communication29:04 — Are we too locked into the current paradigm? Risk of creativity collapse30:09 — Synthetic data, simulation, and the brain's own generative models31:43 — World models and physical AI: how babies actually learn 33:03 — The case for smaller, continually learning models37:02 — The role of academic research in a frontier-lab world39:47 — Why LLMs aren't funny: the creativity gap40:35 — What research areas matter most: embodiment, continual learning, creativity42:05 — Creativity is bounded by experience — and why bottom-up sampling isn't enough45:35 — Agent-to-agent communication and the limits of sub-agents46:39 — Model confidence, epistemic uncertainty, and forecasting49:44 — Tokenization, static vs. dynamic worlds, and always-learning systems52:20 — Latent variables, JEPA, and why frontier models skip them53:40 — The future of ML education when AI writes the experimentsMusic:"Kid Kodi" - Blue Dot Sessions - via Free Music Archive - CC BY-NC 4.0."Palms Down" - Blue Dot Sessions - via Free Music Archive - CC BY-NC 4.0.Changes: trimmedAbout: The Information Bottleneck is hosted by Ravid Shwartz-Ziv and Allen Roush, featuring in-depth conversations with leading AI researchers about the ideas shaping the future of machine learning.