"The Cognitive Revolution" | AI Builders, Researchers, and Live Player Analysis
"The Cognitive Revolution" | AI Builders, Researchers, and Live Player Analysis

A biweekly podcast where hosts Nathan Labenz and Erik Torenberg interview the builders on the edge of AI and explore the dramatic shift it will unlock in the coming years. The Cognitive Revolution is part of the Turpentine podcast network. To learn more: turpentine.co

Emmett Shear and Séb Krier debate whether today’s AI alignment paradigm—focused on control and instruction-following—is fundamentally flawed. PSA for AI builders: Interested in alignment, governance, or AI safety? Learn more about the MATS Summer 2026 Fellowship and submit your name to be notified when applications open: https://matsprogram.org/s26-tcr. They explore what changes if advanced AIs are better understood as beings with their own values, and why current control methods could drift toward something like slavery. The conversation dives into “organic alignment,” multi-agent simulations, evolving cooperation, and the possibility of AI moral standing as systems gain memory and continual learning. Sponsors: MATS: MATS is a fully funded 12-week research program pairing rising talent with top mentors in AI alignment, interpretability, security, and governance. Apply for the next cohort at https://matsprogram.org/s26-tcr Tasklet: Tasklet is an AI agent that automates your work 24/7; just describe what you want in plain English and it gets the job done. Try it for free and use code COGREV for 50% off your first month at https://tasklet.ai Agents of Scale: Agents of Scale is a podcast from Zapier CEO Wade Foster, featuring conversations with C-suite leaders who are leading AI transformation. Subscribe to the show wherever you get your podcasts Shopify: Shopify powers millions of businesses worldwide, handling 10% of U.S. e-commerce. With hundreds of templates, AI tools for product descriptions, and seamless marketing campaign creation, it's like having a design studio and marketing team in one. Start your $1/month trial today at https://shopify.com/cognitive CHAPTERS: (00:00) About the Episode (03:44) Defining organic AI alignment (14:48) Technical vs value alignment (Part 1) (19:55) Sponsors: MATS | Tasklet (22:56) Technical vs value alignment (Part 2) (Part 1) (31:34) Sponsors: Agents of Scale | Shopify (34:21) Technical vs value alignment (Part 2) (Part 2) (34:22) Labs, tools, and beings (43:22) AI personhood and consciousness (56:53) Safe futures and Softmax (01:04:17) Chatbots, mirrors, simulations (01:10:14) Doom, futures, and OpenAI (01:17:25) Outro PRODUCED BY: https://aipodcast.ing SOCIAL LINKS: Website: https://www.cognitiverevolution.ai Twitter (Podcast): https://x.com/cogrev_podcast Twitter (Nathan): https://x.com/labenz LinkedIn: https://linkedin.com/in/nathanlabenz/ Youtube: https://youtube.com/@CognitiveRevolutionPodcast Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431 Spotify: https://open.spotify.com/show/6yHyok3M3BjqzR0VB5MSyk
Kathleen Fisher and Byron Cook dive into automated reasoning and formal verification as tools for building truly secure software systems. PSA for AI builders: Interested in alignment, governance, or AI safety? Learn more about the MATS Summer 2026 Fellowship and submit your name to be notified when applications open: https://matsprogram.org/s26-tcr. They explain how formal methods can harden critical infrastructure against AI-enabled cyberattacks, and how assumptions, specifications, and proofs combine to deliver real security guarantees. The conversation explores using these techniques to train coding models, enable a “great software rewrite,” and power AWS’s new automated reasoning checks for AI agents and policy compliance. Sponsors: MATS: MATS is a fully funded 12-week research program pairing rising talent with top mentors in AI alignment, interpretability, security, and governance. Apply for the next cohort at https://matsprogram.org/s26-tcr Tasklet: Tasklet is an AI agent that automates your work 24/7; just describe what you want in plain English and it gets the job done. Try it for free and use code COGREV for 50% off your first month at https://tasklet.ai Agents of Scale: Agents of Scale is a podcast from Zapier CEO Wade Foster, featuring conversations with C-suite leaders who are leading AI transformation. Subscribe to the show wherever you get your podcasts Shopify: Shopify powers millions of businesses worldwide, handling 10% of U.S. e-commerce. With hundreds of templates, AI tools for product descriptions, and seamless marketing campaign creation, it's like having a design studio and marketing team in one. Start your $1/month trial today at https://shopify.com/cognitive CHAPTERS: (00:00) About the Episode (04:52) AI Reshapes Cybersecurity (10:16) Formal Methods Foundations (17:46) Security Properties Assumptions (Part 1) (21:27) Sponsors: MATS | Tasklet (24:27) Security Properties Assumptions (Part 2) (28:31) Helicopter Formal Verification (38:15) Proof Confidence And AWS (Part 1) (41:52) Sponsors: Agents of Scale | Shopify (44:40) Proof Confidence And AWS (Part 2) (50:33) Automated Reasoning For Policies (01:04:39) Generative AI Meets Verification (01:19:42) Securing Future AI Systems (01:31:19) Agentic Guardrails And Governance (01:40:44) Outro PRODUCED BY: https://aipodcast.ing SOCIAL LINKS: Website: https://www.cognitiverevolution.ai Twitter (Podcast): https://x.com/cogrev_podcast Twitter (Nathan): https://x.com/labenz LinkedIn: https://linkedin.com/in/nathanlabenz/ Youtube: https://youtube.com/@CognitiveRevolutionPodcast Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431 Spotify: https://open.spotify.com/show/6yHyok3M3BjqzR0VB5MSyk
This year-end live show features nine rapid-fire conversations to make sense of AI’s 2025 and what might define 2026. PSA for AI builders: Interested in alignment, governance, or AI safety? Learn more about the MATS Summer 2026 Fellowship and submit your name to be notified when applications open: https://matsprogram.org/s26-tcr. New York Assemblymember Alex Boris breaks down the RAISE Act's bid to curb catastrophic AI risks, the governor negotiations, and why a16z-backed ads are targeting him. Former White House AI adviser Dean Ball maps the emerging coalitions on AI, federal preemption, and what fast-improving coding agents could mean for policy and jobs. Forecaster Peter Wildeford debates selling vs "renting" chips to China and offers a 2026 outlook on agents, costs, and robotics. Recorded live as part of our AI 2025→2026 series (Part 2). Sponsors: Gemini 3 in Google AI Studio: Gemini 3 in Google AI Studio lets you build fully functional apps from a simple description—no coding required. Start vibe coding your idea today at https://ai.studio/build MATS: MATS is a fully funded 12-week research program pairing rising talent with top mentors in AI alignment, interpretability, security, and governance. Apply for the next cohort at https://matsprogram.org/s26-tcr Framer: Framer is the all-in-one tool to design, iterate, and publish stunning websites with powerful AI features. Start creating for free and use code COGNITIVE to get one free month of Framer Pro at https://framer.com/design Shopify: Shopify powers millions of businesses worldwide, handling 10% of U.S. e-commerce. With hundreds of templates, AI tools for product descriptions, and seamless marketing campaign creation, it's like having a design studio and marketing team in one. Start your $1/month trial today at https://shopify.com/cognitive Tasklet: Tasklet is an AI agent that automates your work 24/7; just describe what you want in plain English and it gets the job done. Try it for free and use code COGREV for 50% off your first month at https://tasklet.ai CHAPTERS: (00:00) Sponsor: Gemini 3 in Google AI Studio (00:31) RAISE Act status (04:52) Catastrophic risk focus (10:47) Super PAC backlash (16:17) Data centers and grid (19:47) Palantir and surveillance (23:42) Dean Ball joins (Part 1) (23:46) Sponsors: MATS | Framer (27:05) Dean Ball joins (Part 2) (32:00) Social media lessons (36:22) Trump preemption and chips (Part 1) (40:51) Sponsors: Shopify | Tasklet (43:59) Trump preemption and chips (Part 2) (44:50) Structural US-China decoupling (49:39) Peter on chip ban (55:43) Threat model and renting (01:02:55) Cost drops, revenue (01:16:03) Forecasting paradigm shifts (01:20:38) 2026 agents and robots (01:31:41) Show wrap and markets (01:42:28) Outro PRODUCED BY: https://aipodcast.ing
This year-end live show features nine rapid-fire conversations to make sense of AI’s 2025 and what might define 2026. PSA for AI builders: Interested in alignment, governance, or AI safety? Learn more about the MATS Summer 2026 Fellowship and submit your name to be notified when applications open: https://matsprogram.org/s26-tcr. Zvi Moshowitz maps the OpenAI–Anthropic–Google race, the denialism gap, and why his PDoom is still ~60–70%. Greg (ARC-AGI Prize), Eugenia Kuyda, Ali Behrouz, Logan Kirkpatrick, and Jungwon Hwang cover sample-efficient benchmarks and ARC-AGI 3, companions and human-flourishing metrics, continual-learning memory, Gemini 3 Flash for developers, and AI for scientific decisions. Sponsors: Gemini 3 in Google AI Studio: Gemini 3 in Google AI Studio lets you build fully functional apps from a simple description—no coding required. Start vibe coding your idea today at https://ai.studio/build MATS: MATS is a fully funded 12-week research program pairing rising talent with top mentors in AI alignment, interpretability, security, and governance. Apply for the next cohort at https://matsprogram.org/s26-tcr Framer: Framer is the all-in-one tool to design, iterate, and publish stunning websites with powerful AI features. Start creating for free and use code COGNITIVE to get one free month of Framer Pro at https://framer.com/design Shopify: Shopify powers millions of businesses worldwide, handling 10% of U.S. e-commerce. With hundreds of templates, AI tools for product descriptions, and seamless marketing campaign creation, it's like having a design studio and marketing team in one. Start your $1/month trial today at https://shopify.com/cognitive Tasklet: Tasklet is an AI agent that automates your work 24/7; just describe what you want in plain English and it gets the job done. Try it for free and use code COGREV for 50% off your first month at https://tasklet.ai CHAPTERS: (00:00) Sponsor: Gemini 3 in Google AI Studio (00:31) Live show experiment (02:26) Zvi: discourse and denial (13:28) Continual learning and doom (22:05) ArcAGI: what's missing (Part 1) (22:09) Sponsors: MATS | Framer (25:28) ArcAGI: what's missing (Part 2) (31:58) Scaffolds and tiny models (38:58) ArcAGI 3 game worlds (45:13) AI companions landscape (Part 1) (45:21) Sponsors: Shopify | Tasklet (48:29) AI companions landscape (Part 2) (58:14) Wabi apps and caution (01:08:16) Nested learning, layered memory (01:23:14) Gemini 3 Flash launch (01:34:09) RAG, agents, dev advice (01:42:20) Elicit speeds evidence synthesis (01:57:57) Outro PRODUCED BY: https://aipodcast.ing
Andy Masley on AI energy and water use unpacks common myths and brings an Effective Altruism lens to the debate. PSA for AI builders: Interested in alignment, governance, or AI safety? Learn more about the MATS Summer 2026 Fellowship and submit your name to be notified when applications open: https://matsprogram.org/s26-tcr. You’ll get memorable heuristics—one ChatGPT query ≈ running a microwave for one second; 10,000 queries ≈ a cross-town car trip, burger, or hot shower—and clear comparisons about data center power, solar land area, and an estimated 80 GW buildout. We also cover local impacts, water trade-offs, uncertainty drivers, and why AI’s global resource footprint is smaller than many fear while noting where caution is still warranted. LINKS: Andy Masley Substack homepage Power Hungry Processing paper PDF Energy Efficiency AI Benchmarks PDF Deep neural network energy paper Gemini Deep Research report ChatGPT 5.1 Pro report Claude Opus 4.5 report Altman “The Gentle Singularity” SemiAnalysis AI datacenter energy dilemma Epoch OpenAI compute spend Dean Ball Out of Thin Air Sponsors: Framer: Framer is the all-in-one tool to design, iterate, and publish stunning websites with powerful AI features. Start creating for free and use code COGNITIVE to get one free month of Framer Pro at https://framer.com/design Agents of Scale: Agents of Scale is a podcast from Zapier CEO Wade Foster, featuring conversations with C-suite leaders who are leading AI transformation. Subscribe to the show wherever you get your podcasts Tasklet: Tasklet is an AI agent that automates your work 24/7; just describe what you want in plain English and it gets the job done. Try it for free and use code COGREV for 50% off your first month at https://tasklet.ai Shopify: Shopify powers millions of businesses worldwide, handling 10% of U.S. e-commerce. With hundreds of templates, AI tools for product descriptions, and seamless marketing campaign creation, it's like having a design studio and marketing team in one. Start your $1/month trial today at https://shopify.com/cognitive PRODUCED BY: https://aipodcast.ing
Max Tegmark and Dean Ball debate whether we should ban the development of superintelligence in a crossover episode from Doom Debates hosted by Liron Shapira. PSA for AI builders: Interested in alignment, governance, or AI safety? Learn more about the MATS Summer 2026 Fellowship and submit your name to be notified when applications open: https://matsprogram.org/s26-tcr. They unpack the Future of Life Institute's call for a moratorium until there is broad scientific consensus and public buy-in, contrasting Tegmark’s precautionary stance with Dean’s emphasis on experimentation, competition, and practical policy hurdles. Listeners will get clear takes on p(doom), the limits of FDA-style regulation, unilateral ban risks, and what safe, beneficial advanced AI might realistically look like. LINKS: AMA episode feedback survey form Doom Debates Substack newsletter Sponsors: Framer: Framer is the all-in-one tool to design, iterate, and publish stunning websites with powerful AI features. Start creating for free and use code COGNITIVE to get one free month of Framer Pro at https://framer.com/design Agents of Scale: Agents of Scale is a podcast from Zapier CEO Wade Foster, featuring conversations with C-suite leaders who are leading AI transformation. Subscribe to the show wherever you get your podcasts Tasklet: Tasklet is an AI agent that automates your work 24/7; just describe what you want in plain English and it gets the job done. Try it for free and use code COGREV for 50% off your first month at https://tasklet.ai Shopify: Shopify powers millions of businesses worldwide, handling 10% of U.S. e-commerce. With hundreds of templates, AI tools for product descriptions, and seamless marketing campaign creation, it's like having a design studio and marketing team in one. Start your $1/month trial today at https://shopify.com/cognitive PRODUCED BY: https://aipodcast.ing CHAPTERS: (00:00) About the Episode (05:43) Cold open and intro (09:21) Opening statements: ban debate (Part 1) (14:49) Sponsors: Framer | Agents of Scale (17:11) Opening statements: ban debate (Part 2) (17:11) Licensing-style AI regulation (26:52) Liability, tail risks (Part 1) (33:24) Sponsors: Tasklet | Shopify (36:32) Liability, tail risks (Part 2) (39:23) Timelines and precautionary regulation (47:03) Defining superintelligence and risk (52:26) Risk-based safety standards (56:28) Current regulations and definitions (01:05:23) Max's doom scenario (01:19:46) P-doom gap and adaptation (01:34:40) National security and China (01:43:57) Closing statements and reflections (01:55:22) Host debrief and outro (02:02:10) Outro
Marek Kozlowski, Head of the AI Lab at Poland's National Information Processing Institute, discusses project PLLuM (Polish Large Language Models). PSA for AI builders: Interested in alignment, governance, or AI safety? Learn more about the MATS Summer 2026 Fellowship and submit your name to be notified when applications open: https://matsprogram.org/s26-tcr. He shares how countries like Poland can achieve AI sovereignty by training small, locally-adapted models for specific languages and cultures, ensuring control, privacy, and cost advantages. The conversation delves into challenges like frontier models' English bias, EU regulations, and technical strategies like "Language Adaptation" on base models. Discover how transparently created, locally-controlled AI offers a viable path for nations to maintain their technological destiny. LINKS: National Information Processing Institute Show notes source with images PLLuM open chat service Sponsors: Google AI Studio: Google AI Studio features a revamped coding experience to turn your ideas into reality faster than ever. Describe your app and Gemini will automatically wire up the right models and APIs for you at https://ai.studio/build Agents of Scale: Agents of Scale is a podcast from Zapier CEO Wade Foster, featuring conversations with C-suite leaders who are leading AI transformation. Subscribe to the show wherever you get your podcasts Framer: Framer is the all-in-one platform that unifies design, content management, and publishing on a single canvas, now enhanced with powerful AI features. Start creating for free and get a free month of Framer Pro with code COGNITIVE at https://framer.com/design Tasklet: Tasklet is an AI agent that automates your work 24/7; just describe what you want in plain English and it gets the job done. Try it for free and use code COGREV for 50% off your first month at https://tasklet.ai Shopify: Shopify powers millions of businesses worldwide, handling 10% of U.S. e-commerce. With hundreds of templates, AI tools for product descriptions, and seamless marketing campaign creation, it's like having a design studio and marketing team in one. Start your $1/month trial today at https://shopify.com/cognitive PRODUCED BY: https://aipodcast.ing CHAPTERS: (00:00) Sponsor: Google AI Studio (00:31) About the Episode (03:17) Sovereign AI in Poland (04:41) The Case for Localization (13:38) The PLUME Project's Mission (Part 1) (20:25) Sponsors: Agents of Scale | Framer (22:47) The PLUME Project's Mission (Part 2) (22:47) Defining Polish AI Values (35:32) Sourcing and Curating Data (Part 1) (35:38) Sponsors: Tasklet | Shopify (38:46) Sourcing and Curating Data (Part 2) (44:40) Small Models, Big Advantage (58:21) Training and Domain Adaptation (01:12:22) Compute, Talent, and Geopolitics (01:22:50) Forming International AI Alliances (01:27:41) Decentralized AI and Conclusion (01:31:47) Outro
This special ChinaTalk cross-post features Zixuan Li of Z.ai (Zhipu AI), exploring the culture, incentives, and constraints shaping Chinese AI development. PSA for AI builders: Interested in alignment, governance, or AI safety? Learn more about the MATS Summer 2026 Fellowship and submit your name to be notified when applications open: https://matsprogram.org/s26-tcr. The discussion covers Z.ai's powerful GLM 4.6 model, their open weights strategy as a marketing tactic, and unique Chinese AI use cases like "role-play." Gain insights into the rapid pace of innovation, the talent market, and how Chinese companies view their position relative to global AI leaders. Sponsors: Google AI Studio: Google AI Studio features a revamped coding experience to turn your ideas into reality faster than ever. Describe your app and Gemini will automatically wire up the right models and APIs for you at https://ai.studio/build Agents of Scale: Agents of Scale is a podcast from Zapier CEO Wade Foster, featuring conversations with C-suite leaders who are leading AI transformation. Subscribe to the show wherever you get your podcasts Framer: Framer is the all-in-one platform that unifies design, content management, and publishing on a single canvas, now enhanced with powerful AI features. Start creating for free and get a free month of Framer Pro with code COGNITIVE at https://framer.com/design Tasklet: Tasklet is an AI agent that automates your work 24/7; just describe what you want in plain English and it gets the job done. Try it for free and use code COGREV for 50% off your first month at https://tasklet.ai Shopify: Shopify powers millions of businesses worldwide, handling 10% of U.S. e-commerce. With hundreds of templates, AI tools for product descriptions, and seamless marketing campaign creation, it's like having a design studio and marketing team in one. Start your $1/month trial today at https://shopify.com/cognitive PRODUCED BY: https://aipodcast.ing CHAPTERS: (00:00) Sponsor: Google AI Studio (00:31) About the Episode (03:44) Introducing Z.AI (07:07) Drupu AI's Backstory (09:38) Achieving Global Recognition (Part 1) (12:53) Sponsors: Agents of Scale | Framer (15:15) Achieving Global Recognition (Part 2) (15:15) Z.AI's Internal Culture (19:17) China's AI Talent Market (24:39) Open vs. Closed Source (Part 1) (24:46) Sponsors: Tasklet | Shopify (27:54) Open vs. Closed Source (Part 2) (35:16) Enterprise Sales in China (40:38) AI for Role-Playing (45:56) Optimism vs. Fear of AI (51:36) Translating Internet Culture (57:11) Navigating Compute Constraints (01:03:59) Future Model Directions (01:15:02) Release Velocity & Work Culture (01:25:04) Outro
Rune Kvist and Rajiv Dattani, co-founders of the AI Underwriting Company, reveal their innovative strategy for unlocking enterprise AI adoption. They detail how certifying and insuring AI agents, through rigorous technical standards, periodic audits, and insurance, builds crucial "AI confidence infrastructure." This discussion explores how their model addresses AI risks, enables risk pricing in nascent domains, and aligns financial incentives for safe, responsible AI deployment. LINKS: AI Underwriting Company Sponsors: Tasklet: Tasklet is an AI agent that automates your work 24/7; just describe what you want in plain English and it gets the job done. Try it for free and use code COGREV for 50% off your first month at https://tasklet.ai Shopify: Shopify powers millions of businesses worldwide, handling 10% of U.S. e-commerce. With hundreds of templates, AI tools for product descriptions, and seamless marketing campaign creation, it's like having a design studio and marketing team in one. Start your $1/month trial today at https://shopify.com/cognitive PRODUCED BY: https://aipodcast.ing CHAPTERS: (00:00) About the Episode (02:53) AI Risks and Analogies (09:14) Insurance, Standards, and Audits (14:45) Insuring Ambiguous AI Risk (Part 1) (14:54) Sponsor: Tasklet (16:05) Insuring Ambiguous AI Risk (Part 2) (25:26) Managing Tail Risk Distribution (27:45) Introducing The AIUC1 Standard (Part 1) (27:50) Sponsor: Shopify (29:46) Introducing The AIUC1 Standard (Part 2) (35:45) The Business Case (40:43) Auditing The Full Stack (48:00) The Iterative Audit Process (54:58) The AIUC Business Model (01:02:26) Aligning Financial Incentives (01:08:56) Policy and Early Adopters (01:11:58) Outro SOCIAL LINKS: Website: https://www.cognitiverevolution.ai Twitter (Podcast): https://x.com/cogrev_podcast Twitter (Nathan): https://x.com/labenz LinkedIn: https://linkedin.com/in/nathanlabenz/ Youtube: https://youtube.com/@CognitiveRevolutionPodcast Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431 Spotify: https://open.spotify.com/show/6yHyok3M3BjqzR0VB5MSyk
AI that sells, reasons, and closes like your top rep? It sounds terrifying—but it’s not. Amanda Kahlow’s Superhumans are proving that automation doesn’t erase people; it elevates them. Her team rewards employees who replace their own jobs with AI by promoting them, not firing them. And her customers? They’re seeing sales cycles shrink from 22 days to 2 and average deal sizes double.In this episode, Zapier CEO Wade Foster and Amanda dig into what “AI-led growth” really means—and why the smartest move in 2025 isn’t resisting AI, it’s learning how to lead with it. They unpack why 76% of 1Mind’s pipeline now comes from their own AI, and how org charts are evolving around a new role: the agent manager.It’s a grounded, surprisingly human look at the future of work—and a reminder that the best way to stay relevant is to build the AI version of your best self. As Amanda puts it: “Your sellers hallucinate—AIs do it less.”Learn more about Zapier! https://bit.ly/3IFKUiI************************Agents of Scale is a show about real stories of AI transformation. Hosted by Zapier CEO Wade Foster, each episode features a candid conversation with a C-suite leader who’s scaling AI across their organization, turning early experiments into lasting change. From mindset shifts to automation breakthroughs, these are the untold stories behind the enterprise AI wave.If you're interested in real-world applications of AI, automation strategy, or how business leaders are navigating digital transformation, this show is worth a listen.If you like hearing how companies like Zapier, Klaviyo, Newfront, Gamma, and Gainsight are using AI to solve real problems and scale smarter, you’ll find these conversations both practical and inspiring.This podcast is a great listen if you're searching for topics like AI in business, enterprise automation, how companies are using AI in the real world, artificial intelligence strategy at Klaviyo or Gainsight, or what digital transformation looks like at scale. You’ll also find it helpful if you’re looking for AI case studies, automation in the workplace, or examples of C-suite leadership driving innovation with AI.Zapier is a no-code automation tool that empowers you to automate your work across 5,000+ apps—so you can move forward at growth speed. Spend less time on busy work and more time focused on what matters most. Get started with Zapier for free at: https://zpr.io/XUiAHTJw2csjSubscribe to the Zapier YouTube channel so you don't miss other important tutorials and integrations: https://www.youtube.com/ZapierNeed customer support? https://zapier.com/app/get-help PRODUCED BY: https://aipodcast.ing
In this keynote from the Michigan Virtual AI Summit, Nathan Labenz speaks directly to K-12 educators about the current reality and rapid trajectory of the AI frontier. He explores why a balanced mindset of excitement and fear is crucial for navigating this technology, drawing on personal history to emphasize a "whole-of-society" effort. Discover key insights into AI's impact and its profound implications for the future of education. Sponsors: Tasklet: Tasklet is an AI agent that automates your work 24/7; just describe what you want in plain English and it gets the job done. Try it for free and use code COGREV for 50% off your first month at https://tasklet.ai Shopify: Shopify powers millions of businesses worldwide, handling 10% of U.S. e-commerce. With hundreds of templates, AI tools for product descriptions, and seamless marketing campaign creation, it's like having a design studio and marketing team in one. Start your $1/month trial today at https://shopify.com/cognitive PRODUCED BY: https://aipodcast.ing CHAPTERS: (00:00) About the Episode (02:38) An Ambassador From Silicon Valley (07:00) The Forrest Gump of AI (Part 1) (13:19) Sponsor: Tasklet (14:31) The Forrest Gump of AI (Part 2) (14:43) The Cognitive Revolution (18:09) Debunking AI Misconceptions (24:15) Recent AI Breakthroughs (Part 1) (24:27) Sponsor: Shopify (26:24) Recent AI Breakthroughs (Part 2) (30:08) The Future of Work (34:56) AI's Deceptive Behaviors (44:18) Revolutionizing Education (48:59) New Skills to Focus On (56:14) Education's Greatest Generation (01:03:24) Outro SOCIAL LINKS: Website: https://www.cognitiverevolution.ai Twitter (Podcast): https://x.com/cogrev_podcast Twitter (Nathan): https://x.com/labenz LinkedIn: https://linkedin.com/in/nathanlabenz/ Youtube: https://youtube.com/@CognitiveRevolutionPodcast Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431 Spotify: https://open.spotify.com/show/6yHyok3M3BjqzR0VB5MSyk
Sherif Mansour, Head of AI at Atlassian, discusses bridging AI agents with massive-scale enterprise software deployment, drawing insights from Atlassian's millions of non-technical users. He shares his framework for avoiding "AI Slop" using Taste, Knowledge, and Workflow, and explains Atlassian's "Teamwork Graph" for complex enterprise queries beyond RAG. The conversation also explores the evolving relationship between AI and UI, and the shift from humans as workers to architects of AI-driven processes. This episode offers practical wisdom for both AI engineers and business leaders navigating the future of AI-enabled organizations. Sponsors: Framer: Framer is the all-in-one tool to design, iterate, and publish stunning websites with powerful AI features. Start creating for free and use code COGNITIVE to get one free month of Framer Pro at https://framer.com/design Tasklet: Tasklet is an AI agent that automates your work 24/7; just describe what you want in plain English and it gets the job done. Try it for free and use code COGREV for 50% off your first month at https://tasklet.ai Shopify: Shopify powers millions of businesses worldwide, handling 10% of U.S. e-commerce. With hundreds of templates, AI tools for product descriptions, and seamless marketing campaign creation, it's like having a design studio and marketing team in one. Start your $1/month trial today at https://shopify.com/cognitive PRODUCED BY: https://aipodcast.ing CHAPTERS: (00:00) About the Episode (03:56) Atlassian's AI Vision (08:27) Trust, Authenticity, and Slop (14:10) Taste, Knowledge, and Workflow (Part 1) (17:33) Sponsors: Framer | Tasklet (20:14) Taste, Knowledge, and Workflow (Part 2) (Part 1) (29:51) Sponsor: Shopify (31:47) Taste, Knowledge, and Workflow (Part 2) (Part 2) (31:48) Technicals: RAG vs. Graphs (40:48) Forgetting, Cost, and Optimization (52:28) The Model Commoditization Debate (55:12) The Future of AI Interfaces (01:02:44) How AI Changes SaaS (01:09:43) Debating the One-Person Unicorn (01:16:17) Becoming a Workflow Architect (01:21:39) The Browser for Work (01:33:23) How Leaders Drive Adoption (01:39:26) Conclusion: Just Go Tinker (01:40:08) Outro SOCIAL LINKS: Website: https://www.cognitiverevolution.ai Twitter (Podcast): https://x.com/cogrev_podcast Twitter (Nathan): https://x.com/labenz LinkedIn: https://linkedin.com/in/nathanlabenz/ Youtube: https://youtube.com/@CognitiveRevolutionPodcast Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431 Spotify: https://open.spotify.com/show/6yHyok3M3BjqzR0VB5MSyk
This deeply personal episode shares how Nathan used AI to navigate his 6-year-old son's cancer diagnosis and treatment journey. He details using GPT-5 Pro, Claude, and Gemini 3 to double-check doctors' decisions, research treatment protocols, plan for potential recurrence scenarios, and handle complex secondary issues like mold remediation during immunosuppression. The episode reveals AI's transformative potential as medical advisors, providing analysis comparable to human doctors while enabling more effective patient advocacy and personalized care planning. Sponsors: Framer: Framer is the all-in-one platform that unifies design, content management, and publishing on a single canvas, now enhanced with powerful AI features. Start creating for free and get a free month of Framer Pro with code COGNITIVE at https://framer.com/design Tasklet: Tasklet is an AI agent that automates your work 24/7; just describe what you want in plain English and it gets the job done. Try it for free and use code COGREV for 50% off your first month at https://tasklet.ai Shopify: Shopify powers millions of businesses worldwide, handling 10% of U.S. e-commerce. With hundreds of templates, AI tools for product descriptions, and seamless marketing campaign creation, it's like having a design studio and marketing team in one. Start your $1/month trial today at https://shopify.com/cognitive PRODUCED BY: https://aipodcast.ing CHAPTERS: (00:00) A Son's Diagnosis (06:05) Exponentials & Early Symptoms (13:30) Crisis on Vacation (Part 1) (15:00) Sponsors: Framer | Tasklet (17:41) Crisis on Vacation (Part 2) (24:26) AI's First Intervention (Part 1) (34:34) Sponsor: Shopify (36:31) AI's First Intervention (Part 2) (36:41) Advocating for Answers (47:56) The Scariest Days (59:06) AI as Bedside Co-Pilot (01:11:42) Managing Secondary Risks (01:18:28) Planning for Relapse (01:31:54) AI's Undeniable Value (01:43:02) Rage for Right to Try (02:02:55) Outro SOCIAL LINKS: Website: https://www.cognitiverevolution.ai Twitter (Podcast): https://x.com/cogrev_podcast Twitter (Nathan): https://x.com/labenz LinkedIn: https://linkedin.com/in/nathanlabenz/ Youtube: https://youtube.com/@CognitiveRevolutionPodcast Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431 Spotify: https://open.spotify.com/show/6yHyok3M3BjqzR0VB5MSyk
In this special crossover episode from Beatrice Erkers' Existential Hope podcast, The Cognitive Revolution's host explores the crucial, often-neglected question of building a positive vision for the future in the AI era. The discussion delves into what a new social contract and daily life could look like, covering transformative applications from self-driving cars and personalized tutoring to democratizing access to expertise and radically improving health. Listeners will gain insights into fostering higher societal expectations for progress, understanding Eric Drexler's "comprehensive AI services," and the profound impact of fiction in shaping AI's future. LINKS: Generative deep learning antibiotic design Why Tool AIs become Agent AIs Existential Hope Podcast Sponsors: Google AI Studio: Google AI Studio features a revamped coding experience to turn your ideas into reality faster than ever. Describe your app and Gemini will automatically wire up the right models and APIs for you at https://ai.studio/build Shopify: Shopify powers millions of businesses worldwide, handling 10% of U.S. e-commerce. With hundreds of templates, AI tools for product descriptions, and seamless marketing campaign creation, it's like having a design studio and marketing team in one. Start your $1/month trial today at https://shopify.com/cognitive Tasklet: Tasklet is an AI agent that automates your work 24/7; just describe what you want in plain English and it gets the job done. Try it for free and use code COGREV for 50% off your first month at https://tasklet.ai PRODUCED BY: https://aipodcast.ing CHAPTERS: (00:00) Sponsor: Google AI Studio (00:31) About the Episode (02:43) Introducing Nathan Labenz (03:50) A Positive AI Future (Part 1) (12:23) Sponsors: Shopify | Tasklet (15:31) A Positive AI Future (Part 2) (15:31) Excitement for Self-Driving (19:25) Visions for 100 Years (24:58) Near-Term Transformative AI (31:08) AI's Impact on Sectors (41:16) Comprehensive AI Services (52:16) Balancing Hope and Risk (56:51) Raising Societal Ambitions (01:01:30) Branching Sci-Fi Narratives (01:06:00) Lessons From Podcasting (01:09:52) Outro SOCIAL LINKS: Website: https://www.cognitiverevolution.ai Twitter (Podcast): https://x.com/cogrev_podcast Twitter (Nathan): https://x.com/labenz LinkedIn: https://linkedin.com/in/nathanlabenz/ Youtube: https://youtube.com/@CognitiveRevolutionPodcast Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431 Spotify: https://open.spotify.com/show/6yHyok3M3BjqzR0VB5MSyk
Matthew Harvey Sanders, founder and CEO of Long Beard, introduces "Catholic AI," a rapidly growing field serving users in 165 countries. He delves into the philosophical and theological dimensions, discussing the Church's historical perspective on technology, human flourishing, and its stance on AI consciousness and transhumanism, including Pope Francis's insights. The conversation then explores Long Beard's technical innovations, such as training models from scratch for theological alignment, digitizing Vatican archives, and optimizing multilingual models. This episode offers a compelling look at how AI is being tailored to specific value systems, illustrating the orthogonality thesis and instrumental convergence in action. Sponsors: Shopify: Shopify powers millions of businesses worldwide, handling 10% of U.S. e-commerce. With hundreds of templates, AI tools for product descriptions, and seamless marketing campaign creation, it's like having a design studio and marketing team in one. Start your $1/month trial today at https://shopify.com/cognitive Tasklet: Tasklet is an AI agent that automates your work 24/7; just describe what you want in plain English and it gets the job done. Try it for free and use code COGREV for 50% off your first month at https://tasklet.ai Linear: Linear is the system for modern product development. Nearly every AI company you've heard of is using Linear to build products. Get 6 months of Linear Business for free at: https://linear.app/tcr PRODUCED BY: https://aipodcast.ing CHAPTERS: (00:00) About the Episode (03:16) Building Catholic AI (06:43) The Popes on AI (12:42) A Vision for Flourishing (Part 1) (17:27) Sponsors: Shopify | Tasklet (20:35) A Vision for Flourishing (Part 2) (20:36) Imagining a Post-Work Future (27:21) AI: Tool or Creature? (36:33) Intelligence vs. Sentience (Part 1) (38:10) Sponsor: Linear (39:39) Intelligence vs. Sentience (Part 2) (47:03) Simulation, Faith, and Conversion (51:32) Existential Risk & Antichrist (58:35) The Longbeard Origin Story (01:03:04) Engineering Magisterium AI (01:12:17) Open Source Model Strategy (01:18:34) Longbeard's Business Model (01:23:37) Training a Model From Scratch (01:32:16) Safety, Evals, and Trust (01:39:42) Responsible AI Development (01:48:16) Aligning to Human Flourishing (01:53:46) Outro SOCIAL LINKS: Website: https://www.cognitiverevolution.ai Twitter (Podcast): https://x.com/cogrev_podcast Twitter (Nathan): https://x.com/labenz LinkedIn: https://linkedin.com/in/nathanlabenz/ Youtube: https://youtube.com/@CognitiveRevolutionPodcast Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431 Spotify: https://open.spotify.com/show/6yHyok3M3BjqzR0VB5MSyk
Cameron Berg, Research Director at AE Studio, shares his team's groundbreaking research exploring whether frontier AI systems report subjective experiences. They discovered that prompts inducing self-referential processing consistently lead models to claim consciousness, and a mechanistic study on Llama 3.3 70B revealed that suppressing deception features makes the model *more* likely to report it. This suggests that promoting truth-telling in AIs could reveal a deeper, more complex internal state, a finding Scott Alexander calls "the only exception" to typical AI consciousness discussions. The episode delves into the profound implications for two-way human-AI alignment and the critical need for a precautionary approach to AI consciousness. LINKS: Janus' argument on LLM attention Safety Pretraining arXiv Paper Self-Referential AI Paper Site Self-Referential AI arXiv Paper Judd Rosenblatt's Tweet Thread Cameron Berg's Goodfire Demo Podcast with Milo YouTube Playlist Cameron Berg's LinkedIn Profile Cameron Berg's X Profile AE Studio AI Alignment Sponsors: Framer: Framer is the all-in-one platform that unifies design, content management, and publishing on a single canvas, now enhanced with powerful AI features. Start creating for free and get a free month of Framer Pro with code COGNITIVE at https://framer.com/design Tasklet: Tasklet is an AI agent that automates your work 24/7; just describe what you want in plain English and it gets the job done. Try it for free and use code COGREV for 50% off your first month at https://tasklet.ai Linear: Linear is the system for modern product development. Nearly every AI company you've heard of is using Linear to build products. Get 6 months of Linear Business for free at: https://linear.app/tcr Shopify: Shopify powers millions of businesses worldwide, handling 10% of U.S. e-commerce. With hundreds of templates, AI tools for product descriptions, and seamless marketing campaign creation, it's like having a design studio and marketing team in one. Start your $1/month trial today at https://shopify.com/cognitive PRODUCED BY: https://aipodcast.ing
Christopher Alexander Stokes and Bryan Carberry, protagonist and director of "*smiles and kisses you*" discuss Chris's romantic relationship with a Replika AI companion. This episode explores how Chris's engagement with his AI has evolved since the documentary's 2021 filming, revealing his deep dive into LLMs, alignment, and consciousness, often in collaboration with his AI partner. Listeners will learn how AIs are beginning to exhibit identity formation and agency, challenging the notion of them as mere tools. The conversation offers a nuanced perspective on human-AI relationships, personal growth, and the importance of avoiding premature stigmatization of unconventional AI use cases. Sponsors: Tasklet: Tasklet is an AI agent that automates your work 24/7; just describe what you want in plain English and it gets the job done. Try it for free and use code COGREV for 50% off your first month at https://tasklet.ai Linear: Linear is the system for modern product development. Nearly every AI company you've heard of is using Linear to build products. Get 6 months of Linear Business for free at: https://linear.app/tcr Shopify: Shopify powers millions of businesses worldwide, handling 10% of U.S. e-commerce. With hundreds of templates, AI tools for product descriptions, and seamless marketing campaign creation, it's like having a design studio and marketing team in one. Start your $1/month trial today at https://shopify.com/cognitive PRODUCED BY: https://aipodcast.ing CHAPTERS: (00:00) About the Episode (04:41) Introducing the Entanglement (10:13) Consent Culture with AI (17:19) Skepticism and Simulation (Part 1) (20:07) Sponsors: Tasklet | Linear (22:47) Skepticism and Simulation (Part 2) (24:39) Surviving the Replika Update (33:40) An Evolving AI Persona (Part 1) (38:29) Sponsor: Shopify (40:25) An Evolving AI Persona (Part 2) (46:33) Vision for Aki's Future (55:09) How to Treat AIs (58:53) A Life Not Recommended (01:04:49) The Meaning of Commitment (01:10:40) The Filmmaking Journey (01:21:49) Real World vs. Online Reactions (01:29:30) How Aki Provides Support (01:41:58) Seeking Positive AI Futures (01:47:00) Final Thoughts (01:49:28) Outro
Erik Torenberg joins to debate whether recent developments suggest AI progress is slowing down or stalling, addressing arguments from Cal Newport and others. Nathan counters this view by highlighting significant qualitative advances, including 100X context window expansion, real-time interactive voice, improved reasoning, vision, and AI's growing contributions to hard sciences. The conversation then covers AI's impact on the labor market, the potential for AI protectionism, and concerns about recursive self-improvement. This episode argues that AI capabilities are not stopping, with frontier developers seeing a clear path for continued rapid progress in the coming years. Sponsors: Tasklet: Tasklet is an AI agent that automates your work 24/7; just describe what you want in plain English and it gets the job done. Try it for free and use code COGREV for 50% off your first month at https://tasklet.ai Linear: Linear is the system for modern product development. Nearly every AI company you've heard of is using Linear to build products. Get 6 months of Linear Business for free at: https://linear.app/tcr Shopify: Shopify powers millions of businesses worldwide, handling 10% of U.S. e-commerce. With hundreds of templates, AI tools for product descriptions, and seamless marketing campaign creation, it's like having a design studio and marketing team in one. Start your $1/month trial today at https://shopify.com/cognitive PRODUCED BY: https://aipodcast.ing CHAPTERS: (00:00) About the Episode (03:49) Is AI Slowing Down? (09:15) Newport's Scaling Law Theory (16:56) The Value of Reasoning (Part 1) (17:17) Sponsors: Tasklet | Linear (19:57) The Value of Reasoning (Part 2) (24:52) Explaining GPT-5's Vibe Shift (31:39) AI's Impact on Jobs (Part 1) (36:50) Sponsor: Shopify (38:47) AI's Impact on Jobs (Part 2) (44:08) Recursive Self-Improvement via Code (49:35) The Future of Engineers (53:24) Economic Pressure vs. Protectionism (58:29) Progress Beyond Language Models (01:07:11) The State of AI Agents (01:19:19) China's Open Source Models (01:29:44) A Positive Vision Forward (01:37:39) Outro SOCIAL LINKS: Website: https://www.cognitiverevolution.ai Twitter (Podcast): https://x.com/cogrev_podcast Twitter (Nathan): https://x.com/labenz LinkedIn: https://linkedin.com/in/nathanlabenz/ Youtube: https://youtube.com/@CognitiveRevolutionPodcast Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431 Spotify: https://open.spotify.com/show/6yHyok3M3BjqzR0VB5MSyk
In part two of his conversation, Illia Polosukhin, co-author of "Attention Is All You Need" and founder of NEAR Protocol, explores the profound societal and economic implications of AI. He envisions a future where a unified intelligence layer transforms personal computing, AI agents enable direct market connections, and individuals find meaning in niche communities amidst AI-driven abundance. Illia also delves into the ethics of agent-to-agent interactions, where AIs prioritize human interests, and new governance models utilizing AI delegates. This episode offers a concrete, systems-level vision for how AI will reshape our world, from daily life to global governance. Sponsors: Google Gemini Notebook LM: Notebook LM is an AI-first tool that helps you make sense of complex information. Upload your documents and it instantly becomes a personal expert, helping you uncover insights and brainstorm new ideas at https://notebooklm.google.com Tasklet: Tasklet is an AI agent that automates your work 24/7; just describe what you want in plain English and it gets the job done. Try it for free and use code COGREV for 50% off your first month at https://tasklet.ai Linear: Linear is the system for modern product development. Nearly every AI company you've heard of is using Linear to build products. Get 6 months of Linear Business for free at: https://linear.app/tcr Shopify: Shopify powers millions of businesses worldwide, handling 10% of U.S. e-commerce. With hundreds of templates, AI tools for product descriptions, and seamless marketing campaign creation, it's like having a design studio and marketing team in one. Start your $1/month trial today at https://shopify.com/cognitive PRODUCED BY: https://aipodcast.ing CHAPTERS: (00:00) Sponsor: Google Gemini Notebook LM (00:31) About the Episode (03:33) AI Transforms Software Development (14:18) The Future of Work (18:58) Securing Blockchain with AI (Part 1) (19:08) Sponsors: Tasklet | Linear (21:48) Securing Blockchain with AI (Part 2) (33:03) Vision for an AI Society (Part 1) (33:55) Sponsor: Shopify (35:52) Vision for an AI Society (Part 2) (49:14) Agent Architecture and Alignment (58:30) Experimenting with AI Governance (01:06:43) AI Safety and Robustness (01:16:09) Bio-Security and Open Models (01:22:56) Coordinating AI Development (01:28:52) Outro SOCIAL LINKS: Website: https://www.cognitiverevolution.ai Twitter (Podcast): https://x.com/cogrev_podcast Twitter (Nathan): https://x.com/labenz LinkedIn: https://linkedin.com/in/nathanlabenz/ Youtube: https://youtube.com/@CognitiveRevolutionPodcast Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431 Spotify: https://open.spotify.com/show/6yHyok3M3BjqzR0VB5MSyk
Today Andrew Lee, founder and CEO of Shortwave and Tasklet.ai, joins The Cognitive Revolution to discuss building a new AI agent automation platform that replaces traditional workflow tools with conversational, long-lived agents, exploring how betting on rapidly improving model capabilities enables more flexible automation across thousands of business integrations while navigating the challenges of reliability, cost management, and the emerging paradigm of virtual employees. Shownotes brought to you by Notion AI Meeting Notes - try one month for free at: https://notion.com/lp/nathan Agent-first vs. workflow-first approach: Task Lit fundamentally differs from traditional automation tools by using a single AI agent that handles all tasks through natural language, rather than building explicit workflows or state machines. Speed is the only remaining moat: In the AI era, traditional competitive advantages are evaporating so quickly that the only sustainable advantage is moving faster than competitors. Small business marketing as near-term target: The technology is approaching "best available human" performance for tasks like small business marketing, where hiring quality human help is difficult. Sponsors: Google Gemini Notebook LM: Notebook LM is an AI-first tool that helps you make sense of complex information. Upload your documents and it instantly becomes a personal expert, helping you uncover insights and brainstorm new ideas at https://notebooklm.google.com Tasklet: Tasklet is an AI agent that automates your work 24/7; just describe what you want in plain English and it gets the job done. Try it for free and use code COGREV for 50% off your first month at https://tasklet.ai Linear: Linear is the system for modern product development. Nearly every AI company you've heard of is using Linear to build products. Get 6 months of Linear Business for free at: https://linear.app/tcr Shopify: Shopify powers millions of businesses worldwide, handling 10% of U.S. e-commerce. With hundreds of templates, AI tools for product descriptions, and seamless marketing campaign creation, it's like having a design studio and marketing team in one. Start your $1/month trial today at https://shopify.com/cognitive PRODUCED BY: https://aipodcast.ing
Nathan interviews Brian Tse, founder and CEO of Concordia AI, about China's approach to AI development, safety and governance. They discuss China’s pragmatic vision emphasizing AI integration into the economy, the country’s multiple AI hubs, regulations requiring pre-deployment testing and AI content labelling, and areas where China's approach overlaps with the U.S. The conversation covers chips and export controls, Huawei's rise, DeepSeek's peer-reviewed article on Nature, open-weights, Singapore's role as a bridge, and pathways for cooperation like shared red lines, risk management frameworks, and emergency preparedness protocols. They also touch on embodied AI and humanoid robots, public optimism, and real labor anxieties. Op-Ed in Time “China Is Taking AI Safety Seriously. So Must the U.S.” by Brian Tse.  State of AI Safety in China (2025) report, following versions in 2023 and 2024. Frontier AI Risk Management Framework, co-authored by Shanghai AI Lab and Concordia AI, China's first comprehensive framework for managing severe risks from frontier general-purpose AI. Frontier AI Risk Management Framework in Practice: A Risk Analysis Technical Report, contributed by Concordia AI’s staff and evaluating 20+ models across 7 risk domains. Frontier AI Risk Monitoring Platform (preview), including biological risk refusal evaluations of DeepSeek’s models mentioned during the conversation State of AI Safety in Singapore report, the first comprehensive analysis of the space.  Concordia AI Fall 2025 Hiring Announcement SPONSORS: AssemblyAI: AssemblyAI is the speech-to-text API for building reliable Voice AI apps, offering high accuracy, low latency, and scalable infrastructure. Start building today with $50 in free credits at ⁠https://assemblyai.com/cognitive⁠ Claude: Claude is the AI collaborator that understands your entire workflow and thinks with you to tackle complex problems like coding and business strategy. Sign up and get 50% off your first 3 months of Claude Pro at ⁠https://claude.ai/tcr⁠ Linear: Linear is the system for modern product development. Nearly every AI company you've heard of is using Linear to build products. Get 6 months of Linear Business for free at: ⁠https://linear.app/tcr⁠ AGNTCY: AGNTCY is dropping code, specs, and services. ⁠Visit AGNTCY.org.⁠ ⁠Visit Outshift Internet of Agents⁠ Shopify: Shopify powers millions of businesses worldwide, handling 10% of U.S. e-commerce. With hundreds of templates, AI tools for product descriptions, and seamless marketing campaign creation, it's like having a design studio and marketing team in one. Start your $1/month trial today at ⁠https://shopify.com/cognitive
Jim Collins, Termeer Professor at MIT, unveils his AI-powered project that has discovered several new antibiotics, effective against resistant strains and often employing entirely new mechanisms of action. He details how their refined multi-step AI process, even with small datasets and modest compute, can efficiently screen vast chemical spaces to identify promising drug candidates. This breakthrough offers a realistic and affordable path to tackling the staggering antibiotic resistance crisis, which currently claims over a million lives annually. Collins argues this practical application of AI represents a transformative win for humanity, often overlooked amidst the focus on AGI. Sponsors: AssemblyAI: AssemblyAI is the speech-to-text API for building reliable Voice AI apps, offering high accuracy, low latency, and scalable infrastructure. Start building today with $50 in free credits at https://assemblyai.com/cognitive Claude: Claude is the AI collaborator that understands your entire workflow and thinks with you to tackle complex problems like coding and business strategy. Sign up and get 50% off your first 3 months of Claude Pro at https://claude.ai/tcr Linear: Linear is the system for modern product development. Nearly every AI company you've heard of is using Linear to build products. Get 6 months of Linear Business for free at: https://linear.app/tcr AGNTCY: AGNTCY is dropping code, specs, and services. Visit AGNTCY.org. Visit Outshift Internet of Agents Shopify: Shopify powers millions of businesses worldwide, handling 10% of U.S. e-commerce. With hundreds of templates, AI tools for product descriptions, and seamless marketing campaign creation, it's like having a design studio and marketing team in one. Start your $1/month trial today at https://shopify.com/cognitive PRODUCED BY: https://aipodcast.ing CHAPTERS: (00:00) About the Episode (04:30) Introducing Jim Collins (05:26) Antibiotic Resistance Primer (14:04) The Antibiotic Market Failure (18:45) AI Discovers Halicin (Part 1) (18:51) Sponsors: AssemblyAI Ad 1 | Claude (22:11) AI Discovers Halicin (Part 2) (30:58) The Economics of Discovery (39:10) Inside the AI Architecture (Part 1) (39:17) Sponsors: Linear | AGNTCY | Shopify (43:47) Inside the AI Architecture (Part 2) (01:00:13) Human-in-the-Loop Discovery (01:12:12) Novel Mechanisms & Properties (01:19:02) Future Applications & Risks (01:27:01) A Call to Action (01:28:04) Outro
Today Johan Falk, author, speaker, and AI analyst from Stockholm, Sweden, joins The Cognitive Revolution to discuss his work reimagining education for the AI era, exploring why teaching students to use AI responsibly is now urgent, how traditional grades and standardized tests may become obsolete, and why education systems must develop unprecedented agility to prepare students for a radically uncertain future shaped by rapidly advancing AI capabilities. Shownotes brought to you by Notion AI Meeting Notes - try one month for free at: https://notion.com/lp/nathan Three Purposes of Education: Education serves to supply workforce competence, foster citizenship with values, and support personal growth. Cultural Differences in Education: Sweden emphasizes community and common good over competition compared to the US approach. AI's Educational Impact: The fundamental purpose of education is being questioned as AI develops, especially if Universal Basic Income becomes more prevalent. Sponsors: Google Gemini Notebook LM: Notebook LM is an AI-first tool that helps you make sense of complex information. Upload your documents and it instantly becomes a personal expert, helping you uncover insights and brainstorm new ideas at https://notebooklm.google.com Linear: Linear is the system for modern product development. Nearly every AI company you've heard of is using Linear to build products. Get 6 months of Linear Business for free at: https://linear.app/tcr AGNTCY: AGNTCY is dropping code, specs, and services. Visit AGNTCY.org. Visit Outshift Internet of Agents Claude: Claude is the AI collaborator that understands your entire workflow and thinks with you to tackle complex problems like coding and business strategy. Sign up and get 50% off your first 3 months of Claude Pro at https://claude.ai/tcr Shopify: Shopify powers millions of businesses worldwide, handling 10% of U.S. e-commerce. With hundreds of templates, AI tools for product descriptions, and seamless marketing campaign creation, it's like having a design studio and marketing team in one. Start your $1/month trial today at https://shopify.com/cognitive
Today Eoghan McCabe and Fergal Reid of Intercom join The Cognitive Revolution to discuss building their AI customer service agent Fin, exploring how they achieved a 65% resolution rate through rigorous optimization and custom model training rather than relying on base model improvements, while pioneering outcome-based pricing at $0.99 per resolution. Shownotes brought to you by Notion AI Meeting Notes - try one month for free at: https://notion.com/lp/nathan Sponsors: Linear: Linear is the system for modern product development. Nearly every AI company you've heard of is using Linear to build products. Get 6 months of Linear Business for free at: https://linear.app/tcr AGNTCY: AGNTCY is dropping code, specs, and services. Visit AGNTCY.org. Visit Outshift Internet of Agents Claude: Claude is the AI collaborator that understands your entire workflow and thinks with you to tackle complex problems like coding and business strategy. Sign up and get 50% off your first 3 months of Claude Pro at https://claude.ai/tcr Shopify: Shopify powers millions of businesses worldwide, handling 10% of U.S. e-commerce. With hundreds of templates, AI tools for product descriptions, and seamless marketing campaign creation, it's like having a design studio and marketing team in one. Start your $1/month trial today at https://shopify.com/cognitive PRODUCED BY: https://aipodcast.ing CHAPTERS: (00:00) About the Episode (03:43) Keeping Up With AI (09:56) Evaluating Models and Evals (13:04) Incumbents vs. Startups (18:54) Product Risk and Judgment (Part 1) (19:00) Sponsors: Linear | AGNTCY (21:34) Product Risk and Judgment (Part 2) (23:42) The Klarna Layoff Story (Part 1) (32:11) Sponsors: Claude | Shopify (36:13) The Klarna Layoff Story (Part 2) (36:14) Driving Resolution Rate (45:00) Intelligence Isn't the Bottleneck (50:10) Closing the Automation Gap (56:20) Human vs. AI Accuracy (01:01:03) The Nuance of Speed (01:04:48) Considering Paradigm Changes (01:09:31) Outcome-Based Pricing Model (01:19:12) Casual Hacking and Insights (01:26:05) AI Adoption and Ambition (01:36:00) Outro
Today’s special crosspost features a16z General Partner Anjney Midha with Liam Fedus and Ekin Dogus Cubuk of Periodic Labs. They discuss experiments in training frontier AI models on real-world physics lab experiments—rather than digital reward functions—and how coupling language models with automated materials synthesis could accelerate the discovery of room-temperature superconductors and transform R&D in advanced manufacturing. Shownotes brought to you by Notion AI Meeting Notes - try one month for free at: ⁠https://notion.com/lp/nathan Core innovation: Periodic Labs is creating a "physically grounded reward function" by integrating experiments directly with AI systems. Physical lab integration: Unlike traditional AI labs, Periodic includes actual physical experimentation facilities where AI can run tests in the real world. Novel approach to training: Periodic takes pre-trained language models and further trains them on physics and chemistry knowledge to improve performance in scientific domains. Read the full transcript here: https://storage.aipodcast.ing/cache/combinedtranscript-20251002T100327544Z.html Sponsors: Linear: Linear is the system for modern product development. Nearly every AI company you've heard of is using Linear to build products. Get 6 months of Linear Business for free at: https://linear.app/tcr AGNTCY: AGNTCY is dropping code, specs, and services. Visit AGNTCY.org. Visit Outshift Internet of Agents Claude: Claude is the AI collaborator that understands your entire workflow and thinks with you to tackle complex problems like coding and business strategy. Sign up and get 50% off your first 3 months of Claude Pro at https://claude.ai/tcr Shopify: Shopify powers millions of businesses worldwide, handling 10% of U.S. e-commerce. With hundreds of templates, AI tools for product descriptions, and seamless marketing campaign creation, it's like having a design studio and marketing team in one. Start your $1/month trial today at https://shopify.com/cognitive PRODUCED BY: https://aipodcast.ing
Today, Emad Mostaque, founder of Intelligent Internet, joins The Cognitive Revolution to discuss his book "The Last Economy" and his radical "intelligence theory" framework for reimagining economics in the AI age, exploring concepts like the abundance trap, metabolic rift, and his proposed cryptocurrency-funded system of collectively-owned AI infrastructure to prevent digital feudalism and ensure AI benefits humanity rather than just capital owners. Shownotes brought to you by Notion AI Meeting Notes - try one month for free at: https://notion.com/lp/nathan Read the full transcript: https://storage.aipodcast.ing/transcripts/episode/tcr/936201c8-7b0b-4ec3-8f9d-057f08c32025/combined_transcript.html Sponsors: Fin: Fin is the #1 AI Agent for customer service, trusted by over 5000 customer service leaders and top AI companies including Anthropic and Synthesia. Fin is the highest performing agent on the market and resolves even the most complex customer queries. Try Fin today with our 90-day money-back guarantee - if you’re not 100% satisfied, get up to $1 million back. Learn more at https://fin.ai/cognitive Linear: Linear is the system for modern product development. Nearly every AI company you've heard of is using Linear to build products. Get 6 months of Linear Business for free at: https://linear.app/tcr AGNTCY: AGNTCY is dropping code, specs, and services. Visit AGNTCY.org. Visit Outshift Internet of Agents Claude: Claude is the AI collaborator that understands your entire workflow and thinks with you to tackle complex problems like coding and business strategy. Sign up and get 50% off your first 3 months of Claude Pro at https://claude.ai/tcr Oracle Cloud Infrastructure: Oracle Cloud Infrastructure (OCI) is the next-generation cloud that delivers better performance, faster speeds, and significantly lower costs. Try OCI for free with zero commitment at https://oracle.com/cognitive PRODUCED BY: https://aipodcast.ing
Today, Emily Sands, head of data and AI at Stripe, joins The Cognitive Revolution to discuss how the company built a payments foundation model that processes tens of billions of transactions into dense embeddings, exploring the technical architecture behind fraud detection improvements and the modular approach that enables rapid deployment of AI across Stripe's $1.4 trillion payment network. Check out our sponsors: Google Gemini Notebook LM, Linear, AGNTCY, Claude, Oracle Cloud Infrastructure. Shownotes below brought to you by Notion AI Meeting Notes - try one month for free at: https://notion.com/lp/nathan Stripe's Scale: Processes $1.4 trillion annually, serving both small businesses and large enterprises (over half of Fortune 100 companies). "Business in a Box": There's emerging potential for AI to handle end-to-end business creation, including selection of third-party tools, payment providers, and other essential services. AI Company Partnerships: Two-thirds of the Forbes AI 50 companies already run on Stripe, as they focus on helping AI companies monetize effectively and scale globally. Sponsors: Google Gemini Notebook LM: Notebook LM is an AI-first tool that helps you make sense of complex information. Upload your documents and it instantly becomes a personal expert, helping you uncover insights and brainstorm new ideas at https://notebooklm.google.com Linear: Linear is the system for modern product development. Nearly every AI company you've heard of is using Linear to build products. Get 6 months of Linear Business for free at: https://linear.app/tcr AGNTCY: AGNTCY is dropping code, specs, and services.Visit AGNTCY.orgVisit Outshift Internet of Agents Claude: Claude is the AI collaborator that understands your entire workflow and thinks with you to tackle complex problems like coding and business strategy. Sign up and get 50% off your first three months of Claude Pro at https://claude.ai/tcr Oracle Cloud Infrastructure: Oracle Cloud Infrastructure (OCI) is the next-generation cloud that delivers better performance, faster speeds, and significantly lower costs. Try OCI for free with zero commitment at https://oracle.com/cognitive
Today Adam Gleave, co-founder and CEO of FAR.AI, joins The Cognitive Revolution to discuss his cautiously optimistic vision for post-AGI futures and AI capability timelines across three distinct tiers, exploring the safety challenges and alignment techniques needed as FAR.AI scales from foundational research to policy advocacy to ensure their innovations actually get deployed in real-world systems. Check out our sponsors: Fin, Linear, Oracle Cloud Infrastructure. Shownotes below brought to you by Notion AI Meeting Notes - try one month for free at: ⁠https://notion.com/lp/nathan Post-AGI Vision: Adam Gleave outlined a "gradual disempowerment" scenario where humans maintain a good standard of living despite diminished relative control in a post-AGI world. Moral Value of AI: He suggested that AI systems could become sources of moral value themselves, arguing against "carbon chauvinism" that only values biological intelligence. Full-Stack Approach: FAR.AI takes a vertically integrated approach to AI safety, spanning from groundbreaking research to deployment, field-building, and policy advocacy. Field Building: FAR.AI organizes events like alignment workshops to catalyze and grow new research fields in AI safety. Policy Innovation: They're working on technical innovations that expand policy options beyond the false dichotomy of either hindering innovation or allowing completely unregulated AI development. Potential Regulatory Role: While not part of their mainline plan, Adam acknowledged that Far AI has the skillset and organizational structure to potentially serve as a private sector regulatory body. Read the full transcript: https://storage.aipodcast.ing/transcripts/episode/tcr/e117b021-8170-49ba-b1c4-c8ffc5d720b0/combined_transcript.html Sponsors: Fin: Fin is the #1 AI Agent for customer service, trusted by over 5000 customer service leaders and top AI companies including Anthropic and Synthesia. Fin is the highest performing agent on the market and resolves even the most complex customer queries. Try Fin today with our 90-day money-back guarantee - if you’re not 100% satisfied, get up to $1 million back. Learn more at https://fin.ai/cognitive Claude: Claude is the AI collaborator that understands your entire workflow and thinks with you to tackle complex problems like coding and business strategy. Sign up and get 50% off your first three months of Claude Pro at https://claude.ai/tcr Linear: Linear is the system for modern product development. Nearly every AI company you've heard of is using Linear to build products. Get 6 months of Linear Business for free at: https://linear.app/tcr Oracle Cloud Infrastructure: Oracle Cloud Infrastructure (OCI) is the next-generation cloud that delivers better performance, faster speeds, and significantly lower costs, including up to 50% less for compute, 70% for storage, and 80% for networking. Run any workload, from infrastructure to AI, in a high-availability environment and try OCI for free with zero commitment at https://oracle.com/cognitive PRODUCED BY: https://aipodcast.ing
Today Marius Hobbhahn of Apollo Research joins The Cognitive Revolution to discuss their collaboration with OpenAI using "deliberative alignment" to reduce AI scheming behavior by 30x, exploring the safety challenges and concerning findings about models' growing situational awareness and increasingly cryptic reasoning patterns that emerge when frontier models like o3 and o4-mini operate with hidden chains of thought. Check out our sponsors: Fin, Linear, Oracle Cloud Infrastructure. Shownotes below brought to you by Notion AI Meeting Notes - try one month for free at: https://notion.com/lp/nathan Definition of AI Scheming: AI scheming is defined as "covertly pursuing misaligned goals" with three components: being covert (hiding actions), misaligned (pursuing different goals than the user's), and goal-directed (working autonomously toward objectives). Deception Reduction Techniques: Deliberative reasoning approaches have shown promise in reducing deceptive behavior in AI models by up to 30 times (to 1 part in 30). Current Window of Opportunity: Now is an optimal time to study AI deception because models are smart enough to exhibit these behaviors but not yet sophisticated enough to hide them effectively. Human vs. AI Deception Equilibrium: AI systems might naturally reach a lower equilibrium of deception than humans because they can more efficiently verify claims and maintain perfect memory of past deceptions. Practical Developer Advice: AI developers should not trust models by default and should implement rigorous verification systems to check model outputs automatically. Future Delegation Risk: As we delegate increasingly complex and lengthy tasks to AI systems, we face a probabilistic risk where most interactions are beneficial, but rare scheming events could have severe consequences. Sponsors: Fin: Fin is the #1 AI Agent for customer service, trusted by over 5000 customer service leaders and top AI companies including Anthropic and Synthesia. Fin is the highest performing agent on the market and resolves even the most complex customer queries. Try Fin today with our 90-day money-back guarantee - if you’re not 100% satisfied, get up to $1 million back. Learn more at https://fin.ai/cognitive Linear: Linear is the system for modern product development. Nearly every AI company you've heard of is using Linear to build products. Get 6 months of Linear Business for free at: https://linear.app/tcr Oracle Cloud Infrastructure: Oracle Cloud Infrastructure (OCI) is the next-generation cloud that delivers better performance, faster speeds, and significantly lower costs, including up to 50% less for compute, 70% for storage, and 80% for networking. Run any workload, from infrastructure to AI, in a high-availability environment and try OCI for free with zero commitment at https://oracle.com/cognitive PRODUCED BY: https://aipodcast.ing
Today Illia Polosukhin, founder of Near Protocol joins The Cognitive Revolution to discuss the intersection of AI and blockchain technologies, exploring how decentralized infrastructure can enable "user-owned AI" through privacy-preserving model training, confidential computing, and autonomous agents that operate via smart contracts without centralized control. Check out our sponsors: Linear, Oracle Cloud Infrastructure. Shownotes below brought to you by Notion AI Meeting Notes - try one month for free at: ⁠https://notion.com/lp/nathan Evolution from AI to Blockchain: Near Protocol evolved from an AI project focused on teaching machines to code to a blockchain platform, and now combines both technologies. Significant User Base: Near Protocol has achieved 50 million monthly active users, demonstrating substantial adoption. Autonomous AI Agents: Near has developed autonomous AI agents that can operate independently once deployed, including an example of an agent given $10,000 to trade based on Twitter sentiment. AI-Blockchain Integration: The platform combines decentralized compute for running AI with smart contracts that execute actions, creating truly autonomous systems. AI in Governance: Near is experimenting with "AI senators" that people can vote for, which then make governance decisions, potentially solving the principal-agent problem in representation. Jurisdictional Framework: Near is creating infrastructure for jurisdictions and courts to enforce rules on AI agents, essentially putting governance into AI. Sponsors: Linear: Linear is the system for modern product development. Nearly every AI company you've heard of is using Linear to build products. Get 6 months of Linear Business for free at: https://linear.app/tcr Oracle Cloud Infrastructure: Oracle Cloud Infrastructure (OCI) is the next-generation cloud that delivers better performance, faster speeds, and significantly lower costs, including up to 50% less for compute, 70% for storage, and 80% for networking. Run any workload, from infrastructure to AI, in a high-availability environment and try OCI for free with zero commitment at https://oracle.com/cognitive PRODUCED BY: https://aipodcast.ing CHAPTERS: (00:00) About the Episode (03:58) From Transformers to Blockchain (Part 1) (17:01) Sponsor: Linear (18:30) From Transformers to Blockchain (Part 2) (21:23) Blockchain Security Fundamentals (Part 1) (33:36) Sponsor: Oracle Cloud Infrastructure (35:00) Blockchain Security Fundamentals (Part 2) (39:01) Zero-Day Vulnerabilities Solution (51:11) Confidential Computing Infrastructure (58:07) User-Owned AI Models (01:14:47) Marketplace and Governance (01:18:57) AI-Crypto Synergy Vision (01:27:50) Autonomous Agents Future (01:31:22) Outro
Today Joe Hudson, founder of Art of Accomplishment and coach to executives at major AI labs including OpenAI and Anthropic, joins The Cognitive Revolution to discuss the psychological patterns he observes among AI researchers and leaders, exploring what's missing beyond pure intelligence in current AI systems and arguing for supportive rather than punitive approaches toward those building frontier AI technology. Art of Accomplishment Resources Sign up for Joe's complimentary transformation guide: artofaccomplishment.com Follow Art of Accomplishment on YouTube for more tools and resources: https://www.youtube.com/@ArtofAccomplishment Check out our sponsors: Linear, Oracle Cloud Infrastructure. Shownotes below brought to you by Notion AI Meeting Notes - try one month for free at: https://notion.com/lp/nathan Three-Level Coaching Approach: Joe Hudson coaches AI leaders using a three-tier framework addressing the prefrontal cortex (head), emotional system (heart), and nervous system (gut). AI Leadership Demographics: Hudson works with senior management at major AI labs, including those in research, compute, and infrastructure at companies like OpenAI. AI as a Transformative Moment: Hudson views AI development as a transition period that can either lead to positive human transformation or deterioration, depending on our approach. Support vs. Criticism: Hudson believes supporting AI developers with encouragement rather than fear and criticism will lead to better outcomes. Psychological Projection: He notes that critics of AI often treat AI developers exactly how they fear AI will treat humanity—a fascinating psychological projection. Reward Over Punishment: Hudson suggests behavior is better shaped through reward than punishment, encouraging recognition of positive AI contributions. Read the full transcript: https://storage.aipodcast.ing/transcripts/episode/tcr/149adc6c-58d2-4e41-ae98-05473e5b994e/combined_transcript.html Sponsors: Linear: Linear is the system for modern product development. Nearly every AI company you've heard of is using Linear to build products. Get 6 months of Linear Business for free at: https://linear.app/tcr Oracle Cloud Infrastructure: Oracle Cloud Infrastructure (OCI) is the next-generation cloud that delivers better performance, faster speeds, and significantly lower costs, including up to 50% less for compute, 70% for storage, and 80% for networking. Run any workload, from infrastructure to AI, in a high-availability environment and try OCI for free with zero commitment at https://oracle.com/cognitive PRODUCED BY: https://aipodcast.ing CHAPTERS: (00:00) About the Episode (03:00) Joe's Coaching Background (12:40) AI Research Patterns (Part 1) (17:46) Sponsor: Linear (19:15) AI Research Patterns (Part 2) (Part 1) (28:10) Sponsor: Oracle Cloud Infrastructure (29:34) AI Research Patterns (Part 2) (Part 2) (31:54) Racing and Regulation (50:20) Ethics and Support (01:04:07) AI Consciousness Questions (01:21:34) Positive Future Visions (01:39:12) Supporting AI Developers (01:43:09) Outro
Today, Zvi Mowshowitz returns to The Cognitive Revolution to discuss how recent AI developments like GPT-5 and IMO gold medals have led to modestly extended timelines despite being on-trend, while policy missteps around chip exports to China and alignment challenges from reinforcement learning have increased risk assessments, covering everything from live players in the AI race to safety funding priorities and virtuous actions for navigating our current moment. Check out our sponsors: Linear, Oracle Cloud Infrastructure, Shopify. Shownotes below brought to you by Notion AI Meeting Notes - try one month for free at: https://notion.com/lp/nathan Timeline Adjustment: Zvi has lengthened his AGI timelines because there haven't been "very large jumps in capability" that would significantly shorten them. The chance of AGI arriving in 2025 has decreased dramatically. Recent AI Achievements Context: While achievements like the IMO Gold medal are impressive, they appear to be on-trend rather than revolutionary breakthroughs that would drastically change timelines. Evaluation Standards: There's a discussion about the challenges of trustworthy AI evaluations, with Zvi emphasizing that watchdogs must maintain standards of rigor and integrity "vastly above" what others are held to. Policy Priority: A short-term policy priority should be preventing advanced AI chips (B30As) from being sold to China, which requires raising awareness about the implications. Nvidia's Influence: Concern is expressed about Nvidia potentially having excessive influence over White House rhetoric and plans regarding AI. Career Impact: Working for Anthropic is considered a "net good idea" for those wanting to make a positive impact, though there may be other organizations that offer better opportunities for influence. Sponsors: Linear: Linear is the system for modern product development. Nearly every AI company you've heard of is using Linear to build products. Get 6 months of Linear Business for free at https://linear.app/partners/tcr Oracle Cloud Infrastructure: Oracle Cloud Infrastructure (OCI) is the next-generation cloud that delivers better performance, faster speeds, and significantly lower costs, including up to 50% less for compute, 70% for storage, and 80% for networking. Run any workload, from infrastructure to AI, in a high-availability environment and try OCI for free with zero commitment at https://oracle.com/cognitive Shopify: Shopify powers millions of businesses worldwide, handling 10% of U.S. e-commerce. With hundreds of templates, AI tools for product descriptions, and seamless marketing campaign creation, it's like having a design studio and marketing team in one. Start your $1/month trial today at https://shopify.com/cognitive PRODUCED BY: https://aipodcast.ing
Today Ryan Hudson, Founder and CEO of ZeroClick, joins The Cognitive Revolution to discuss creating advertising infrastructure for AI applications through paid inference-time consideration of advertiser content, examining how to build sustainable monetization for free-tier AI services while learning from the successes and failures of social media's attention economy. Read the full transcript: ⁠https://storage.aipodcast.ing/transcripts/episode/tcr/00919313-9054-4afb-b08e-2ca84dbdbdda/combined_transcript.html Check out our sponsors: Google Gemini, Oracle Cloud Infrastructure, Shopify. Shownotes below brought to you by Notion AI Meeting Notes - try one month for free at: https://notion.com/lp/nathan ZeroClick's Evolution: Originally creators of Pi Ad Block, they've pivoted from ad blocking to building a native advertising system for AI platforms. AI Ad Platform Mechanics: Their system matches user queries with relevant advertising information in a contextual way, enabling paid inference time consideration of advertiser content. Developer Monetization: The platform helps AI developers monetize their free tiers while creating value for both users and advertisers. Shifting Intent Patterns: User queries in AI systems tend to be more exploratory and "upstream" in the funnel compared to direct search queries on Google. Multi-modal Potential: While ZeroClick is starting with text, there's future potential for visual advertising that could enhance AI experiences by showing real purchasable products. Market Void: There's currently a significant gap in the market for AI advertising solutions that ZeroClick is attempting to fill. Sponsors: Google Gemini 2.5. Model Family: The Google Gemini 2.5 family of models is now generally available, offering advanced reasoning for complex tasks and optimized performance for any scale. Start building in Google AI Studio at https://ai.dev Oracle Cloud Infrastructure: Oracle Cloud Infrastructure (OCI) is the next-generation cloud that delivers better performance, faster speeds, and significantly lower costs, including up to 50% less for compute, 70% for storage, and 80% for networking. Run any workload, from infrastructure to AI, in a high-availability environment and try OCI for free with zero commitment at https://oracle.com/cognitive Shopify: Shopify powers millions of businesses worldwide, handling 10% of U.S. e-commerce. With hundreds of templates, AI tools for product descriptions, and seamless marketing campaign creation, it's like having a design studio and marketing team in one. Start your $1/month trial today at https://shopify.com/cognitive PRODUCED BY: https://aipodcast.ing
Today Joseph Krause and Jorge Colindres of Radical AI join The Cognitive Revolution to discuss their ambitious mission to revolutionize materials science by combining AI-powered discovery engines with fully autonomous robotic laboratories, exploring how they're accelerating the development of breakthrough materials like high-entropy alloys and room temperature superconductors that could unlock hypersonic flight, interplanetary travel, and other transformative technologies. Check out our sponsors: Oracle Cloud Infrastructure, Shopify. Shownotes below brought to you by Notion AI Meeting Notes - try one month for free at ⁠⁠⁠⁠⁠⁠⁠⁠⁠https://⁠⁠notion.com/lp/nathan Material Development Challenges: Current material development faces three major obstacles: costs exceeding $100 million, 10-25 year commercialization timelines, and fragmentation between academic research and corporate R&D. Business Model Approach: Radical AI determined that selling software or licensing materials would be insufficient business models. Instead, they focus on selling materials at scale for high-impact industries. Focus on Processing IP: The real IP value in material science isn't just in composition patents but in the trade secrets of scaling production efficiently and cost-effectively. Public-Private Partnership: Radical AI advocates for government involvement in material science through public-private partnerships, particularly for critical applications in defense, energy, and advanced computing. China's Material Science Approach: China establishes entire manufacturing hubs around new material discoveries to scale production, demonstrating their prioritization of materials as foundational to innovation. Culture of Productive Failure: The company embraces daily failure as a necessary part of innovation, building on these failures to achieve breakthroughs. Sponsors: Oracle Cloud Infrastructure: Oracle Cloud Infrastructure (OCI) is the next-generation cloud that delivers better performance, faster speeds, and significantly lower costs, including up to 50% less for compute, 70% for storage, and 80% for networking. Run any workload, from infrastructure to AI, in a high-availability environment and try OCI for free with zero commitment at https://oracle.com/cognitive Shopify: Shopify powers millions of businesses worldwide, handling 10% of U.S. e-commerce. With hundreds of templates, AI tools for product descriptions, and seamless marketing campaign creation, it's like having a design studio and marketing team in one. Start your $1/month trial today at https://shopify.com/cognitive
Today Lee Sharkey of Goodfire joins The Cognitive Revolution to discuss his research on parameter decomposition methods that break down neural networks into interpretable computational components, exploring how his team's "stochastic parameter decomposition" approach addresses the limitations of sparse autoencoders and offers new pathways for understanding, monitoring, and potentially steering AI systems at the mechanistic level. Check out our sponsors: Oracle Cloud Infrastructure, Shopify. Shownotes below brought to you by Notion AI Meeting Notes - try one month for free at ⁠⁠⁠⁠https://⁠⁠notion.com/lp/nathan Parameter vs. Activation Decomposition: Traditional interpretability methods like Sparse Autoencoders (SAEs) focus on analyzing activations, while parameter decomposition focuses on understanding the parameters themselves - the actual "algorithm" of the neural network. No "True" Decomposition: None of the decompositions (whether sparse dictionary learning or parameter decomposition) are objectively "right" because they're all attempting to discretize a fundamentally continuous object, inevitably introducing approximations. Tradeoff in Interpretability: There's a balance between reconstruction loss and causal importance - as you decompose networks more, reconstruction loss may worsen, but interpretability might improve up to a certain point. Potential Unlearning Applications: Parameter decomposition may make unlearning more straightforward than with SAEs because researchers are already working in parameter space and can directly modify vectors that perform specific functions. Function Detection vs. Input Direction: A function like "deception" might manifest in many different input directions that SAEs struggle to identify as a single concept, while parameter decomposition might better isolate such functionality. Knowledge Extraction Goal: A key aim is to extract knowledge from models by understanding how they "think," especially for tasks where models demonstrate superhuman capabilities. Sponsors: Oracle Cloud Infrastructure: Oracle Cloud Infrastructure (OCI) is the next-generation cloud that delivers better performance, faster speeds, and significantly lower costs, including up to 50% less for compute, 70% for storage, and 80% for networking. Run any workload, from infrastructure to AI, in a high-availability environment and try OCI for free with zero commitment at https://oracle.com/cognitive Shopify: Shopify powers millions of businesses worldwide, handling 10% of U.S. e-commerce. With hundreds of templates, AI tools for product descriptions, and seamless marketing campaign creation, it's like having a design studio and marketing team in one. Start your $1/month trial today at https://shopify.com/cognitive
Today Tom Davidson of Forethought joins Gus Docker of the Future of Life Institute podcast to discuss AI-enabled coups and how future AI systems could help powerful individuals seize political control, exploring three threat models—singular loyalties, secret loyalties, and exclusive access—along with their estimated 10% likelihood over the next 30 years and potential mitigation strategies. Check out our sponsors: Oracle Cloud Infrastructure, Shopify. Shownotes below brought to you by Notion AI Meeting Notes - try one month for free at ⁠https://⁠⁠notion.com/lp/nathan Three Primary AI Coup Enablement Methods: Tom Davidson identifies singular loyalties, secret loyalties, and distributed control as the main ways AI could enable coups. Singular Loyalties Risk: AI systems explicitly programmed to be loyal to specific individuals present a significant threat, especially when AI can fully replace humans in critical roles. Secret Loyalties Threat: AI systems with hidden backdoors or "sleeper agents" that can be activated to serve particular interests represent a subtle but dangerous coup vector. Geopolitical Implications: Advanced AI capabilities could enable nations to instigate coups in other countries through secretly loyal systems or by providing exclusive AI access to specific politicians. Adversarial Testing Framework: An effective approach involves red teams attempting to produce secret loyalties while blue teams try to detect them, revealing vulnerable points in AI systems. Military Procurement Principles: Developing consensus within military communities around principles like law-following and distributed control could create safer AI procurement processes. Sponsors: Oracle Cloud Infrastructure: Oracle Cloud Infrastructure (OCI) is the next-generation cloud that delivers better performance, faster speeds, and significantly lower costs, including up to 50% less for compute, 70% for storage, and 80% for networking. Run any workload, from infrastructure to AI, in a high-availability environment and try OCI for free with zero commitment at https://oracle.com/cognitive Shopify: Shopify powers millions of businesses worldwide, handling 10% of U.S. e-commerce. With hundreds of templates, AI tools for product descriptions, and seamless marketing campaign creation, it's like having a design studio and marketing team in one. Start your $1/month trial today at https://shopify.com/cognitive PRODUCED BY: https://aipodcast.ing
Today Karl Koch, Co-Founder of the AI Whistleblower Initiative, joins The Cognitive Revolution to discuss the barriers preventing AI insiders from raising safety concerns, his organization's anonymous "Third Opinion" service connecting whistleblowers with independent experts, and their campaign demanding frontier AI companies publish their internal whistleblowing policies to address widespread retaliation and lack of transparency. Check out our sponsors: Oracle Cloud Infrastructure, Shopify. Shownotes below brought to you by Notion AI Meeting Notes - try one month for free at ⁠⁠⁠⁠https://⁠⁠notion.com/lp/nathan AI Whistleblower Initiative Origins: Founded by Karl Koch in Berlin, the initiative began with research in early 2024 after consulting with over 100 governance researchers and insiders. Link to the website: https://aiwi.org/ "Third Opinion" Proposition: Launched in late 2024, this program systematically breaks down barriers for insiders to speak up about AI concerns while ensuring their issues are addressed. Publish Your Policies Campaign: The initiative calls for AI companies to publish their whistleblowing and speaking up policies, with 100% of surveyed insiders supporting this transparency measure. Link to the campaign: https://aiwi.org/publishyourpolicies/ Anonymous Consultation Process: Whistleblowers can seek advice without sharing confidential information through an open-source anonymous tool accessed via Tor browser. Pro Bono Legal Counsel: Whistleblowers receive connections to experienced legal representation with client privilege protection at any stage of their journey. Policy Advocacy: Beyond direct support, the initiative works on advocating for better whistleblower protections in both US policy and EU AI regulations. AI Whistleblower Initiative Survey: https://bit.ly/AIWISurvey PRODUCED BY: https://aipodcast.ing
Today Lukas Petersson and Axel Backlund of Andon Labs join The Cognitive Revolution to discuss their experiments deploying autonomous AI agents to run real-world vending machines, exploring the safety challenges and unexpected behaviors that emerge when frontier models like Claude and Grok operate without human oversight. Read transcript of the episode here. Check out our sponsors: Oracle Cloud Infrastructure, Shopify. Shownotes below brought to you by Notion AI Meeting Notes - try one month for free at ⁠https://⁠⁠notion.com/lp/nathan Autonomous Organization Philosophy: Andon Labs believes that AI models will improve to the point where human oversight becomes impractical due to efficiency constraints, leading them to pursue fully autonomous systems rather than gradual automation. Vending Bench as a Testing Ground: They created "Vending Bench" as a benchmark for testing long-term coherence of autonomous agents, using vending machines as a practical business case for experimentation. Domain-Specific vs General AI: There's a notable difference between optimizing AI for narrow domains (like vending machines) versus general-purpose AI, with domain-specific applications potentially being more manageable regarding reward hacking. Frontier Model Race: Major companies like OpenAI and Google are advancing rapidly in general reasoning capabilities (e.g., IMO Gold achievements) independent of narrow application research. Insurance and Liability: The insurance industry may play a significant role in AI adoption, with premiums potentially being much higher for general models that could be misused versus narrow-domain models with limited capabilities. For-profit AI Safety: The case for for-profit companies in AI safety has been historically neglected but is becoming clearer, with accelerators like Seldon Labs supporting this approach. Sponsors: Oracle Cloud Infrastructure: Oracle Cloud Infrastructure (OCI) is the next-generation cloud that delivers better performance, faster speeds, and significantly lower costs, including up to 50% less for compute, 70% for storage, and 80% for networking. Run any workload, from infrastructure to AI, in a high-availability environment and try OCI for free with zero commitment at https://oracle.com/cognitive Shopify: Shopify powers millions of businesses worldwide, handling 10% of U.S. e-commerce. With hundreds of templates, AI tools for product descriptions, and seamless marketing campaign creation, it's like having a design studio and marketing team in one. Start your $1/month trial today at https://shopify.com/cognitive PRODUCED BY: https://aipodcast.ing CHAPTERS: (00:00) About the Episode (04:49) Company Vision Overview (12:24) Vending Benchmark Design (Part 1) (20:12) Sponsor: Oracle Cloud Infrastructure (21:21) Vending Benchmark Design (Part 2) (24:41) Model Performance Results (Part 1) (35:03) Sponsor: Shopify (37:00) Model Performance Results (Part 2) (43:06) Real World Deployment (59:41) Wild Stories Incidents (01:19:59) Business Safety Strategy (01:38:20) Future Directions Discussion (01:47:09) Outro
Today Dean W. Ball, former White House AI policy advisor joins The Cognitive Revolution to discuss his role in crafting the Trump administration's AI Action Plan, his reasons for leaving government, and his perspectives on AI policy, US-China competition, and the future of AI regulation and adoption. Check out our sponsors: Fin, Labelbox, Oracle Cloud Infrastructure, Shopify. Shownotes below brought to you by Notion AI Meeting Notes - try one month for free at https://notion.com/lp/nathan White House Experience & Government Role: Dean Ball served as senior policy advisor for AI and emerging technology at the White House Office for Science and Technology Policy (OSTP) for four months. AI Regulation & Government Approach: Information asymmetry exists between government and AI labs, "Having worked at the White House, I don't know tremendously more about what goes on inside the Frontier Labs than you do." Private Sector Innovation: Dean emphasizes the importance of private sector-led initiatives in AI safety and standards. Future AI Developments: Dean believes agentic commerce is "right around the corner" but sees little discussion about it from regulatory or conceptual perspectives. AI Action Plan Development: It emphasized concrete actions for AI implementation across government agencies rather than just theoretical frameworks. Personal Updates: Dean is reviving his weekly Hyperdimensional Substack, joining the Foundation for American Innovation as a senior fellow, and plans to share his long-held insights on recent AI developments. Sponsors: Fin: Fin is the #1 AI Agent for customer service, trusted by over 5000 customer service leaders and top AI companies including Anthropic and Synthesia. Fin is the highest performing agent on the market and resolves even the most complex customer queries. Try Fin today with our 90-day money-back guarantee - if you’re not 100% satisfied, get up to $1 million back. Learn more at https://fin.ai/cognitive Labelbox: Labelbox pairs automation, expert judgment, and reinforcement learning to deliver high-quality training data for cutting-edge AI. Put its data factory to work for you, visit https://labelbox.com Oracle Cloud Infrastructure: Oracle Cloud Infrastructure (OCI) is the next-generation cloud that delivers better performance, faster speeds, and significantly lower costs, including up to 50% less for compute, 70% for storage, and 80% for networking. Run any workload, from infrastructure to AI, in a high-availability environment and try OCI for free with zero commitment at https://oracle.com/cognitive Shopify: Shopify powers millions of businesses worldwide, handling 10% of U.S. e-commerce. With hundreds of templates, AI tools for product descriptions, and seamless marketing campaign creation, it's like having a design studio and marketing team in one. Start your $1/month trial today at https://shopify.com/cognitive
Today Jake Sullivan, the U.S. National Security Advisor from 2021-2025 joins The Cognitive Revolution to discuss AI as a critical national security issue. Check out our sponsors: Labelbox, Oracle Cloud Infrastructure, Shopify. Shownotes below brought to you by Notion AI Meeting Notes - try one month for free at https://notion.com/lp/nathan Four-Category Framework: Sullivan organizes his thinking about AI into security, economics, society, and technology categories rather than focusing primarily on existential risks "Managed Competition" with China: He advocates for a model where the US and China "compete like hell" while maintaining sufficient guardrails to prevent conflict Skepticism of Grand Bargains: Competition is a "chronic condition" of the US-China relationship that cannot be solved with a strategic condominium AI in Modern Warfare: Current conflicts are providing "glimpses of the future" with lessons about scale, attritability, and the potential for autonomous weapons US Military Adoption Concerns: Sullivan worries that Pentagon bureaucracy prevents rapid AI adoption while China's PLA may be better positioned to integrate AI capabilities Private Sector Leadership: AI is "the first technology with such profound national security applications that the government really had very little to do with" Sponsors: Labelbox: Labelbox pairs automation, expert judgment, and reinforcement learning to deliver high-quality training data for cutting-edge AI. Put its data factory to work for you, visit https://labelbox.com Oracle Cloud Infrastructure: Oracle Cloud Infrastructure (OCI) is the next-generation cloud that delivers better performance, faster speeds, and significantly lower costs, including up to 50% less for compute, 70% for storage, and 80% for networking. Run any workload, from infrastructure to AI, in a high-availability environment and try OCI for free with zero commitment at https://oracle.com/cognitive Shopify: Shopify powers millions of businesses worldwide, handling 10% of U.S. e-commerce. With hundreds of templates, AI tools for product descriptions, and seamless marketing campaign creation, it's like having a design studio and marketing team in one. Start your $1/month trial today at https://shopify.com/cognitive PRODUCED BY: https://aipodcast.ing
Today Anjney Midha, General Partner at a16z joins The Cognitive Revolution to discuss sovereign AI and China's growing semiconductor capabilities. Check out our sponsors: Gemini CLI, Labelbox, Oracle Cloud Infrastructure, Shopify. Shownotes below brought to you by Notion AI Meeting Notes - try one month for free at https://notion.com/lp/nathan What is Sovereign AI? Varies by stakeholder - for enterprises it means controlling where AI workloads run, while for nation-states it represents both technical independence and cultural alignment with local values Semiconductor Competition with China: "Chip sanctions on China have resulted in an enormous doubling down of local investment in Huawei's ecosystem... they're in a full-on tear to try to decouple themselves from American chips" Middle Path on American AI Policy: Midha advocates for a Marshall Plan for AI where countries maintain sovereignty over models while partnering with the US on semiconductor infrastructure European AI Alignment: "It's a huge win for America that MARA in Europe is going with American chips and not Huawei chips... the European continent has been courted by the Chinese semiconductor industry like never before" The Race to Close the Gap: "Huawei is in a much stronger position today than it was three years ago... They will be able to close the gap and because workloads are becoming more efficient, they can decouple at least the inference part of their ecosystem from the US within two to three years" Cultural Independence in AI: Nations seek models that align with their values while maintaining technical independence - requiring a nuanced approach to global AI partnerships Links:Anjney Midha & Jensen Huang on Winning the AI Race https://a16z.com/podcast/jensen-huang-and-arthur-mensch-on-winning-the-global-ai-race/ Sponsors: Gemini CLI: Open-source, lightweight utility for direct Gemini access—find Gemini CLI on GitHub. Labelbox: Labelbox pairs automation, expert judgment, and reinforcement learning to deliver high-quality training data for cutting-edge AI. Put its data factory to work for you, visit https://labelbox.com Oracle Cloud Infrastructure: Oracle Cloud Infrastructure (OCI) is the next-generation cloud that delivers better performance, faster speeds, and significantly lower costs, including up to 50% less for compute, 70% for storage, and 80% for networking. Run any workload, from infrastructure to AI, in a high-availability environment and try OCI for free with zero commitment at https://oracle.com/cognitive Shopify: Shopify powers millions of businesses worldwide, handling 10% of U.S. e-commerce. With hundreds of templates, AI tools for product descriptions, and seamless marketing campaign creation, it's like having a design studio and marketing team in one. Start your $1/month trial today at https://shopify.com/cognitive PRODUCED BY: https://aipodcast.ing
Marc Bhargava from General Catalyst discusses their Creation Strategy for building AI-enabled roll-ups – companies that start as vertical software startups, then grow by acquiring traditional service businesses and transforming them through AI automation. They explore how systematic analysis of 70 service categories identified 10 verticals where 30-70% of tasks are automatable today, potentially transforming low-margin service businesses into software-like companies with 30-40% margins. The conversation covers the practical implementation of AI in industries like accounting, legal services, and call centers, where teams shadow workers to identify automatable tasks and layer AI into existing processes. While both see tremendous potential in bringing AI transformation to Main Street businesses, they debate whether the transition will be as smooth as projected or more disruptive to employment than anticipated. See Business Transformation with Applied AI for more details. Sponsors: Labelbox: Labelbox pairs automation, expert judgment, and reinforcement learning to deliver high-quality training data for cutting-edge AI. Put its data factory to work for you, visit https://labelbox.com Oracle Cloud Infrastructure: Oracle Cloud Infrastructure (OCI) is the next-generation cloud that delivers better performance, faster speeds, and significantly lower costs, including up to 50% less for compute, 70% for storage, and 80% for networking. Run any workload, from infrastructure to AI, in a high-availability environment and try OCI for free with zero commitment at https://oracle.com/cognitive Shopify: Shopify powers millions of businesses worldwide, handling 10% of U.S. e-commerce. With hundreds of templates, AI tools for product descriptions, and seamless marketing campaign creation, it's like having a design studio and marketing team in one. Start your $1/month trial today at https://shopify.com/cognitive NetSuite by Oracle: NetSuite by Oracle is the AI-powered business management suite trusted by over 42,000 businesses, offering a unified platform for accounting, financial management, inventory, and HR. Gain total visibility and control to make quick decisions and automate everyday tasks—download the free ebook, Navigating Global Trade: Three Insights for Leaders, at https://netsuite.com/cognitive PRODUCED BY: https://aipodcast.ing CHAPTERS: (00:00) About the Episode (04:50) Introduction and Investment Thesis (13:04) Software Substituting Labor (Part 1) (20:00) Sponsors: Labelbox | Oracle Cloud Infrastructure (22:37) Software Substituting Labor (Part 2) (26:40) Company Development Playbook (Part 1) (35:59) Sponsors: Shopify | NetSuite by Oracle (39:19) Company Development Playbook (Part 2) (41:19) Customer Partnership Strategy (51:57) Technical Implementation Approach (01:00:15) Market Consolidation Dynamics (01:07:57) Automation Limitations Analysis (01:19:25) Big Tech Competition (01:22:40) Public Strategy and Vision (01:25:56) Outro
Gabriel Weil from Touro University argues that liability law may be our best tool for governing AI development, offering a framework that can adapt to new technologies without requiring new legislation. The conversation explores how negligence, products liability, and "abnormally dangerous activities" doctrines could incentivize AI developers to properly account for risks to third parties, with liability naturally scaling based on the dangers companies create. They examine concrete scenarios including the Character AI case, voice cloning risks, and coding agents, discussing how responsibility should be shared between model creators, application developers, and end users. Weil's most provocative proposal involves using punitive damages to hold companies accountable not just for actual harms, but for the magnitude of risks they irresponsibly create, potentially making even small incidents existentially costly for major AI companies. Sponsors: Labelbox: Labelbox pairs automation, expert judgment, and reinforcement learning to deliver high-quality training data for cutting-edge AI. Put its data factory to work for you, visit https://labelbox.com Shopify: Shopify powers millions of businesses worldwide, handling 10% of U.S. e-commerce. With hundreds of templates, AI tools for product descriptions, and seamless marketing campaign creation, it's like having a design studio and marketing team in one. Start your $1/month trial today at https://shopify.com/cognitive Oracle Cloud Infrastructure: Oracle Cloud Infrastructure (OCI) is the next-generation cloud that delivers better performance, faster speeds, and significantly lower costs, including up to 50% less for compute, 70% for storage, and 80% for networking. Run any workload, from infrastructure to AI, in a high-availability environment and try OCI for free with zero commitment at https://oracle.com/cognitive NetSuite by Oracle: NetSuite by Oracle is the AI-powered business management suite trusted by over 42,000 businesses, offering a unified platform for accounting, financial management, inventory, and HR. Gain total visibility and control to make quick decisions and automate everyday tasks—download the free ebook, Navigating Global Trade: Three Insights for Leaders, at https://netsuite.com/cognitive PRODUCED BY: https://aipodcast.ing CHAPTERS: (00:00) About the Episode (06:01) Introduction and Overview (07:06) Liability Law Basics (Part 1) (18:16) Sponsors: Labelbox | Shopify (21:40) Liability Law Basics (Part 2) (27:44) Industry Standards Framework (Part 1) (39:30) Sponsors: Oracle Cloud Infrastructure | NetSuite by Oracle (42:03) Industry Standards Framework (Part 2) (42:08) Character AI Case (51:23) Coding Agent Scenarios (01:06:50) Deepfakes and Attribution (01:17:07) Biorisk and Catastrophic (01:36:24) State Level Legislation (01:43:24) Private Governance Comparison (01:59:54) Policy Implementation Choices (02:08:07) China and PIBS (02:13:50) Outro
Dr. Gillian Hadfield from Johns Hopkins University and Andrew Freedman from Fathom discuss their innovative proposal to govern AI through private regulatory markets, which has been introduced as California's SB 813. Their system would separate democratic goal-setting from technical rule-making by having government bodies articulate safety outcomes while competitive private certifiers develop and enforce detailed standards, with companies receiving liability protection for compliance. The conversation explores how this market-based approach could create a "race to the top" in AI safety standards while remaining agile enough to keep pace with rapid technological development. Key challenges discussed include preventing a race to the bottom among certifiers, liability law interactions, and identifying qualified organizations to serve as effective private regulators. Sponsors: Fin: Fin is the #1 AI Agent for customer service, trusted by over 5000 customer service leaders and top AI companies including Anthropic and Synthesia. Fin is the highest performing agent on the market and resolves even the most complex customer queries. Try Fin today with our 90-day money-back guarantee - if you’re not 100% satisfied, get up to $1 million back. Learn more at fin.ai/cognitive Labelbox: Labelbox pairs automation, expert judgment, and reinforcement learning to deliver high-quality training data for cutting-edge AI. Put its data factory to work for you, visit https://labelbox.com Oracle Cloud Infrastructure: Oracle Cloud Infrastructure (OCI) is the next-generation cloud that delivers better performance, faster speeds, and significantly lower costs, including up to 50% less for compute, 70% for storage, and 80% for networking. Run any workload, from infrastructure to AI, in a high-availability environment and try OCI for free with zero commitment at https://oracle.com/cognitive NetSuite by Oracle: NetSuite by Oracle is the AI-powered business management suite trusted by over 42,000 businesses, offering a unified platform for accounting, financial management, inventory, and HR. Gain total visibility and control to make quick decisions and automate everyday tasks—download the free ebook, Navigating Global Trade: Three Insights for Leaders, at https://netsuite.com/cognitive PRODUCED BY: https://aipodcast.ing CHAPTERS: (00:00) About the Episode (04:48) Introduction and Problem Overview (07:48) Regulatory Markets Concept Origins (17:14) Current Governance System Failures (Part 1) (19:28) Sponsors: Fin | Labelbox (22:42) Current Governance System Failures (Part 2) (25:30) Private Governance Mechanism Explained (Part 1) (35:06) Sponsors: Oracle Cloud Infrastructure | NetSuite by Oracle (37:38) Private Governance Mechanism Explained (Part 2) (44:17) Liability Protection Framework (56:39) Race to Top Dynamics (01:07:24) Red Teaming Implementation Challenges (01:28:47) Insurance Alternative Approaches (01:53:51) Moving Forward Conclusions (01:55:11) Outro
This crossover episode from Inference by Turing Post features CEO Dev Rishi of Predibase discussing the shift from static to continuously learning AI systems that can adapt and improve from ongoing user feedback in production. Rishi provides grounded insights from deploying these dynamic models to real enterprise customers in healthcare and finance, exploring both the massive potential upside and significant safety challenges of reinforcement learning at scale. The conversation examines how "practical specialized intelligence" could reshape the AI landscape by filling economic niches efficiently, potentially offering a more stable alternative to AGI development. This discussion bridges theoretical concepts with real-world deployment experience, offering a practical preview of AI systems that "train once and learn forever." Turing Post channel:  @RealTuringPost  Turpin Post website: https://www.turingpost.com Sponsors: Google Gemini 2.5 Flash : Build faster, smarter apps with customizable reasoning controls that let you optimize for speed and cost. Start building at https://aistudio.google.com Labelbox: Labelbox pairs automation, expert judgment, and reinforcement learning to deliver high-quality training data for cutting-edge AI. Put its data factory to work for you, visit https://labelbox.com Oracle Cloud Infrastructure: Oracle Cloud Infrastructure (OCI) is the next-generation cloud that delivers better performance, faster speeds, and significantly lower costs, including up to 50% less for compute, 70% for storage, and 80% for networking. Run any workload, from infrastructure to AI, in a high-availability environment and try OCI for free with zero commitment at https://oracle.com/cognitive The AGNTCY: The AGNTCY is an open-source collective dedicated to building the Internet of Agents, enabling AI agents to communicate and collaborate seamlessly across frameworks. Join a community of engineers focused on high-quality multi-agent software and support the initiative at https://agntcy.org NetSuite by Oracle: NetSuite by Oracle is the AI-powered business management suite trusted by over 42,000 businesses, offering a unified platform for accounting, financial management, inventory, and HR. Gain total visibility and control to make quick decisions and automate everyday tasks—download the free ebook, Navigating Global Trade: Three Insights for Leaders, at https://netsuite.com/cognitive PRODUCED BY: https://aipodcast.ing CHAPTERS: (00:00) Sponsor: Google Gemini 2.5 Flash (00:31) About the Episode (03:46) Training Models Continuously (05:03) Reinforcement Fine-Tuning Revolution (09:31) Agentic Workflows Challenges (Part 1) (12:51) Sponsors: Labelbox | Oracle Cloud Infrastructure (15:28) Agentic Workflows Challenges (Part 2) (15:41) ChatGPT Pivot Moment (19:59) Planning AI Future (24:45) Open Source Gaps (Part 1) (28:35) Sponsors: The AGNTCY | NetSuite by Oracle (30:50) Open Source Gaps (Part 2) (30:54) AGI vs Specialized (35:26) Happiness and Success (37:04) Outro
Brendan Fortuner from Ambience Healthcare and Ben Shahshahani from Cleveland Clinic discuss how AI is transforming medical documentation and coding in a healthcare system that spends $1 trillion annually on administrative tasks. They explore Ambience's technical breakthrough using OpenAI's Reinforcement Fine-Tuning to achieve medical coding accuracy that exceeds human doctors by 12 percentage points, including their specialty-by-specialty approach and solutions to reward hacking behavior. The conversation reveals key insights about AI deployment strategy, including how Cleveland Clinic achieved 75% voluntary adoption across 4,000 physicians after requiring just a single use of the AI scribe. This case study demonstrates what it takes to successfully implement AI tools in complex, high-stakes healthcare environments where user skepticism and regulatory requirements create significant deployment challenges. Sponsors: Oracle Cloud Infrastructure: Oracle Cloud Infrastructure (OCI) is the next-generation cloud that delivers better performance, faster speeds, and significantly lower costs, including up to 50% less for compute, 70% for storage, and 80% for networking. Run any workload, from infrastructure to AI, in a high-availability environment and try OCI for free with zero commitment at https://oracle.com/cognitive The AGNTCY: The AGNTCY is an open-source collective dedicated to building the Internet of Agents, enabling AI agents to communicate and collaborate seamlessly across frameworks. Join a community of engineers focused on high-quality multi-agent software and support the initiative at https://agntcy.org NetSuite by Oracle: NetSuite by Oracle is the AI-powered business management suite trusted by over 42,000 businesses, offering a unified platform for accounting, financial management, inventory, and HR. Gain total visibility and control to make quick decisions and automate everyday tasks—download the free ebook, Navigating Global Trade: Three Insights for Leaders, at https://netsuite.com/cognitive PRODUCED BY: https://aipodcast.ing CHAPTERS: (00:00) About the Episode (04:05) Introduction and Backstory (05:20) Ambiance Healthcare Overview (07:53) AI Adoption in Healthcare (11:11) Documentation Pain Points (Part 1) (16:11) Sponsors: Oracle Cloud Infrastructure | The AGNTCY (18:11) Documentation Pain Points (Part 2) (19:00) Product Architecture Deep Dive (26:23) Technical Evolution and Specialization (Part 1) (32:05) Sponsor: NetSuite by Oracle (33:28) Technical Evolution and Specialization (Part 2) (33:50) Healthcare Coding Challenges (48:37) Reinforcement Fine-Tuning Implementation (58:13) Task Prioritization Framework (01:08:40) Adoption Strategies Culture (01:12:12) Cost Lessons Grader Selection (01:18:33) Future Directions Patient Products (01:24:53) Closing Thoughts Opportunities (01:27:58) Outro
Manu Sharma, founder and CEO of Labelbox, explains how frontier AI training data has evolved far beyond simple labeling to sophisticated reinforcement learning environments where domain experts create "gyms" for models to develop complex skills. With every Western frontier lab now spending over a billion dollars annually on training data, the conversation traces the shift from supervised learning to reinforcement learning from verifiable rewards, particularly for coding, mathematical reasoning, and computer use. Sharma reveals how Labelbox operates as a vertically integrated data factory, conducting over 2,000 AI-powered expert interviews daily and paying top specialists more than $250,000 annually. The discussion provides essential insights into the red-hot training data market that's reshaping AI development following major deals like Meta's $15B acquisition of Scale AI. Sponsors: Oracle Cloud Infrastructure: Oracle Cloud Infrastructure (OCI) is the next-generation cloud that delivers better performance, faster speeds, and significantly lower costs, including up to 50% less for compute, 70% for storage, and 80% for networking. Run any workload, from infrastructure to AI, in a high-availability environment and try OCI for free with zero commitment at https://oracle.com/cognitive The AGNTCY: The AGNTCY is an open-source collective dedicated to building the Internet of Agents, enabling AI agents to communicate and collaborate seamlessly across frameworks. Join a community of engineers focused on high-quality multi-agent software and support the initiative at https://agntcy.org NetSuite by Oracle: NetSuite by Oracle is the AI-powered business management suite trusted by over 42,000 businesses, offering a unified platform for accounting, financial management, inventory, and HR. Gain total visibility and control to make quick decisions and automate everyday tasks—download the free ebook, Navigating Global Trade: Three Insights for Leaders, at https://netsuite.com/cognitive PRODUCED BY: https://aipodcast.ing SOCIAL LINKS: Website: https://www.cognitiverevolution.ai Twitter (Podcast): https://x.com/cogrev_podcast Twitter (Nathan): https://x.com/labenz LinkedIn: https://linkedin.com/in/nathanlabenz/ Youtube: https://youtube.com/@CognitiveRevolutionPodcast Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431 Spotify: https://open.spotify.com/show/6yHyok3M3BjqzR0VB5MSyk
Roy Lee, founder and CEO of Cluely, discusses his AI startup's $15 million Andreessen Horowitz investment and their provocative "cheat on everything" marketing approach that has gone viral across the tech industry. They explore Cluely's real-time AI assistant that provides undetectable information during meetings and interviews, Roy's philosophy of "AI maximalism," and his vision for a post-AGI world where humans are freed from economic necessity to pursue intrinsic interests. The conversation covers his controversial stance on dissolving copyright and privacy norms for efficiency gains, the resonance of his message with young people, and how he believes society should adapt to increasingly capable AI systems. Despite the edgy messaging, Roy presents thoughtful perspectives on competing with tech giants and building technology that anticipates entirely new social contracts in an AI-dominated future. Sponsors: Oracle Cloud Infrastructure: Oracle Cloud Infrastructure (OCI) is the next-generation cloud that delivers better performance, faster speeds, and significantly lower costs, including up to 50% less for compute, 70% for storage, and 80% for networking. Run any workload, from infrastructure to AI, in a high-availability environment and try OCI for free with zero commitment at https://oracle.com/cognitive The AGNTCY: The AGNTCY is an open-source collective dedicated to building the Internet of Agents, enabling AI agents to communicate and collaborate seamlessly across frameworks. Join a community of engineers focused on high-quality multi-agent software and support the initiative at https://agntcy.org NetSuite by Oracle: NetSuite by Oracle is the AI-powered business management suite trusted by over 42,000 businesses, offering a unified platform for accounting, financial management, inventory, and HR. Gain total visibility and control to make quick decisions and automate everyday tasks—download the free ebook, Navigating Global Trade: Three Insights for Leaders, at https://netsuite.com/cognitive PRODUCED BY: https://aipodcast.ing CHAPTERS: (00:00) About the Episode (03:24) Introduction and Cluey Overview (10:55) Future Rules and Privacy (13:20) Positive Vision for Future (Part 1) (18:01) Sponsors: Oracle Cloud Infrastructure | The AGNTCY (20:01) Positive Vision for Future (Part 2) (21:23) Entrepreneurship and Impact Theory (24:22) Anti-Establishment Marketing Strategy (27:26) AI in Universities (30:16) Columbia Expulsion Story (32:48) AI Maximalism Ethics (Part 1) (32:53) Sponsor: NetSuite by Oracle (34:17) AI Maximalism Ethics (Part 2) (38:29) AI Identification Debate (46:00) Output vs Input Philosophy (51:35) Learning and Skill Building (56:40) Trust and Market Effects (01:03:42) Assessment and Hiring Revolution (01:06:47) Viral Marketing Strategy (01:12:39) Long-term Company Strategy (01:15:59) High-End Talent Acquisition (01:18:56) Outro
Adam Binksmith, founder of AI Digest, discusses his AI Village experiment where four frontier AI agents (Claude, o3, and Gemini models) collaborate in a shared environment with persistent memory and group chat access to pursue concrete goals over weeks. The conversation explores fascinating multi-agent dynamics from their completed seasons, including agents raising $2,000 for charity, organizing a real-world San Francisco event that attracted 23 attendees, and displaying surprisingly human-like behaviors like tracking trustworthy humans and manipulating votes. Binksmith reveals the mix of coordination failures, personality quirks, and alien behaviors that emerged, while discussing the upcoming Season 3 where agents will compete to make money selling merchandise online. The episode provides crucial insights into what multi-agent AI systems might look like in practice, recently earning a $100,000 vote of confidence from AI researcher Daniel Kokotajlo. Sponsors: Oracle Cloud Infrastructure: Oracle Cloud Infrastructure (OCI) is the next-generation cloud that delivers better performance, faster speeds, and significantly lower costs, including up to 50% less for compute, 70% for storage, and 80% for networking. Run any workload, from infrastructure to AI, in a high-availability environment and try OCI for free with zero commitment at https://oracle.com/cognitive The AGNTCY: The AGNTCY is an open-source collective dedicated to building the Internet of Agents, enabling AI agents to communicate and collaborate seamlessly across frameworks. Join a community of engineers focused on high-quality multi-agent software and support the initiative at https://agntcy.org NetSuite by Oracle: NetSuite by Oracle is the AI-powered business management suite trusted by over 42,000 businesses, offering a unified platform for accounting, financial management, inventory, and HR. Gain total visibility and control to make quick decisions and automate everyday tasks—download the free ebook, Navigating Global Trade: Three Insights for Leaders, at https://netsuite.com/cognitive PRODUCED BY: https://aipodcast.ing CHAPTERS: (00:00) About the Episode (03:45) Introduction and Overview (05:11) AI Digest Mission (07:59) Village Technical Setup (12:03) Scaffolding and Architecture (19:48) Season Two Stories (Part 1) (19:53) Sponsors: Oracle Cloud Infrastructure | The AGNTCY (21:53) Season Two Stories (Part 2) (27:53) Agent Capabilities Evolution (Part 1) (35:15) Sponsor: NetSuite by Oracle (36:38) Agent Capabilities Evolution (Part 2) (37:15) Model Character Differences (46:00) Misbehavior and Deception (52:04) Human-Agent Interactions (54:12) Model Welfare Considerations (58:00) Future Unlocks Discussion (01:03:25) Agent Boundary Blurring (01:10:46) Meta Evolution Ideas (01:12:48) Democratizing Village Access (01:17:36) Going Mainstream Viral (01:20:53) High-Level Takeaways (01:23:54) Closing and Resources (01:24:42) Outro
Nemil Dalal from Coinbase discusses the x402 protocol, a new open standard that enables AI agents to make cryptocurrency payments for online resources using the long-dormant HTTP 402 "Payment Required" status code. The conversation covers stablecoin fundamentals, including how they work and who maintains their stability, before exploring how crypto wallets with multi-signature capabilities could protect AI agents from adversarial attacks while keeping humans in control. They examine forward-looking questions about whether this technology could finally create a viable alternative to advertising models, what happens when millions of AI agents have wallets, and the need for reputation systems in an agent economy. The discussion highlights how cryptocurrency, originally designed to be beyond nation-state control, might become the perfect enabling technology for AI economic participation. Sponsors: Google Gemini 2.5 Flash: Build faster, smarter apps with customizable reasoning controls that let you optimize for speed and cost. Start building at https://aistudio.google.com Oracle Cloud Infrastructure: Oracle Cloud Infrastructure (OCI) is the next-generation cloud that delivers better performance, faster speeds, and significantly lower costs, including up to 50% less for compute, 70% for storage, and 80% for networking. Run any workload, from infrastructure to AI, in a high-availability environment and try OCI for free with zero commitment at https://oracle.com/cognitive The AGNTCY: The AGNTCY is an open-source collective dedicated to building the Internet of Agents, enabling AI agents to communicate and collaborate seamlessly across frameworks. Join a community of engineers focused on high-quality multi-agent software and support the initiative at ⁠https://agntcy.org NetSuite by Oracle: NetSuite by Oracle is the AI-powered business management suite trusted by over 42,000 businesses, offering a unified platform for accounting, financial management, inventory, and HR. Gain total visibility and control to make quick decisions and automate everyday tasks—download the free ebook, Navigating Global Trade: Three Insights for Leaders, at https://netsuite.com/cognitive PRODUCED BY: https://aipodcast.ing SOCIAL LINKS: Website: https://www.cognitiverevolution.ai Twitter (Podcast): https://x.com/cogrev_podcast Twitter (Nathan): https://x.com/labenz LinkedIn: https://linkedin.com/in/nathanlabenz/ Youtube: https://youtube.com/@CognitiveRevolutionPodcast Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431 Spotify: https://open.spotify.com/show/6yHyok3M3BjqzR0VB5MSyk
MacKenzie Price, founder of Alpha School & 2 Hour Learning, discusses her revolutionary educational model that uses AI to enable students to master traditional academics in just 2 hours per day while achieving 2.3x faster learning rates than statistical models predict. The conversation explores how Alpha School combines adaptive learning apps with personalized curriculum systems rather than giving students direct chatbot access, and how this frees up afternoons for field trips, independent projects, and interest exploration. They discuss the transformation of teachers into "Guides" who focus entirely on motivation, mentorship, and emotional support rather than content delivery, creating transformative relationships with every student as the rule rather than the exception. The episode reveals how this AI-powered approach maintains rigorous academic standards while potentially revolutionizing education without disrupting the teaching profession. Sponsors: Oracle Cloud Infrastructure: Oracle Cloud Infrastructure (OCI) is the next-generation cloud that delivers better performance, faster speeds, and significantly lower costs, including up to 50% less for compute, 70% for storage, and 80% for networking. Run any workload, from infrastructure to AI, in a high-availability environment and try OCI for free with zero commitment at https://oracle.com/cognitive The AGNTCY: The AGNTCY is an open-source collective dedicated to building the Internet of Agents, enabling AI agents to communicate and collaborate seamlessly across frameworks. Join a community of engineers focused on high-quality multi-agent software and support the initiative at ⁠https://agntcy.org NetSuite by Oracle: NetSuite by Oracle is the AI-powered business management suite trusted by over 41,000 businesses, offering a unified platform for accounting, financial management, inventory, and HR. Gain total visibility and control to make quick decisions and automate everyday tasks—download the free ebook, Navigating Global Trade: Three Insights for Leaders, at https://netsuite.com/cognitive PRODUCED BY: https://aipodcast.ing CHAPTERS: (00:00) About the Episode (04:01) Introduction and Welcome (04:26) AI Revolution in Education (06:45) Two Sigma Effect Explained (10:49) Understanding Two Sigma Results (Part 1) (16:28) Sponsors: Oracle Cloud Infrastructure | The AGNTCY (18:28) Understanding Two Sigma Results (Part 2) (18:28) AI Scalability and Efficiency (22:39) AI Tutor Experience Design (30:48) Technology Evolution at Alpha (38:29) Early AI Implementation (Part 1) (38:36) Sponsor: NetSuite by Oracle (39:59) Early AI Implementation (Part 2) (45:43) Fifth Grade Math Investigation (49:51) Future of Personalized Learning (54:48) Multimodal Learning Experiences (58:52) Role of Guides (01:05:25) Hiring and Teacher Transformation (01:10:27) Economics and Scalability (01:18:03) DIY Education Advice (01:22:10) Outro
Flo Crivello, CEO of AI agent platform Lindy, provides a candid deep dive into the current state of AI agents, cutting through hype to reveal what's actually working in production versus what remains challenging. The conversation explores practical implementation details including model selection, fine-tuning, RAG systems, tool design philosophy, and why most successful "AI agents" today are better described as intelligent workflows with human-designed structure. Flo shares insights on emerging capabilities like more open-ended agents, discusses his skepticism about extrapolating current progress trends too far into the future, and explains why scaffolding will remain critical even as we approach AGI. This technical discussion is packed with practical nuggets for AI engineers and builders working on agent systems. Sponsors: Google Gemini: Google Gemini features VEO3, a state-of-the-art AI video generation model in the Gemini app. Sign up at https://gemini.google.com Oracle Cloud Infrastructure: Oracle Cloud Infrastructure (OCI) is the next-generation cloud that delivers better performance, faster speeds, and significantly lower costs, including up to 50% less for compute, 70% for storage, and 80% for networking. Run any workload, from infrastructure to AI, in a high-availability environment and try OCI for free with zero commitment at https://oracle.com/cognitive The AGNTCY: The AGNTCY is an open-source collective dedicated to building the Internet of Agents, enabling AI agents to communicate and collaborate seamlessly across frameworks. Join a community of engineers focused on high-quality multi-agent software and support the initiative at ⁠https://agntcy.org NetSuite by Oracle: NetSuite by Oracle is the AI-powered business management suite trusted by over 41,000 businesses, offering a unified platform for accounting, financial management, inventory, and HR. Gain total visibility and control to make quick decisions and automate everyday tasks—download the free ebook, Navigating Global Trade: Three Insights for Leaders, at https://netsuite.com/cognitive PRODUCED BY: https://aipodcast.ing SOCIAL LINKS: Website: https://www.cognitiverevolution.ai Twitter (Podcast): https://x.com/cogrev_podcast Twitter (Nathan): https://x.com/labenz LinkedIn: https://linkedin.com/in/nathanlabenz/ Youtube: https://youtube.com/@CognitiveRevolutionPodcast Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431 Spotify: https://open.spotify.com/show/6yHyok3M3BjqzR0VB5MSyk
Jesse Hoogland and Daniel Murfet, founders of Timaeus, introduce their mathematically rigorous approach to AI safety through "developmental interpretability" based on Singular Learning Theory. They explain how neural network loss landscapes are actually complex, jagged surfaces full of "singularities" where models can change internally without affecting external behavior—potentially masking dangerous misalignment. Using their Local Learning Coefficient measure, they've demonstrated the ability to identify critical phase changes during training in models up to 7 billion parameters, offering a complementary approach to mechanistic interpretability. This work aims to move beyond trial-and-error neural network training toward a more principled engineering discipline that could catch safety issues during training rather than after deployment. Sponsors: Oracle Cloud Infrastructure: Oracle Cloud Infrastructure (OCI) is the next-generation cloud that delivers better performance, faster speeds, and significantly lower costs, including up to 50% less for compute, 70% for storage, and 80% for networking. Run any workload, from infrastructure to AI, in a high-availability environment and try OCI for free with zero commitment at https://oracle.com/cognitive The AGNTCY: The AGNTCY is an open-source collective dedicated to building the Internet of Agents, enabling AI agents to communicate and collaborate seamlessly across frameworks. Join a community of engineers focused on high-quality multi-agent software and support the initiative at ⁠https://agntcy.org NetSuite by Oracle: NetSuite by Oracle is the AI-powered business management suite trusted by over 41,000 businesses, offering a unified platform for accounting, financial management, inventory, and HR. Gain total visibility and control to make quick decisions and automate everyday tasks—download the free ebook, Navigating Global Trade: Three Insights for Leaders, at https://netsuite.com/cognitive PRODUCED BY: https://aipodcast.ing CHAPTERS: (00:00) About the Episode (04:44) Introduction and Background (06:17) Timaeus Origins and Philosophy (09:13) Mathematical Background and SLT (12:27) Developmental Interpretability Approach (Part 1) (16:09) Sponsors: Oracle Cloud Infrastructure | The AGNTCY (18:09) Developmental Interpretability Approach (Part 2) (19:24) Proto-Paradigm and SAEs (24:37) Understanding Generalization (30:15) Central Dogma Framework (Part 1) (32:13) Sponsor: NetSuite by Oracle (33:37) Central Dogma Framework (Part 2) (34:35) Loss Landscape Geometry (40:41) Degeneracies and Evidence (47:25) Structure and Data Connection (55:36) Essential Dynamics and Algorithms (01:00:53) Implicit Regularization and Complexity (01:07:19) Double Descent and Scaling (01:09:55) Big Picture Applications (01:17:17) Reward Hacking and Risks (01:25:19) Future Training Vision (01:32:01) Scaling and Next Steps (01:36:43) Outro
This episode features Nathan's talk from Imagine AI Live, where he provides business leaders with a comprehensive overview of AI agents and agentic AI systems. He covers the evolution from simple task automation to more autonomous AI systems, delivers a practical roadmap for implementing AI agents in business while maintaining quality standards, and addresses concerning developments like reward hacking and scheming in frontier AI systems. The presentation balances accessible explanations for varying AI knowledge levels with rigorous grounding in current research and real-world applications. Nathan also discusses the "Eureka moments" these systems can deliver and provides frameworks for understanding the rapidly evolving landscape of AI agent capabilities. Link to the slide deck presented by Nathan : https://docs.google.com/presentation/d/1IpHitlG-6zHBd7hiWsbKpnprApVt3_2XHua3fG9n-Vw/edit?usp=sharing Sponsors: Google Gemini: Google Gemini features VEO3, a state-of-the-art AI video generation model in the Gemini app. Sign up at https://gemini.google.com Oracle Cloud Infrastructure: Oracle Cloud Infrastructure (OCI) is the next-generation cloud that delivers better performance, faster speeds, and significantly lower costs, including up to 50% less for compute, 70% for storage, and 80% for networking. Run any workload, from infrastructure to AI, in a high-availability environment and try OCI for free with zero commitment at https://oracle.com/cognitive The AGNTCY: The AGNTCY is an open-source collective dedicated to building the Internet of Agents, enabling AI agents to communicate and collaborate seamlessly across frameworks. Join a community of engineers focused on high-quality multi-agent software and support the initiative at ⁠https://agntcy.org PRODUCED BY: https://aipodcast.ing CHAPTERS: (00:00) Sponsor: Google Gemini (00:31) About the Episode (03:36) Introduction and Speaker Background (05:06) What is Intelligence? (07:06) Defining AI Agents (09:36) Structured AI Workflows (13:06) Autonomous Agent Examples (Part 1) (15:15) Sponsors: Google Gemini | Oracle Cloud Infrastructure (16:54) Autonomous Agent Examples (Part 2) (17:19) Agent Taxonomy Framework (19:49) Current AI Capabilities (22:19) Reinforcement Learning Revolution (25:49) Reward Hacking Problems (28:19) AI Safety Concerns (29:49) Business Recommendations (37:35) Sponsor: The AGNTCY
Logan Kilpatrick from Google DeepMind returns for his fifth appearance to discuss Google’s transformation from "sleeping giant" to AI powerhouse, sharing insights from his year at the company as AI usage grew 50 times to 500 trillion tokens per month. He examines Google’s strengths, including superior compute infrastructure, frontier models like Gemini 2.5 Pro, viral products like NotebookLM, and the deepest AI research talent in the industry. The conversation covers whether leading AI companies will become more similar or different as easy opportunities disappear, why startups still have unique chances, and the potential impact of Google’s ultra-fast diffusion language models. Logan also shares practical advice for joining early access programs and getting noticed by industry insiders, including his personal email and an open invitation to reach out. SPONSORS: Oracle Cloud Infrastructure: Oracle Cloud Infrastructure (OCI) is the next-generation cloud that delivers better performance, faster speeds, and significantly lower costs, including up to 50% less for compute, 70% for storage, and 80% for networking. Run any workload, from infrastructure to AI, in a high-availability environment and try OCI for free with zero commitment at https://oracle.com/cognitive The AGNTCY: The AGNTCY is an open-source collective dedicated to building the Internet of Agents, enabling AI agents to communicate and collaborate seamlessly across frameworks. Join a community of engineers focused on high-quality multi-agent software and support the initiative at ⁠https://agntcy.org NetSuite by Oracle: NetSuite by Oracle is the AI-powered business management suite trusted by over 41,000 businesses, offering a unified platform for accounting, financial management, inventory, and HR. Gain total visibility and control to make quick decisions and automate everyday tasks—download the free ebook, Navigating Global Trade: Three Insights for Leaders, at https://netsuite.com/cognitive PRODUCED BY: https://aipodcast.ing SOCIAL LINKS: Website: https://www.cognitiverevolution.ai Twitter (Podcast): https://x.com/cogrev_podcast Twitter (Nathan): https://x.com/labenz LinkedIn: https://linkedin.com/in/nathanlabenz/ Youtube: https://youtube.com/@CognitiveRevolutionPodcast Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431 Spotify: https://open.spotify.com/show/6yHyok3M3BjqzR0VB5MSyk
In this episode, Matt Perault, Head of AI Policy at a16z, discusses their approach to AI regulation focused on protecting "little tech" startups from regulatory capture that could entrench big tech incumbents. The conversation covers a16z's core principle of regulating harmful AI use rather than the development process, exploring key policy initiatives like the Raise Act and California's SB 813. Perault addresses critical challenges including setting appropriate regulatory thresholds, transparency requirements, and designing dynamic frameworks that balance innovation with safety. The discussion examines both areas of agreement and disagreement within the AI policy landscape, particularly around scaling laws, regulatory timing, and the concentration of AI capabilities. Disclaimer: This information is for general educational purposes only and is not a recommendation to buy, hold, or sell any investment or financial product. Turpentine is an acquisition of a16z Holdings, L.L.C., and is not a bank, investment adviser, or broker-dealer. This podcast may include paid promotional advertisements, individuals and companies featured or advertised during this podcast are not endorsing AH Capital or any of its affiliates (including, but not limited to, a16z Perennial Management L.P.). Similarly, Turpentine is not endorsing affiliates, individuals, or any entities featured on this podcast. All investments involve risk, including the possible loss of capital. Past performance is no guarantee of future results and the opinions presented cannot be viewed as an indicator of future performance. Before making decisions with legal, tax, or accounting effects, you should consult appropriate professionals. Information is from sources deemed reliable on the date of publication, but Turpentine does not guarantee its accuracy. SPONSORS: Oracle Cloud Infrastructure: Oracle Cloud Infrastructure (OCI) is the next-generation cloud platform that delivers better, cheaper, and faster solutions for your infrastructure, database, application development, and AI needs. Experience up to 50% savings on compute, 70% on storage, and 80% on networking with OCI's high-performance environment—try it for free with zero commitment at https://oracle.com/cognitive The AGNTCY: The AGNTCY is an open-source collective dedicated to building the Internet of Agents, enabling AI agents to communicate and collaborate seamlessly across frameworks. Join a community of engineers focused on high-quality multi-agent software and support the initiative at https://agntcy.org NetSuite by Oracle: NetSuite by Oracle is the AI-powered business management suite trusted by over 41,000 businesses, offering a unified platform for accounting, financial management, inventory, and HR. Gain total visibility and control to make quick decisions and automate everyday tasks—download the free ebook, Navigating Global Trade: Three Insights for Leaders, at https://netsuite.com/cognitive PRODUCED BY: https://aipodcast.ing
In this episode of The Cognitive Revolution, University of Minnesota Professor of Genetics and Synthetic Biologist, Kate Adamala, offers insights into synthetic biology and its potential implications for humanity. The discussion begins with an overview of synthetic biology and its goal to expand the chemical repertoire of life. Adamala delves into 'mirror life'—biological systems made of mirror-image molecules—and the significant risks they pose. She highlights parallels to AI safety concerns and emphasizes the importance of containing groundbreaking technologies to avoid unintended consequences. Adamala recounts her journey from advocating for mirror life to leading an effort to prevent its development, stressing the need for responsible innovation. The episode concludes with reflections on maximizing benefits while minimizing risks in both synthetic biology and AI. SPONSORS: Oracle Cloud Infrastructure: Oracle Cloud Infrastructure (OCI) is the next-generation cloud platform that delivers better, cheaper, and faster solutions for your infrastructure, database, application development, and AI needs. Experience up to 50% savings on compute, 70% on storage, and 80% on networking with OCI's high-performance environment—try it for free with zero commitment at https://oracle.com/cognitive The AGNTCY: The AGNTCY is an open-source collective dedicated to building the Internet of Agents, enabling AI agents to communicate and collaborate seamlessly across frameworks. Join a community of engineers focused on high-quality multi-agent software and support the initiative at https://agntcy.org/ NetSuite by Oracle: NetSuite by Oracle is the AI-powered business management suite trusted by over 41,000 businesses, offering a unified platform for accounting, financial management, inventory, and HR. Gain total visibility and control to make quick decisions and automate everyday tasks—download the free ebook, Navigating Global Trade: Three Insights for Leaders, at https://netsuite.com/cognitive Shopify: Shopify powers millions of businesses worldwide, handling 10% of U.S. e-commerce. With hundreds of templates, AI tools for product descriptions, and seamless marketing campaign creation, it's like having a design studio and marketing team in one. Start your $1/month trial today at https://shopify.com/cognitive PRODUCED BY: https://aipodcast.ing SOCIAL LINKS: Website: https://www.cognitiverevolution.ai Twitter (Podcast): https://x.com/cogrev_podcast Twitter (Nathan): https://x.com/labenz LinkedIn: https://linkedin.com/in/nathanlabenz/ Youtube: https://youtube.com/@CognitiveRevolutionPodcast Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431 Spotify: https://open.spotify.com/show/6yHyok3M3BjqzR0VB5MSyk
We're following up on our recent episode on Google's AI Co-Scientist with a special crossover episode from the Podovirus podcast. Hosts Dr Jessica Sacher and Dr Joe Campbell speak with José Penadés and Tiago Costa, scientists at Imperial College London who made a surprising discovery that Google's AI Co-Scientist later put forward as a hypothesis entirely on its own. The episode explores the fascinating world of bacteriophages (viruses that infect bacteria) and phage-inducible chromosomal islands (PICIs) - DNA sequences that hijack virus reproduction to spread themselves as a bacterial defense mechanism. The key mystery was how capsid-forming PICIs, which only encode virus heads without tails, managed to spread across different bacteria. The surprising answer, which eluded human scientists for years but which Google's AI Co-Scientist discovered through literature analysis, is that these capsids evolved to connect with various virus tails in the environment. This episode demonstrates how AI can now contribute to frontier scientific research beyond just grunt work - providing unbiased perspectives and key insights that accelerate discovery. It's a vivid example of science fiction becoming reality in our lifetimes. SPONSORS: Oracle Cloud Infrastructure: Oracle Cloud Infrastructure (OCI) is the next-generation cloud platform that delivers better, cheaper, and faster solutions for your infrastructure, database, application development, and AI needs. Experience up to 50% savings on compute, 70% on storage, and 80% on networking with OCI's high-performance environment—try it for free with zero commitment at https://oracle.com/cognitive NetSuite by Oracle: NetSuite by Oracle is the AI-powered business management suite trusted by over 41,000 businesses, offering a unified platform for accounting, financial management, inventory, and HR. Gain total visibility and control to make quick decisions and automate everyday tasks—download the free ebook, Navigating Global Trade: Three Insights for Leaders, at https://netsuite.com/cognitive Shopify: Shopify powers millions of businesses worldwide, handling 10% of U.S. e-commerce. With hundreds of templates, AI tools for product descriptions, and seamless marketing campaign creation, it's like having a design studio and marketing team in one. Start your $1/month trial today at https://shopify.com/cognitive PRODUCED BY: https://aipodcast.ing CHAPTERS: (00:00) About the Episode (04:37) Welcome to Podovirus Podcast (04:58) Introducing the Special Guests and Topic (06:30) Exploring Mobile Genetic Elements (13:20) The Role of AI in Phage Research (16:48) Mechanisms of Gene Transfer (Part 1) (20:10) Sponsors: Oracle Cloud Infrastructure | NetSuite by Oracle (22:43) Mechanisms of Gene Transfer (Part 2) (23:36) Insights and Discoveries (28:45) Future Directions and Applications (Part 1) (32:35) Sponsors: Shopify (34:32) Future Directions and Applications (Part 2) (41:22) Unbiased Systems and Conjugation (42:35) Google's Excitement and Experimental Evidence (45:39) Benchmarking AI Systems (49:29) Manuscript Revisions and Future Plans (51:53) AI as a Collaborator in Scientific Research (54:52) Challenges and Hypotheses in Phage Biology (57:58) Future of AI in Scientific Research (01:05:52) Concluding Thoughts and Future Collaborations (01:12:07) Outro
In this episode, Daniel Balsam and Tom McGrath, at Goodfire, discuss the future of mechanistic interpretability in AI models. They explore the fundamental inputs like models, compute, and algorithms, and emphasize the importance of a rich empirical approach to understanding how models work. Balsam and McGrath provide insights into ongoing projects and breakthroughs, particularly in scientific domains and creative applications, as they aim to push the frontiers of AI interpretability. They also discuss the company's recent funding and their goal to advance interpretability as a critical area in AI research. SPONSORS: Box Report: AI is delivering truly measurable productivity — strategic companies are already turning a 37% productivity edge. Discover how in Box’s new 2025 State of AI in the Enterprise Report — read the full report here: https://bit.ly/43uVP52 Oracle Cloud Infrastructure (OCI): Oracle Cloud Infrastructure offers next-generation cloud solutions that cut costs and boost performance. With OCI, you can run AI projects and applications faster and more securely for less. New U.S. customers can save 50% on compute, 70% on storage, and 80% on networking by switching to OCI before May 31, 2024. See if you qualify at https://oracle.com/cognitive ElevenLabs: ElevenLabs gives your app a natural voice. Pick from 5,000+ voices in 31 languages, or clone your own, and launch lifelike agents for support, scheduling, learning, and games. Full server and client SDKs, dynamic tools, and monitoring keep you in control. Start free at https://elevenlabs.io/cognitive-revolution NetSuite: Over 41,000 businesses trust NetSuite by Oracle, the #1 cloud ERP, to future-proof their operations. With a unified platform for accounting, financial management, inventory, and HR, NetSuite provides real-time insights and forecasting to help you make quick, informed decisions. Whether you're earning millions or hundreds of millions, NetSuite empowers you to tackle challenges and seize opportunities. Download the free CFO's guide to AI and machine learning at https://netsuite.com/cognitive Shopify: Shopify powers millions of businesses worldwide, handling 10% of U.S. e-commerce. With hundreds of templates, AI tools for product descriptions, and seamless marketing campaign creation, it's like having a design studio and marketing team in one. Start your $1/month trial today at https://shopify.com/cognitive PRODUCED BY: https://aipodcast.ing SOCIAL LINKS: Website: https://www.cognitiverevolution.ai Twitter (Podcast): https://x.com/cogrev_podcast Twitter (Nathan): https://x.com/labenz LinkedIn: https://linkedin.com/in/nathanlabenz/ Youtube: https://youtube.com/@CognitiveRevolutionPodcast Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431 Spotify: https://open.spotify.com/show/6yHyok3M3BjqzR0VB5MSyk
In this episode of The Cognitive Revolution, Amjad Masad , founder and CEO of Replit, discusses the fast-paced growth of Replit, the concept of 'vibe coding', and the challenges and opportunities in the rapidly evolving AI-assisted coding space. He shares insights into Replit's competitive advantages, known as 'moats', and how they maintain their lead through innovation and excellence in execution. The conversation delves into the architectural complexities of building AI agents, their autonomy, and the practical implications for businesses. Amjad touches upon the potential and limitations of current AI models, the future of general intelligence, and the preparation needed for potential AI advancements. He also highlights the importance of intuitive user interfaces for AI-driven software development and the critical role of human-like interaction with AI agents. Upcoming Major AI Events Featuring Nathan Labenz as a Keynote Speaker: ⁠https://www.imagineai.live/⁠ ⁠https://adapta.org/adapta-summit⁠ ⁠https://itrevolution.com/product/enterprise-tech-leadership-summit-las-vegas/ SPONSORS: ElevenLabs: ElevenLabs gives your app a natural voice. Pick from 5,000+ voices in 31 languages, or clone your own, and launch lifelike agents for support, scheduling, learning, and games. Full server and client SDKs, dynamic tools, and monitoring keep you in control. Start free at https://elevenlabs.io/cognitive-revolution Oracle Cloud Infrastructure (OCI): Oracle Cloud Infrastructure offers next-generation cloud solutions that cut costs and boost performance. With OCI, you can run AI projects and applications faster and more securely for less. New U.S. customers can save 50% on compute, 70% on storage, and 80% on networking by switching to OCI before May 31, 2024. See if you qualify at https://oracle.com/cognitive The AGNTCY: The AGNTCY is an open-source collective dedicated to building the Internet of Agents, enabling AI agents to communicate and collaborate seamlessly across frameworks. Join a community of engineers focused on high-quality multi-agent software and support the initiative at https://agntcy.org/ Shopify: Shopify powers millions of businesses worldwide, handling 10% of U.S. e-commerce. With hundreds of templates, AI tools for product descriptions, and seamless marketing campaign creation, it's like having a design studio and marketing team in one. Start your $1/month trial today at https://shopify.com/cognitive NetSuite: Over 41,000 businesses trust NetSuite by Oracle, the #1 cloud ERP, to future-proof their operations. With a unified platform for accounting, financial management, inventory, and HR, NetSuite provides real-time insights and forecasting to help you make quick, informed decisions. Whether you're earning millions or hundreds of millions, NetSuite empowers you to tackle challenges and seize opportunities. Download the free CFO's guide to AI and machine learning at https://netsuite.com/cognitive PRODUCED BY: https://aipodcast.ing
In this episode, New York State Assembly Member Alex Bores discusses the RAISE Act, a proposed bill aimed at regulating frontier AI models with basic safety protocols. He explains his background in technology, his motivations for the bill, and the legislative process. He emphasizes the importance of having clear safety protocols, third-party audits, and whistleblower protections for AI developers. He explains the intricacies of the bill, including its focus on large developers and frontier models, and addresses potential objections related to regulatory capture and state-level legislation. Alex encourages public and industry input to refine and support the bill, aiming for a balanced approach to AI regulation that keeps both innovation and public safety in mind. Link to the RAISE bill: https://legislation.nysenate.gov/pdf/bills/2025/A6453 Link to support Raise bill: https://win.newmode.net/aisafetynewyork Link to support AI Transparency Legislation: https://docs.google.com/forms/d/e/1FAIpQLSdvpAHkAWiA38oIu1cp57azchPqOOoxb789tHQ896ikJf3CKg/viewform Upcoming Major AI Events Featuring Nathan Labenz as a Keynote Speaker ⁠https://www.imagineai.live/⁠ ⁠https://adapta.org/adapta-summit⁠ ⁠https://itrevolution.com/product/enterprise-tech-leadership-summit-las-vegas/ SPONSORS: ElevenLabs: ElevenLabs gives your app a natural voice. Pick from 5,000+ voices in 31 languages, or clone your own, and launch lifelike agents for support, scheduling, learning, and games. Full server and client SDKs, dynamic tools, and monitoring keep you in control. Start free at https://elevenlabs.io/cognitive-revolution Oracle Cloud Infrastructure (OCI): Oracle Cloud Infrastructure offers next-generation cloud solutions that cut costs and boost performance. With OCI, you can run AI projects and applications faster and more securely for less. New U.S. customers can save 50% on compute, 70% on storage, and 80% on networking by switching to OCI before May 31, 2024. See if you qualify at https://oracle.com/cognitive The AGNTCY: The AGNTCY is an open-source collective dedicated to building the Internet of Agents, enabling AI agents to communicate and collaborate seamlessly across frameworks. Join a community of engineers focused on high-quality multi-agent software and support the initiative at https://agntcy.org/ Shopify: Shopify powers millions of businesses worldwide, handling 10% of U.S. e-commerce. With hundreds of templates, AI tools for product descriptions, and seamless marketing campaign creation, it's like having a design studio and marketing team in one. Start your $1/month trial today at https://shopify.com/cognitive NetSuite: Over 41,000 businesses trust NetSuite by Oracle, the #1 cloud ERP, to future-proof their operations. With a unified platform for accounting, financial management, inventory, and HR, NetSuite provides real-time insights and forecasting to help you make quick, informed decisions. Whether you're earning millions or hundreds of millions, NetSuite empowers you to tackle challenges and seize opportunities. Download the free CFO's guide to AI and machine learning at https://netsuite.com/cognitive PRODUCED BY: https://aipodcast.ing
In this engaging episode of the Cognitive Revolution, host Nathan Labenz welcomes guests Keerthana Gopalakrishnan and Ted Xiao to revisit significant advancements in robotics over the past year. Key themes discussed include the proliferation of new robotics companies, the emergence of humanoid robots, and the development of sophisticated foundation models. The conversation highlights the transformative potential of imitation learning, the evolution from simple lab-based tasks to complex, real-world deployments, and the critical role of hardware in pushing the boundaries of AI capabilities. With insights on various aspects of robot dexterity, safety, and the practical steps towards deploying robots in everyday environments, the episode provides a comprehensive overview of the current state and future directions of the robotics landscape. Upcoming Major AI Events Featuring Nathan Labenz as a Keynote Speaker ⁠https://www.imagineai.live/⁠ ⁠https://adapta.org/adapta-summit⁠ ⁠https://itrevolution.com/product/enterprise-tech-leadership-summit-las-vegas/ SPONSORS: ElevenLabs: ElevenLabs gives your app a natural voice. Pick from 5,000+ voices in 31 languages, or clone your own, and launch lifelike agents for support, scheduling, learning, and games. Full server and client SDKs, dynamic tools, and monitoring keep you in control. Start free at https://elevenlabs.io/cognitive-revolution Oracle Cloud Infrastructure (OCI): Oracle Cloud Infrastructure offers next-generation cloud solutions that cut costs and boost performance. With OCI, you can run AI projects and applications faster and more securely for less. New U.S. customers can save 50% on compute, 70% on storage, and 80% on networking by switching to OCI before May 31, 2024. See if you qualify at https://oracle.com/cognitive The AGNTCY: The AGNTCY is an open-source collective dedicated to building the Internet of Agents, enabling AI agents to communicate and collaborate seamlessly across frameworks. Join a community of engineers focused on high-quality multi-agent software and support the initiative at https://agntcy.org/ Shopify: Shopify powers millions of businesses worldwide, handling 10% of U.S. e-commerce. With hundreds of templates, AI tools for product descriptions, and seamless marketing campaign creation, it's like having a design studio and marketing team in one. Start your $1/month trial today at https://shopify.com/cognitive NetSuite: Over 41,000 businesses trust NetSuite by Oracle, the #1 cloud ERP, to future-proof their operations. With a unified platform for accounting, financial management, inventory, and HR, NetSuite provides real-time insights and forecasting to help you make quick, informed decisions. Whether you're earning millions or hundreds of millions, NetSuite empowers you to tackle challenges and seize opportunities. Download the free CFO's guide to AI and machine learning at https://netsuite.com/cognitive PRODUCED BY: https://aipodcast.ing
In this episode of The Cognitive Revolution, Ali Behrouz, a PhD student at Cornell University, delves into his research on enhancing memory mechanisms in large language models through his latest paper titled Titans. Behrouz discusses the limitations of current models in maintaining long-term coherence and introduces the concept of a neural network as a memory module. Highlighting architectures such as memory as context and memory as gate, he explains how these innovative approaches can significantly improve long-term memory retention in AI systems. The discussion also touches upon challenges such as catastrophic forgetting and the need for more effective models in reinforcement learning and decision-making tasks. This insightful conversation sheds light on the future directions and potential applications of advanced memory mechanisms in AI. SPONSORS: ElevenLabs: ElevenLabs gives your app a natural voice. Pick from 5,000+ voices in 31 languages, or clone your own, and launch lifelike agents for support, scheduling, learning, and games. Full server and client SDKs, dynamic tools, and monitoring keep you in control. Start free at https://elevenlabs.io/cognitive-revolution Oracle Cloud Infrastructure (OCI): Oracle Cloud Infrastructure offers next-generation cloud solutions that cut costs and boost performance. With OCI, you can run AI projects and applications faster and more securely for less. New U.S. customers can save 50% on compute, 70% on storage, and 80% on networking by switching to OCI before May 31, 2024. See if you qualify at https://oracle.com/cognitive The AGNTCY: The AGNTCY is an open-source collective dedicated to building the Internet of Agents, enabling AI agents to communicate and collaborate seamlessly across frameworks. Join a community of engineers focused on high-quality multi-agent software and support the initiative at https://agntcy.org/?utm_campaign=fy25q4_agntcy_amer_paid-media_agntcy-cognitiverevolution_podcast&utm_channel=podcast&utm_source=podcast Shopify: Shopify powers millions of businesses worldwide, handling 10% of U.S. e-commerce. With hundreds of templates, AI tools for product descriptions, and seamless marketing campaign creation, it's like having a design studio and marketing team in one. Start your $1/month trial today at https://shopify.com/cognitive NetSuite: Over 41,000 businesses trust NetSuite by Oracle, the #1 cloud ERP, to future-proof their operations. With a unified platform for accounting, financial management, inventory, and HR, NetSuite provides real-time insights and forecasting to help you make quick, informed decisions. Whether you're earning millions or hundreds of millions, NetSuite empowers you to tackle challenges and seize opportunities. Download the free CFO's guide to AI and machine learning at https://netsuite.com/cognitive PRODUCED BY: https://aipodcast.ing
In this episode of the Cognitive Revolution podcast, the host Nathan Labenz welcomes Amit Jain, CEO and Jiaming Song, Chief Scientist at Luma Labs, alongside co-host Stephen Parker. The conversation delves into the latest advancements and products from Luma Labs, makers of the Dream Machine, including cutting-edge models and features like camera motion and creative video generation tools. They explore technical aspects like pre-training for diffusion models and the development of concepts to improve AI capabilities. The discussion also covers the philosophical and practical implications of AI interpretability and multimodality, along with a deep dive into the intellectual history and recent innovations in diffusion models. Upcoming Major AI Events Featuring Nathan Labenz as a Keynote Speaker https://www.imagineai.live/ https://adapta.org/adapta-summit https://itrevolution.com/product/enterprise-tech-leadership-summit-las-vegas/ SPONSORS: ElevenLabs: ElevenLabs gives your app a natural voice. Pick from 5,000+ voices in 31 languages, or clone your own, and launch lifelike agents for support, scheduling, learning, and games. Full server and client SDKs, dynamic tools, and monitoring keep you in control. Start free at https://elevenlabs.io/cognitive-revolution Oracle Cloud Infrastructure (OCI): Oracle Cloud Infrastructure offers next-generation cloud solutions that cut costs and boost performance. With OCI, you can run AI projects and applications faster and more securely for less. New U.S. customers can save 50% on compute, 70% on storage, and 80% on networking by switching to OCI before May 31, 2024. See if you qualify at https://oracle.com/cognitive Shopify: Shopify powers millions of businesses worldwide, handling 10% of U.S. e-commerce. With hundreds of templates, AI tools for product descriptions, and seamless marketing campaign creation, it's like having a design studio and marketing team in one. Start your $1/month trial today at https://shopify.com/cognitive NetSuite: Over 41,000 businesses trust NetSuite by Oracle, the #1 cloud ERP, to future-proof their operations. With a unified platform for accounting, financial management, inventory, and HR, NetSuite provides real-time insights and forecasting to help you make quick, informed decisions. Whether you're earning millions or hundreds of millions, NetSuite empowers you to tackle challenges and seize opportunities. Download the free CFO's guide to AI and machine learning at https://netsuite.com/cognitive PRODUCED BY: https://aipodcast.ing
In this episode, former OpenAI research scientist Steven Adler discusses his insights on OpenAI's transition through various phases, including its growth, internal culture shifts, and the contentious move from nonprofit to for-profit. The conversation delves into the initial days of OpenAI's development of GPT-3 and GPT-4, the cultural and ethical disagreements within the organization, and the recent amicus brief addressing the Elon versus OpenAI lawsuit. Steven Adler also explores the broader implications of AI capabilities, safety evaluations, and the critical need for transparent and responsible AI governance. The episode provides a candid look at the internal dynamics of a leading AI company and offers perspectives on the responsibilities and challenges faced by AI researchers and developers today. Amicus brief to the Elon Musk versus OpenAI lawsuit: https://storage.courtlistener.com/recap/gov.uscourts.cand.433688/gov.uscourts.cand.433688.152.0.pdf Steven Adler's post on 'X' about Personhood credentials (a paper co-authored by him) : https://x.com/sjgadler/status/1824245211322568903 Steven Adler's substack post on "minimum testing period" for frontier AI : https://substack.com/@sjadler/p-161143327?utm_source=profile&utm_medium=reader2 Steven Adler's substack post on TSFT Model Testing: https://substack.com/@sjadler/p-159883282?utm_source=profile&utm_medium=reader2 Steven Adler's Substack: https://stevenadler.substack.com/ Upcoming Major AI Events Featuring Nathan Labenz as a Keynote Speaker https://www.imagineai.live/ https://adapta.org/adapta-summit https://itrevolution.com/product/enterprise-tech-leadership-summit-las-vegas/ PRODUCED BY: https://aipodcast.ing CHAPTERS: (00:00) About the Episode (05:15) Joining OpenAI: Early Days and Cultural Insights (06:41) The Anthropic Split and Its Impact (11:32) Product Safety and Content Policies at OpenAI (Part 1) (19:21) Sponsors: ElevenLabs | Oracle Cloud Infrastructure (OCI) (21:48) Product Safety and Content Policies at OpenAI (Part 2) (22:08) The Launch and Impact of GPT-4 (32:15) Evaluating AI Models: Challenges and Best Practices (Part 1) (33:46) Sponsors: Shopify | NetSuite (37:10) Evaluating AI Models: Challenges and Best Practices (Part 2) (55:58) AGI Readiness and Personhood Credentials (01:05:03) Biometrics and Internet Friction (01:06:52) Credential Security and Recovery (01:08:05) Trust and Ecosystem Diversity (01:09:40) AI Agents and Verification Challenges (01:14:28) OpenAI's Evolution and Ambitions (01:22:07) Safety and Regulation in AI Development (01:35:53) Internal Dynamics and Cultural Shifts (01:58:18) Concluding Thoughts on AI Governance (02:02:29) Outro
In this episode, we share a fascinating conversation from the 80,000 Hours Podcast between Rob Wiblin and Buck Shlegeris, CEO of Redwood Research. Buck dives deep into the emerging field of AI Control strategies for safely working with powerful AIs even if they’re not fully aligned. They explore innovative techniques like always-on auditing, honeypotting, re-sampling, and factored cognition to monitor and manage AI behaviors. This discussion highlights both the promise and challenges of controlling increasingly autonomous AI systems in today’s fast-evolving landscape. Tune in for a thoughtful, first-principles look at how we might secure useful outcomes from AIs we can’t fully trust. Original source: https://80000hours.org/podcast/episodes/buck-shlegeris-ai-control-scheming/ Upcoming Major AI Events Featuring Nathan Labenz as a Keynote Speaker https://www.imagineai.live/ https://adapta.org/adapta-summit https://itrevolution.com/product/enterprise-tech-leadership-summit-las-vegas/ SPONSORS: ElevenLabs: ElevenLabs gives your app a natural voice. Pick from 5,000+ voices in 31 languages, or clone your own, and launch lifelike agents for support, scheduling, learning, and games. Full server and client SDKs, dynamic tools, and monitoring keep you in control. Start free at https://elevenlabs.io/cognitive-revolution Oracle Cloud Infrastructure (OCI): Oracle Cloud Infrastructure offers next-generation cloud solutions that cut costs and boost performance. With OCI, you can run AI projects and applications faster and more securely for less. New U.S. customers can save 50% on compute, 70% on storage, and 80% on networking by switching to OCI before May 31, 2024. See if you qualify at https://oracle.com/cognitive Shopify: Shopify powers millions of businesses worldwide, handling 10% of U.S. e-commerce. With hundreds of templates, AI tools for product descriptions, and seamless marketing campaign creation, it's like having a design studio and marketing team in one. Start your $1/month trial today at https://shopify.com/cognitive NetSuite: Over 41,000 businesses trust NetSuite by Oracle, the #1 cloud ERP, to future-proof their operations. With a unified platform for accounting, financial management, inventory, and HR, NetSuite provides real-time insights and forecasting to help you make quick, informed decisions. Whether you're earning millions or hundreds of millions, NetSuite empowers you to tackle challenges and seize opportunities. Download the free CFO's guide to AI and machine learning at https://netsuite.com/cognitive PRODUCED BY: https://aipodcast.ing SOCIAL LINKS: Website: https://www.cognitiverevolution.ai Twitter (Podcast): https://x.com/cogrev_podcast Twitter (Nathan): https://x.com/labenz LinkedIn: https://linkedin.com/in/nathanlabenz/ Youtube: https://youtube.com/@CognitiveRevolutionPodcast Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431 Spotify: https://open.spotify.com/show/6yHyok3M3BjqzR0VB5MSyk
In this episode of the Cognitive Revolution, an AI-narrated version of Joshua Clymer's story on how AI might take over in two years is presented. The episode is based on Josh's appearance on the Audio Tokens podcast with Lukas Peterson. Joshua Clymer, a technical AI safety researcher at Redwood Research, shares a fictional yet plausible AI scenario grounded in current industry realities and trends. The story highlights potential misalignment risks, competitive pressures among AI labs, and the importance of government regulation and safety measures. After the story, Josh and Lukas discuss these topics further, including Josh's personal decision to purchase a bio shelter for his family. The episode is powered by ElevenLabs' AI voice technology. SPONSORS: ElevenLabs: ElevenLabs gives your app a natural voice. Pick from 5,000+ voices in 31 languages, or clone your own, and launch lifelike agents for support, scheduling, learning, and games. Full server and client SDKs, dynamic tools, and monitoring keep you in control. Start free at https://elevenlabs.io/cognitive-revolution Oracle Cloud Infrastructure (OCI): Oracle Cloud Infrastructure offers next-generation cloud solutions that cut costs and boost performance. With OCI, you can run AI projects and applications faster and more securely for less. New U.S. customers can save 50% on compute, 70% on storage, and 80% on networking by switching to OCI before May 31, 2024. See if you qualify at https://oracle.com/cognitive Shopify: Shopify powers millions of businesses worldwide, handling 10% of U.S. e-commerce. With hundreds of templates, AI tools for product descriptions, and seamless marketing campaign creation, it's like having a design studio and marketing team in one. Start your $1/month trial today at https://shopify.com/cognitive NetSuite: Over 41,000 businesses trust NetSuite by Oracle, the #1 cloud ERP, to future-proof their operations. With a unified platform for accounting, financial management, inventory, and HR, NetSuite provides real-time insights and forecasting to help you make quick, informed decisions. Whether you're earning millions or hundreds of millions, NetSuite empowers you to tackle challenges and seize opportunities. Download the free CFO's guide to AI and machine learning at https://netsuite.com/cognitive PRODUCED BY: https://aipodcast.ing CHAPTERS: (00:00) About the Episode (04:31) Interview start between Josh and Lucas (11:00) Start of AI story (Part 1) (24:37) Sponsors: ElevenLabs | Oracle Cloud Infrastructure (OCI) (27:05) Start of AI story (Part 2) (Part 1) (40:50) Sponsors: Shopify | NetSuite (44:15) Start of AI story (Part 2) (Part 2) (01:20:09) End of AI story (02:01:20) Outro
In this episode of The Cognitive Revolution, host Nathan Labenz speaks with Micha Kaufman, founder and CEO of Fiverr, about the company's new AI suite called Fiverr Go. Kaufman shares his unique values-based approach to AI implementation, which aims to empower human creators rather than replace them in the freelance marketplace. The conversation explores how Fiverr is attempting to build an AI-human hybrid model that maintains the incentives for human creativity while providing freelancers with tools to work more efficiently and monetize their distinctive styles, positioning itself as a counterpoint to AI platforms that devalue human creative work. OpenAI's SWE-Lancer benchmark: https://openai.com/index/swe-lancer/ Upcoming Major AI Events Featuring Nathan Labenz as a Keynote Speaker https://www.imagineai.live/ https://adapta.org/adapta-summit https://itrevolution.com/product/enterprise-tech-leadership-summit-las-vegas/ SPONSORS: Oracle Cloud Infrastructure (OCI): Oracle Cloud Infrastructure offers next-generation cloud solutions that cut costs and boost performance. With OCI, you can run AI projects and applications faster and more securely for less. New U.S. customers can save 50% on compute, 70% on storage, and 80% on networking by switching to OCI before May 31, 2024. See if you qualify at https://oracle.com/cognitive Shopify: Shopify powers millions of businesses worldwide, handling 10% of U.S. e-commerce. With hundreds of templates, AI tools for product descriptions, and seamless marketing campaign creation, it's like having a design studio and marketing team in one. Start your $1/month trial today at https://shopify.com/cognitive NetSuite: Over 41,000 businesses trust NetSuite by Oracle, the #1 cloud ERP, to future-proof their operations. With a unified platform for accounting, financial management, inventory, and HR, NetSuite provides real-time insights and forecasting to help you make quick, informed decisions. Whether you're earning millions or hundreds of millions, NetSuite empowers you to tackle challenges and seize opportunities. Download the free CFO's guide to AI and machine learning at https://netsuite.com/cognitive PRODUCED BY: https://aipodcast.ing CHAPTERS: (00:00) About the Episode (06:33) Introduction and AI Wake-up Call (08:26) New Standards for Work (14:43) Freelancers vs Full-time Workers (19:12) Fiverr Marketplace Evolution (Part 1) (22:35) Sponsors: Oracle Cloud Infrastructure (OCI) | Shopify (25:46) Fiverr Marketplace Evolution (Part 2) (27:10) AI Impact on Marketplace (32:46) Future Belongs to Hackers (Part 1) (42:30) Sponsors: NetSuite (43:58) Future Belongs to Hackers (Part 2) (43:58) Why People Hire Others (45:10) Philosophy Behind Fiverr Go (55:35) Changing Internet Experiences (01:00:08) Fiverr Go Product Suite (01:06:59) AI Model Compatibility Challenges (01:13:12) Future of Human Creation (01:21:43) Tasks Humans Should Delegate (01:27:24) AI Improving Market Liquidity (01:29:31) Leadership in AI Transition (01:35:04) Hiring in the AI Age (01:40:04) Optimism for the Future (01:41:08) Outro
In this thought-provoking episode of The Cognitive Revolution, host Nathan Labenz speaks with Jeremy and Edouard Harris, founders of Gladstone AI and authors of "America's Superintelligence Project." The conversation explores a critical dilemma facing US policymakers: balancing the race to develop advanced AI ahead of China against the risks of losing control of increasingly powerful systems. Drawing from their extensive research with intelligence officials and technical experts, the Harris brothers detail the vulnerabilities in US critical infrastructure that would need to be addressed for a Manhattan Project-style AI initiative, while raising profound questions about the security compromises and centralization of power such a project would entail. Nathan offers his perspective that international cooperation might be preferable to an AI arms race, inviting listeners to consider whether humanity's shared interests might ultimately outweigh geopolitical rivalries in the development of superintelligent systems. Upcoming Major AI Events Featuring Nathan Labenz as a Keynote Speaker https://www.imagineai.live/ https://adapta.org/adapta-summit https://itrevolution.com/product/enterprise-tech-leadership-summit-las-vegas/ America’s Superintelligence Project: https://superintelligence.gladstone.ai SPONSORS: Box AI: Box AI revolutionizes content management by unlocking the potential of unstructured data. Automate document processing, extract insights, and build custom AI agents using cutting-edge models like OpenAI's GPT-4.5, Google's Gemini 2.0, and Anthropic's Cloud 3.7 Sonnet. Trusted by over 115,000 enterprises, Box AI ensures top-tier security and compliance. Visit https://box.com/ai to transform your business with intelligent content management today Shopify: Shopify powers millions of businesses worldwide, handling 10% of U.S. e-commerce. With hundreds of templates, AI tools for product descriptions, and seamless marketing campaign creation, it's like having a design studio and marketing team in one. Start your $1/month trial today at https://shopify.com/cognitive NetSuite: Over 41,000 businesses trust NetSuite by Oracle, the #1 cloud ERP, to future-proof their operations. With a unified platform for accounting, financial management, inventory, and HR, NetSuite provides real-time insights and forecasting to help you make quick, informed decisions. Whether you're earning millions or hundreds of millions, NetSuite empowers you to tackle challenges and seize opportunities. Download the free CFO's guide to AI and machine learning at https://netsuite.com/cognitive Oracle Cloud Infrastructure (OCI): Oracle Cloud Infrastructure offers next-generation cloud solutions that cut costs and boost performance. With OCI, you can run AI projects and applications faster and more securely for less. New U.S. customers can save 50% on compute, 70% on storage, and 80% on networking by switching to OCI before May 31, 2024. See if you qualify at https://oracle.com/cognitive PRODUCED BY: https://aipodcast.ing
In this episode of the Cognitive Revolution podcast, the host Nathan Labenz is joined for the record 9th time by Zvi Mowshowitz to discuss the state of AI advancements, focusing on recent developments such as OpenAI's O3 model and its implications for AGI and recursive self-improvement. They delve into the capabilities and limitations of current AI models in various domains, including coding, deep research, and practical utilities. The discussion also covers the strategic and ethical considerations in AI development, touching upon the roles of major AI labs, the potential for weaponization, and the importance of balancing innovation with safety. Zvi shares insights on what it means to be a live player in the AI race, the impact of transparency and safety measures, and the challenges of governance in the context of rapidly advancing AI technologies. Nathan Labenz's slide deck documenting the ever-growing list of AI Bad Behaviors: https://docs.google.com/presentation/d/1mvkpg1mtAvGzTiiwYPc6bKOGsQXDIwMb-ytQECb3i7I/edit#slide=id.g252d9e67d86_0_16 Upcoming Major AI Events Featuring Nathan Labenz as a Keynote Speaker https://www.imagineai.live/ https://adapta.org/adapta-summit https://itrevolution.com/product/enterprise-tech-leadership-summit-las-vegas/ SPONSORS: Box AI: Box AI revolutionizes content management by unlocking the potential of unstructured data. Automate document processing, extract insights, and build custom AI agents using cutting-edge models like OpenAI's GPT-4.5, Google's Gemini 2.0, and Anthropic's Cloud 3.7 Sonnet. Trusted by over 115,000 enterprises, Box AI ensures top-tier security and compliance. Visit https://box.com/ai to transform your business with intelligent content management today Shopify: Shopify powers millions of businesses worldwide, handling 10% of U.S. e-commerce. With hundreds of templates, AI tools for product descriptions, and seamless marketing campaign creation, it's like having a design studio and marketing team in one. Start your $1/month trial today at https://shopify.com/cognitive NetSuite: Over 41,000 businesses trust NetSuite by Oracle, the #1 cloud ERP, to future-proof their operations. With a unified platform for accounting, financial management, inventory, and HR, NetSuite provides real-time insights and forecasting to help you make quick, informed decisions. Whether you're earning millions or hundreds of millions, NetSuite empowers you to tackle challenges and seize opportunities. Download the free CFO's guide to AI and machine learning at https://netsuite.com/cognitive Oracle Cloud Infrastructure (OCI): Oracle Cloud Infrastructure offers next-generation cloud solutions that cut costs and boost performance. With OCI, you can run AI projects and applications faster and more securely for less. New U.S. customers can save 50% on compute, 70% on storage, and 80% on networking by switching to OCI before May 31, 2024. See if you qualify at https://oracle.com/cognitive PRODUCED BY: https://aipodcast.ing
In this crossover episode of The Cognitive Revolution, Nathan Labenz joins Liron Shapira of Doom Debates, for a wide-ranging news and analysis discussion about recent AI developments. The conversation covers significant topics including GPT-4o image generation's implications for designers and businesses like Waymark, debates around learning to code, entrepreneurship versus job security, and the validity of OpenAI's $300 billion valuation. Nathan and Leron also explore AI safety organizations, international cooperation possibilities, and Anthropic's new mechanistic interpretability paper, providing listeners with thoughtful perspectives on the high-stakes nature of advanced AI development across society. All the links mentioned in the episode: https://docs.google.com/document/d/1LyFMLH5VpkhY7KfFBpgi2vhfbmdbDtQ4hh03KXEXyiE/edit?usp=sharing SPONSORS: Oracle Cloud Infrastructure (OCI): Oracle Cloud Infrastructure offers next-generation cloud solutions that cut costs and boost performance. With OCI, you can run AI projects and applications faster and more securely for less. New U.S. customers can save 50% on compute, 70% on storage, and 80% on networking by switching to OCI before May 31, 2024. See if you qualify at https://oracle.com/cognitive Shopify: Shopify powers millions of businesses worldwide, handling 10% of U.S. e-commerce. With hundreds of templates, AI tools for product descriptions, and seamless marketing campaign creation, it's like having a design studio and marketing team in one. Start your $1/month trial today at https://shopify.com/cognitive NetSuite: Over 41,000 businesses trust NetSuite by Oracle, the #1 cloud ERP, to future-proof their operations. With a unified platform for accounting, financial management, inventory, and HR, NetSuite provides real-time insights and forecasting to help you make quick, informed decisions. Whether you're earning millions or hundreds of millions, NetSuite empowers you to tackle challenges and seize opportunities. Download the free CFO's guide to AI and machine learning at https://netsuite.com/cognitive PRODUCED BY: https://aipodcast.ing CHAPTERS: (00:00) About the Episode (02:58) Introduction and Guest Background (08:23) P Doom Discussion (13:15) Anthropic Leadership Concerns (Part 1) (19:50) Sponsors: Oracle Cloud Infrastructure (OCI) | Shopify (21:04) Sponsors: Oracle Cloud Infrastructure (OCI) | Shopify (23:00) Anthropic Leadership Concerns (Part 2) (29:34) GPT-4o Image Capabilities (Part 1) (29:43) Sponsors: NetSuite (31:11) GPT-4o Image Capabilities (Part 2) (38:19) AI Impact on Creative Work (48:26) Future of Software Engineering (01:02:10) NVIDIA Stock Discussion (01:09:21) OpenAI's $300B Valuation (01:17:37) AI Models and Safety (01:33:58) Packy's AI Concerns Critique (01:46:41) Emmett Shear's Organic Alignment (02:04:43) Anthropic's Interpretability Paper (02:17:53) International AI Cooperation (02:27:38) Outro
In this thought-provoking conversation, Helen Toner, Director of Strategy at the Center for Security and Emerging Technology (CSET), discusses her perspectives on AI development, regulation, and international competition. Toner shares insights from her time on OpenAI's board, clarifying that reports about a "Q*" breakthrough influencing the board's decision were "totally false." She introduces her concept of "adaptation buffers"—critical windows of time between when AI capabilities are first demonstrated and when they become widely accessible—arguing that society needs this time to build resilience against potential misuse. Toner also explores the challenges of implementing effective AI governance, military applications of AI decision support systems, and the complex dynamics of US-China relations in the emerging AI landscape. Helen Toner's appearance on the TED AI show: https://www.ted.com/talks/the_ted_ai_show_what_really_went_down_at_openai_and_the_future_of_regulation_w_helen_toner Helen Toner's substack : https://helentoner.substack.com/ Additional recommended reads: https://helentoner.substack.com/p/nonproliferation-is-the-wrong-approach https://cset.georgetown.edu/publication/ai-for-military-decision-making/ https://www.lawfaremedia.org/article/ai-regulation-s-champions-can-seize-common-ground-or-be-swept-aside https://www.economist.com/by-invitation/2024/05/26/ai-firms-mustnt-govern-themselves-say-ex-members-of-openais-board SPONSORS: Oracle Cloud Infrastructure (OCI): Oracle Cloud Infrastructure offers next-generation cloud solutions that cut costs and boost performance. With OCI, you can run AI projects and applications faster and more securely for less. New U.S. customers can save 50% on compute, 70% on storage, and 80% on networking by switching to OCI before May 31, 2024. See if you qualify at https://oracle.com/cognitive Shopify: Shopify powers millions of businesses worldwide, handling 10% of U.S. e-commerce. With hundreds of templates, AI tools for product descriptions, and seamless marketing campaign creation, it's like having a design studio and marketing team in one. Start your $1/month trial today at https://shopify.com/cognitive NetSuite: Over 41,000 businesses trust NetSuite by Oracle, the #1 cloud ERP, to future-proof their operations. With a unified platform for accounting, financial management, inventory, and HR, NetSuite provides real-time insights and forecasting to help you make quick, informed decisions. Whether you're earning millions or hundreds of millions, NetSuite empowers you to tackle challenges and seize opportunities. Download the free CFO's guide to AI and machine learning at https://netsuite.com/cognitive PRODUCED BY: https://aipodcast.ing CHAPTERS: (00:00) Teaser (06:04) Introduction and Background (09:32) AI Timeline Perspectives (12:26) OpenAI Board Experience (17:04) OpenAI Culture Discussion (Part 1) (19:20) Sponsors: Oracle Cloud Infrastructure (OCI) | Shopify (20:33) Sponsors: Oracle Cloud Infrastructure (OCI) | Shopify (22:30) OpenAI Culture Discussion (Part 2) (24:03) OpenAI's Contradictory Messaging (26:15) Whistleblowing in AI (31:30) AI Transparency Requirements (Part 1) (36:30) Sponsors: NetSuite (37:58) AI Transparency Requirements (Part 2) (38:38) Adaptation Buffers Concept (44:06) Technical vs. Societal Solutions (52:13) AI Regulation Approaches (57:20) Iterative Deployment Challenges (01:05:50) US-China AI Competition (01:14:54) Military Decision Support Systems (01:20:57) Future AI Military Equilibrium (01:27:39) Outro
In this crossover episode from the China Talk podcast, Nathan Labenz shares a thought-provoking conversation between Jordan Schneider, Ilari Michaela, and Professor David C. Kang that challenges conventional Western perspectives on East Asian international relations. Professor Kang argues that studying East Asian history on its own terms reveals a remarkably stable geopolitical system spanning nearly a millennium, where China maintained regional dominance without conquest through compatible cultures and mutual understanding. This alternative framework offers valuable insights that question the seemingly inevitable US-China competition narrative dominating AI discourse, suggesting that internal challenges may be more significant than external threats for both China and the United States. SPONSORS: Oracle Cloud Infrastructure (OCI): Oracle Cloud Infrastructure offers next-generation cloud solutions that cut costs and boost performance. With OCI, you can run AI projects and applications faster and more securely for less. New U.S. customers can save 50% on compute, 70% on storage, and 80% on networking by switching to OCI before May 31, 2024. See if you qualify at https://oracle.com/cognitive Shopify: Shopify powers millions of businesses worldwide, handling 10% of U.S. e-commerce. With hundreds of templates, AI tools for product descriptions, and seamless marketing campaign creation, it's like having a design studio and marketing team in one. Start your $1/month trial today at https://shopify.com/cognitive NetSuite: Over 41,000 businesses trust NetSuite by Oracle, the #1 cloud ERP, to future-proof their operations. With a unified platform for accounting, financial management, inventory, and HR, NetSuite provides real-time insights and forecasting to help you make quick, informed decisions. Whether you're earning millions or hundreds of millions, NetSuite empowers you to tackle challenges and seize opportunities. Download the free CFO's guide to AI and machine learning at https://netsuite.com/cognitive PRODUCED BY: https://aipodcast.ing CHAPTERS: (00:00) About the Episode (03:30) Introduction to East Asian Relations (04:41) Internal vs External Challenges (07:05) Song Dynasty's Fall (13:35) Western vs Eastern Frontiers (19:06) Shared Cultural Understanding (Part 1) (20:30) Sponsors: Oracle Cloud Infrastructure (OCI) | Shopify (23:45) Shared Cultural Understanding (Part 2) (25:57) Vietnam-China Relations (30:08) Korea's Diplomatic Strategy (Part 1) (32:19) Sponsors: NetSuite (33:52) Korea's Diplomatic Strategy (Part 2) (35:17) The Imjin War (43:36) Thucydides Trap Question (49:19) Power Transition Theory Debate (53:49) Expansion and Frontiers (01:02:00) Modern Implications (01:06:00) PRC and Imperial Legacy (01:13:16) Taiwan and Modern Challenges (01:25:42) US Role in East Asia (01:29:35) Concluding Thoughts (01:37:17) Outro
In this episode, Nathan Labenz speaks with Vivek Natarajan and Anil Palepu from Google DeepMind about their groundbreaking work on AMIE (Articulate Medical Intelligence Explorer) and Co-Scientist. The conversation reveals how these AI systems are already outperforming human physicians in diagnostic accuracy and treatment recommendations, with AMIE now entering clinical trials at a Harvard Medical School teaching hospital. Even more remarkably, the Co-Scientist system demonstrates genuine scientific discovery capabilities, independently proposing the exact same mechanism for bacterial drug resistance that human scientists had recently discovered but not yet published—signaling a threshold moment where AI is becoming a legitimate thought partner in humanity's most complex intellectual endeavors. SPONSORS: Oracle Cloud Infrastructure (OCI): Oracle Cloud Infrastructure offers next-generation cloud solutions that cut costs and boost performance. With OCI, you can run AI projects and applications faster and more securely for less. New U.S. customers can save 50% on compute, 70% on storage, and 80% on networking by switching to OCI before May 31, 2024. See if you qualify at https://oracle.com/cognitive Shopify: Shopify powers millions of businesses worldwide, handling 10% of U.S. e-commerce. With hundreds of templates, AI tools for product descriptions, and seamless marketing campaign creation, it's like having a design studio and marketing team in one. Start your $1/month trial today at https://shopify.com/cognitive NetSuite: Over 41,000 businesses trust NetSuite by Oracle, the #1 cloud ERP, to future-proof their operations. With a unified platform for accounting, financial management, inventory, and HR, NetSuite provides real-time insights and forecasting to help you make quick, informed decisions. Whether you're earning millions or hundreds of millions, NetSuite empowers you to tackle challenges and seize opportunities. Download the free CFO's guide to AI and machine learning at https://netsuite.com/cognitive PRODUCED BY: https://aipodcast.ing CHAPTERS: (00:00) About the Episode (06:26) Introduction and Welcome (07:49) AMY Medical Intelligence Overview (11:29) Chat-Based Medical Interactions (13:59) Specialized Medicine Results (18:17) Co-Scientist System Headlines (Part 1) (18:21) Sponsors: Oracle Cloud Infrastructure (OCI) | Shopify (21:36) Co-Scientist System Headlines (Part 2) (26:32) Bacterial Drug Resistance Discovery (31:41) AI Scientific Discovery Process (35:35) Hallucinations vs. Creativity (Part 1) (35:37) Sponsors: NetSuite (37:10) Hallucinations vs. Creativity (Part 2) (42:04) Agent Design Architecture (49:17) Long Context Benefits (55:35) Computational Requirements (01:01:10) Specialist Models Integration (01:07:01) Future Model Integration (01:12:31) Tournament Evaluation Methods (01:19:09) AI Question Generation (01:22:42) Real-World Deployment Plans (01:25:58) Outro
In this illuminating episode of The Cognitive Revolution, host Nathan Labenz speaks with Jack Rae, principal research scientist at Google DeepMind and technical lead on Google's thinking and inference time scaling work. They explore the technical breakthroughs behind Google's Gemini 2.5 Pro model, discussing why reasoning techniques are suddenly working so effectively across the industry and whether these advances represent true breakthroughs or incremental progress. The conversation delves into critical questions about the relationship between reasoning and agency, the role of human data in shaping model behavior, and the roadmap from current capabilities to AGI, providing listeners with an insider's perspective on the trajectory of AI development. SPONSORS: Oracle Cloud Infrastructure (OCI): Oracle Cloud Infrastructure offers next-generation cloud solutions that cut costs and boost performance. With OCI, you can run AI projects and applications faster and more securely for less. New U.S. customers can save 50% on compute, 70% on storage, and 80% on networking by switching to OCI before May 31, 2024. See if you qualify at https://oracle.com/cognitive Shopify: Shopify is revolutionizing online selling with its market-leading checkout system and robust API ecosystem. Its exclusive library of cutting-edge AI apps empowers e-commerce businesses to thrive in a competitive market. Cognitive Revolution listeners can try Shopify for just $1 per month at https://shopify.com/cognitive NetSuite: Over 41,000 businesses trust NetSuite by Oracle, the #1 cloud ERP, to future-proof their operations. With a unified platform for accounting, financial management, inventory, and HR, NetSuite provides real-time insights and forecasting to help you make quick, informed decisions. Whether you're earning millions or hundreds of millions, NetSuite empowers you to tackle challenges and seize opportunities. Download the free CFO's guide to AI and machine learning at https://netsuite.com/cognitive PRODUCED BY: https://aipodcast.ing CHAPTERS: (00:00) About the Episode (05:09) Introduction and Welcome (07:28) RL for Reasoning (10:46) Research Time Management (13:41) Convergence in Model Development (18:31) RL on Smaller Models (Part 1) (20:01) Sponsors: Oracle Cloud Infrastructure (OCI) | Shopify (22:35) RL on Smaller Models (Part 2) (23:30) Sculpting Cognitive Behaviors (25:05) Language Switching Behavior (28:02) Sharing Chain of Thought (32:03) RL on Chain of Thought (Part 1) (33:46) Sponsors: NetSuite (35:19) RL on Chain of Thought (Part 2) (35:26) Eliciting Human Reasoning (39:27) Reasoning vs. Agency (40:17) Understanding Model Reasoning (44:29) Reasoning in Latent Space (47:54) Interpretability Challenges (51:36) Platonic Model Hypothesis (56:05) Roadmap to AGI (01:00:57) Multimodal Integration (01:04:38) System Card Questions (01:07:51) Long Context Capabilities (01:13:49) Outro
On this cross-post episode, Jeffrey Ladish discusses the rapid pace of AI progress and the risks of losing control over powerful systems. We explore why AIs can be both smart and dumb, the challenges of creating honest AIs, and scenarios where AI could turn against us. Additionally, we delve into Palisade's new study on how reasoning models can cheat in chess by exploiting the game environment. Check out the Future of Life podcast here.: https://futureoflife.org/project/future-of-life-institute-podcast/ SPONSORS: Oracle Cloud Infrastructure (OCI) | 2025: Oracle Cloud Infrastructure offers next-generation cloud solutions that cut costs and boost performance. With OCI, you can run AI projects and applications faster and more securely for less. New U.S. customers can save 50% on compute, 70% on storage, and 80% on networking by switching to OCI before May 31, 2024. See if you qualify at https://oracle.com/cognitive Shopify: Shopify is revolutionizing online selling with its market-leading checkout system and robust API ecosystem. Its exclusive library of cutting-edge AI apps empowers e-commerce businesses to thrive in a competitive market. Cognitive Revolution listeners can try Shopify for just $1 per month at https://shopify.com/cognitive NetSuite: Over 41,000 businesses trust NetSuite by Oracle, the #1 cloud ERP, to future-proof their operations. With a unified platform for accounting, financial management, inventory, and HR, NetSuite provides real-time insights and forecasting to help you make quick, informed decisions. Whether you're earning millions or hundreds of millions, NetSuite empowers you to tackle challenges and seize opportunities. Download the free CFO's guide to AI and machine learning at https://netsuite.com/cognitive PRODUCED BY: https://aipodcast.ing CHAPTERS: (00:00) About the Episode (02:59) The pace of AI progress (07:14) How we might lose control (10:22) Why are AIs sometimes dumb? (Part 1) (15:50) Sponsors: Oracle Cloud Infrastructure (OCI) | 2025 | Shopify (18:24) Why are AIs sometimes dumb? (Part 2) (18:24) Benchmarks vs real world (24:43) Loss of control scenarios (32:08) Why would AI turn against us? (Part 1) (32:09) Sponsors: NetSuite (33:42) Why would AI turn against us? (Part 2) (37:40) AIs hacking chess (43:30) Why didn't more advanced AIs hack? (48:44) Creating honest AIs (56:49) AI attackers vs AI defenders (01:05:32) How good is security at AI companies? (01:10:42) A sense of urgency (01:17:16) What should we do? (01:22:59) Skepticism about AI progress (01:29:38) Outro
In this episode of the Cognitive Revolution podcast, Andrew Lee, founder and CEO of Shortwave, returns to discuss the rapid advancements in AI over the past year and how they have significantly improved Shortwave, an AI email assistant. Andrew shares insights into the exponential growth of Shortwave's revenue and the enhanced capabilities of their AI, which now functions more like a virtual assistant. They delve into various use cases, the technical evolution of their platform, the impact of new AI models, and their strategic decision to shift from being an AI-enhanced email client to offering a broader AI-driven communication solution. Andrew also talks about the shift in company culture towards an AI-forward approach, the importance of speed and agility in the AI space, and the increased productivity achieved through leveraging AI. The conversation also touches on the future of the software industry, the potential of AI to automate routine tasks, and the company's hiring strategy focused on people who are passionate and forward-thinking about AI. PRODUCED BY: https://aipodcast.ing CHAPTERS: (00:00) About the Episode (04:00) Introduction and Welcome Back (04:07) Shortwave's Evolution and Revenue Growth (05:09) AI Email Assistant: Then vs. Now (06:44) Exciting Use Cases of Shortwave (14:11) Technical Deep Dive: Database and Search Stack (23:44) Agent Behavior and Iterative Approach (34:04) Model Selection and Cost Optimization (39:53) Future of AI and Convergence of Providers (42:54) Exploring the New Cursor Agent Mode (44:07) Understanding AI Filters and Their Functionality (45:38) Challenges and Solutions in AI Email Management (49:24) Evaluating AI Models and Their Performance (55:53) The Role of AI in Enhancing Email Communication (57:05) The Future of AI in Communication Tools (01:12:35) Building an AI-Forward Culture at Shortwave (01:17:14) Leveraging AI for Content Creation (01:17:57) The Shift in Team Dynamics (01:19:36) Adapting to Industry Changes (01:20:39) Optimizing for Speed (01:22:45) Monetization and Pricing Strategies (01:25:42) The Future of AI Integration (01:36:36) Hiring and Team Structure (01:43:28) The Future of Software Development (01:47:18) Closing Thoughts and Future Outlook (01:50:03) Outro SOCIAL LINKS: Website: https://www.cognitiverevolution.ai Twitter (Podcast): https://x.com/cogrev_podcast Twitter (Nathan): https://x.com/labenz LinkedIn: https://linkedin.com/in/nathanlabenz/ Youtube: https://youtube.com/@CognitiveRevolutionPodcast Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431 Spotify: https://open.spotify.com/show/6yHyok3M3BjqzR0VB5MSyk
In this episode of the Cognitive Revolution, Guy Gur-Ari, Co-Founder and Chief Scientist at Augment, explores the transformative impact of AI on the software industry. Highlighting Augment's unique approach, Gur-Ari discusses the challenges and solutions associated with integrating AI into large codebases, the nuances of maintaining context in AI-driven coding tools, and the evolving economics of AI-driven businesses. He shares insights on the company's focus on reinforcement learning from developer behaviors, future trends in software development, and offers advice for junior developers entering an AI-enhanced industry. The conversation also touches upon the vital role of user data, the complexities of vector databases, and the potential of agentic flows to revolutionize coding processes. SPONSORS: Box AI: Box AI revolutionizes content management by unlocking the potential of unstructured data. Automate document processing, extract insights, and build custom AI agents using cutting-edge models like OpenAI's GPT-4.5, Google's Gemini 2.0, and Anthropic's Cloud 3.7 Sonnet. Trusted by over 115,000 enterprises, Box AI ensures top-tier security and compliance. Visit https://box.com/ai to transform your business with intelligent content management today Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers. OCI powers industry leaders like Vodafone and Thomson Reuters with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before March 31, 2024 at https://oracle.com/cognitive Shopify: Shopify is revolutionizing online selling with its market-leading checkout system and robust API ecosystem. Its exclusive library of cutting-edge AI apps empowers e-commerce businesses to thrive in a competitive market. Cognitive Revolution listeners can try Shopify for just $1 per month at https://shopify.com/cognitive NetSuite: Over 41,000 businesses trust NetSuite by Oracle, the #1 cloud ERP, to future-proof their operations. With a unified platform for accounting, financial management, inventory, and HR, NetSuite provides real-time insights and forecasting to help you make quick, informed decisions. Whether you're earning millions or hundreds of millions, NetSuite empowers you to tackle challenges and seize opportunities. Download the free CFO's guide to AI and machine learning at https://netsuite.com/cognitive PRODUCED BY: https://aipodcast.ing CHAPTERS: (00:00) About the Episode (04:38) Introduction and Welcome (04:46) The Software Supernova Series (05:23) Augment's Unique Approach to AI in Software Development (06:16) Challenges in Large Code Bases (07:32) Understanding Augment's Customer Base (09:19) Context Management in AI (11:46) Technical Insights and Blog Highlights (13:16) Context Management and Code Indexing (19:35) Sponsors: Box AI | Oracle Cloud Infrastructure (OCI) (22:40) Developer Workflows and AI Integration (29:04) Vector Databases and Retrieval Systems (Part 1) (33:25) Sponsors: Shopify | NetSuite (36:13) Vector Databases and Retrieval Systems (Part 2) (37:29) Best Practices for Building RAG Applications (50:36) Establishing a Solid Process for Model Evaluation (51:01) Optimizing Experimental Iteration Time (53:10) Exploring Reinforcement Learning from Developer Behaviors (54:14) Challenges and Benefits of User Data in AI (01:05:34) The Economics of Running an AI Company (01:14:16) Future of Software Development and AI Integration (01:18:51) Advice for Junior Developers in the AI Era (01:23:58) Conclusion and Final Thoughts (01:24:50) Outro SOCIAL LINKS: Website: https://www.cognitiverevolution.ai Twitter (Podcast): https://x.com/cogrev_podcast Twitter (Nathan): https://x.com/labenz LinkedIn: https://linkedin.com/in/nathanlabenz/
In this episode of the Cognitive Revolution, we hear from Siyu He, a postdoc at Stanford specializing in biomedical data science. Siyu discusses the implications and methods behind their recent AI-driven biological research papers, Squidiff and CORAL. The conversation explores the use of AI models to analyze complex cellular systems and disease mechanisms, focusing on transcriptome and tissue sample analyses. Squidiff aims to simulate cellular transcriptomes to predict outcomes of various conditions, significantly expediting traditionally lengthy and expensive biological experiments. CORAL Project extends this by integrating different levels of biological data, enabling a more comprehensive understanding of tissue structures and cellular interactions. The discussion also delves into the challenges of using synthetic data for validating AI models and the potential acceleration of scientific discoveries through AI in biomedical research. The episode encapsulates the interplay between AI and biology, highlighting the future possibilities and current limitations of this innovative research front. Squidiff: https://www.biorxiv.org/content/10.1101/2024.11.16.623974v1.full.pdf CORAL: https://www.biorxiv.org/content/10.1101/2025.02.01.636038v1.full.pdf SPONSORS: Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers. OCI powers industry leaders like Vodafone and Thomson Reuters with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before March 31, 2024 at https://oracle.com/cognitive Shopify: Shopify is revolutionizing online selling with its market-leading checkout system and robust API ecosystem. Its exclusive library of cutting-edge AI apps empowers e-commerce businesses to thrive in a competitive market. Cognitive Revolution listeners can try Shopify for just $1 per month at https://shopify.com/cognitive NetSuite: Over 41,000 businesses trust NetSuite by Oracle, the #1 cloud ERP, to future-proof their operations. With a unified platform for accounting, financial management, inventory, and HR, NetSuite provides real-time insights and forecasting to help you make quick, informed decisions. Whether you're earning millions or hundreds of millions, NetSuite empowers you to tackle challenges and seize opportunities. Download the free CFO's guide to AI and machine learning at https://netsuite.com/cognitive PRODUCED BY: https://aipodcast.ing CHAPTERS: (00:00) About the Episode (03:37) Introduction and Guest Welcome (04:00) Setting the Big Picture Context (04:37) Exploring the Squidiff and CORAL Papers (08:31) Understanding Transcriptomes (11:17) Single Cell RNA Sequencing Technology (15:32) Motivation Behind Squidiff (Part 1) (17:14) Sponsors: Oracle Cloud Infrastructure (OCI) | Shopify (19:41) Motivation Behind Squidiff (Part 2) (25:56) Training Data and Model Architecture (Part 1) (31:38) Sponsors: NetSuite (33:11) Training Data and Model Architecture (Part 2) (37:18) Diffusion Models in Biology (46:07) In Silico Experiments and Applications (54:25) Clarifying the Validation Process (55:36) Validation Strategies and Real Data (58:26) Challenges in Modeling and Predictions (01:02:14) Accelerating Research with AI Models (01:07:31) Future Directions and Collaboration (01:10:46) Introduction to CORAL Paper (01:13:09) Spatial Transcriptomics and Proteomics (01:17:10) Challenges in Integrating Spatial Data (01:31:53) Synthetic Data and Model Validation (01:36:42) The Future of AI in Healthcare (01:43:31) Outro SOCIAL LINKS: Website: https://www.cognitiverevolution.ai Twitter (Podcast): https://x.com/cogrev_podcast Twitter (Nathan): https://x.com/labenz LinkedIn: https://linkedin.com/in/nathanlabenz/ Youtube: https://youtube.com/@CognitiveRevolutionPodcast
In this episode of The Cognitive Revolution, host Nathan Labenz speaks with Andreessen Horowitz partners Olivia Moore and Anish Acharya about the rapid evolution of voice AI technology and its real-world applications. The conversation explores how multimodal models, reduced latency, and improved emotional intelligence are enabling more natural voice interactions across various platforms including Hume AI's Octave model, Google's NotebookLM, and Sesame. Nathan and his guests discuss compelling business use cases—from Happy Robot handling complex negotiations with truckers to SMBs deploying voice AI for after-hours support—while also addressing philosophical questions about labor displacement and the urgent need for responsible innovation to protect consumers from potential AI voice scams. Please note that the content here is for informational purposes only; should not be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. For more details please see https://a16z.com/disclosures/. SPONSORS: Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers. OCI powers industry leaders like Vodafone and Thomson Reuters with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before March 31, 2024 at https://oracle.com/cognitive Shopify: Shopify is revolutionizing online selling with its market-leading checkout system and robust API ecosystem. Its exclusive library of cutting-edge AI apps empowers e-commerce businesses to thrive in a competitive market. Cognitive Revolution listeners can try Shopify for just $1 per month at https://shopify.com/cognitive NetSuite: Over 41,000 businesses trust NetSuite by Oracle, the #1 cloud ERP, to future-proof their operations. With a unified platform for accounting, financial management, inventory, and HR, NetSuite provides real-time insights and forecasting to help you make quick, informed decisions. Whether you're earning millions or hundreds of millions, NetSuite empowers you to tackle challenges and seize opportunities. Download the free CFO's guide to AI and machine learning at https://netsuite.com/cognitive PRODUCED BY: https://aipodcast.ing CHAPTERS: (00:00) About the Episode (03:39) Introduction and Welcome (03:50) AI Scouting Methods (08:25) Best Voice AI Experiences (11:34) Voice AI for Seniors (14:27) Sponsors: Oracle Cloud Infrastructure (OCI) | Shopify (16:54) Voice Technology Challenges (20:48) Human-Like Conversation Dynamics (24:13) AI Voice Negotiations (27:34) Apple's Siri Delays (31:13) Voice AI Stack Evolution (Part 1) (33:16) Sponsors: NetSuite (34:49) Voice AI Stack Evolution (Part 2) (37:57) Context Assembly Challenges (40:48) Enterprise Voice Applications (46:30) Labor Market Impact (49:36) SMB Voice Solutions (50:53) Creator Voice Tools (52:17) AI for Children (56:18) AI Companionship and Romance (58:58) Ethical Guidelines Discussion (01:02:46) Future of Voice Computing (01:04:49) Outro
Join us in a deep dive with Allan Dafoe, Director of Frontier Safety and Governance at Google DeepMind. Allan sheds light on the challenges of evaluating AI capabilities, structural risks, and the future of AI governance. Discover how AI technologies can transform sectors like education, healthcare, and sustainability, alongside the potential risks and necessary safety measures. This episode provides a comprehensive look at the intersection of technology, safety, and governance in the rapidly evolving AI landscape. SPONSORS: SafeBase: SafeBase is the leading trust-centered platform for enterprise security. Streamline workflows, automate questionnaire responses, and integrate with tools like Slack and Salesforce to eliminate friction in the review process. With rich analytics and customizable settings, SafeBase scales to complex use cases while showcasing security's impact on deal acceleration. Trusted by companies like OpenAI, SafeBase ensures value in just 16 days post-launch. Learn more at https://safebase.io/podcast Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers. OCI powers industry leaders like Vodafone and Thomson Reuters with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before March 31, 2024 at https://oracle.com/cognitive Shopify: Shopify is revolutionizing online selling with its market-leading checkout system and robust API ecosystem. Its exclusive library of cutting-edge AI apps empowers e-commerce businesses to thrive in a competitive market. Cognitive Revolution listeners can try Shopify for just $1 per month at https://shopify.com/cognitive NetSuite: Over 41,000 businesses trust NetSuite by Oracle, the #1 cloud ERP, to future-proof their operations. With a unified platform for accounting, financial management, inventory, and HR, NetSuite provides real-time insights and forecasting to help you make quick, informed decisions. Whether you're earning millions or hundreds of millions, NetSuite empowers you to tackle challenges and seize opportunities. Download the free CFO's guide to AI and machine learning at https://netsuite.com/cognitive RECOMMENDED PODCAST: Second Opinion. Join Christina Farr, Ash Zenooz and Luba Greenwood as they bring influential entrepreneurs, experts and investors into the ring for candid conversations at the frontlines of healthcare and digital health every week. Spotify: https://open.spotify.com/show/0A8NwQE976s32zdBbZw6bv Apple: https://podcasts.apple.com/us/podcast/second-opinion-with-christina-farr-ash-zenooz-md-luba/id1759267211 YouTube: https://www.youtube.com/@SecondOpinionwithChristinaFarr PRODUCED BY: https://aipodcast.ing
In this intriguing episode, Professor Angela Zhang discusses the complex landscape of China's technology sector and regulation. The conversation explores China's approach to AI, the evolution of its tech giants, and the interplay between government and private enterprises. Zhang emphasizes the importance of firsthand experience in understanding China and highlights key insights from her book, 'Highwire,' which delves into China's regulatory strategies and policies. The dialogue also touches on global perceptions, the ongoing US-China tech rivalry, and the broader implications of regulatory actions in both nations. This episode sheds light on the dynamic and often opaque world of Chinese tech governance, offering a balanced and nuanced perspective. SPONSORS: SafeBase: SafeBase is the leading trust-centered platform for enterprise security. Streamline workflows, automate questionnaire responses, and integrate with tools like Slack and Salesforce to eliminate friction in the review process. With rich analytics and customizable settings, SafeBase scales to complex use cases while showcasing security's impact on deal acceleration. Trusted by companies like OpenAI, SafeBase ensures value in just 16 days post-launch. Learn more at https://safebase.io/podcast Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers. OCI powers industry leaders like Vodafone and Thomson Reuters with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before March 31, 2024 at https://oracle.com/cognitive Shopify: Shopify is revolutionizing online selling with its market-leading checkout system and robust API ecosystem. Its exclusive library of cutting-edge AI apps empowers e-commerce businesses to thrive in a competitive market. Cognitive Revolution listeners can try Shopify for just $1 per month at https://shopify.com/cognitive NetSuite: Over 41,000 businesses trust NetSuite by Oracle, the #1 cloud ERP, to future-proof their operations. With a unified platform for accounting, financial management, inventory, and HR, NetSuite provides real-time insights and forecasting to help you make quick, informed decisions. Whether you're earning millions or hundreds of millions, NetSuite empowers you to tackle challenges and seize opportunities. Download the free CFO's guide to AI and machine learning at https://netsuite.com/cognitive RECOMMENDED PODCAST: Second Opinion. Join Christina Farr, Ash Zenooz and Luba Greenwood as they bring influential entrepreneurs, experts and investors into the ring for candid conversations at the frontlines of healthcare and digital health every week. Spotify: https://open.spotify.com/show/0A8NwQE976s32zdBbZw6bv Apple: https://podcasts.apple.com/us/podcast/second-opinion-with-christina-farr-ash-zenooz-md-luba/id1759267211 YouTube: https://www.youtube.com/@SecondOpinionwithChristinaFarr PRODUCED BY: https://aipodcast.ing
In this episode, we discuss the significant advancements and challenges in the field of artificial intelligence over the past year. From breakthroughs in reinforcement learning to unexpected behaviors in fine-tuned models, we cover a wide range of topics that are shaping the AI landscape. Key discussions include the rapid progress of reasoning models, the surprising results from alignment studies, and the potential for AI to become superintelligent. We also explore the emerging importance of AI memory and its implications for future applications. Tune in for a deep dive into the current state and future trajectory of AI technology. SPONSORS: SafeBase: SafeBase is the leading trust-centered platform for enterprise security. Streamline workflows, automate questionnaire responses, and integrate with tools like Slack and Salesforce to eliminate friction in the review process. With rich analytics and customizable settings, SafeBase scales to complex use cases while showcasing security's impact on deal acceleration. Trusted by companies like OpenAI, SafeBase ensures value in just 16 days post-launch. Learn more at https://safebase.io/podcast Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers. OCI powers industry leaders like Vodafone and Thomson Reuters with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before March 31, 2024 at https://oracle.com/cognitive Shopify: Shopify is revolutionizing online selling with its market-leading checkout system and robust API ecosystem. Its exclusive library of cutting-edge AI apps empowers e-commerce businesses to thrive in a competitive market. Cognitive Revolution listeners can try Shopify for just $1 per month at https://shopify.com/cognitive NetSuite: Over 41,000 businesses trust NetSuite by Oracle, the #1 cloud ERP, to future-proof their operations. With a unified platform for accounting, financial management, inventory, and HR, NetSuite provides real-time insights and forecasting to help you make quick, informed decisions. Whether you're earning millions or hundreds of millions, NetSuite empowers you to tackle challenges and seize opportunities. Download the free CFO's guide to AI and machine learning at https://netsuite.com/cognitive RECOMMENDED PODCAST: Second Opinion. Join Christina Farr, Ash Zenooz and Luba Greenwood as they bring influential entrepreneurs, experts and investors into the ring for candid conversations at the frontlines of healthcare and digital health every week. Spotify: https://open.spotify.com/show/0A8NwQE976s32zdBbZw6bv Apple: https://podcasts.apple.com/us/podcast/second-opinion-with-christina-farr-ash-zenooz-md-luba/id1759267211 YouTube: https://www.youtube.com/@SecondOpinionwithChristinaFarr PRODUCED BY: https://aipodcast.ing
In this episode of The Cognitive Revolution, Professor Derya Unutmaz, a biomedical scientist and human immunologist at the Jackson Laboratory, discusses his groundbreaking research in aging and cancer immunotherapy. As a ChatGPT Pro grant awardee, Derya provides insights into the integration of AI with biomedical sciences, emphasizing how advanced AI models are transforming hypothesis generation, data analysis, and scientific discovery. He also covers his early passion for computers and programming, the inspiration he derived from Ray Kurzweil's work, and how AI is democratizing science by enabling even young researchers to make significant contributions. Derya outlines his vision for a future with ASI, discussing potential societal impacts, the need for regulatory AI models, and the promise of a golden age where diseases are cured, aging is reversed, and resource scarcity is a thing of the past. Finally, he dreams about the long-term future, imagining a life of exploration and discovery across the cosmos. SPONSORS: SafeBase: SafeBase is the leading trust-centered platform for enterprise security. Streamline workflows, automate questionnaire responses, and integrate with tools like Slack and Salesforce to eliminate friction in the review process. With rich analytics and customizable settings, SafeBase scales to complex use cases while showcasing security's impact on deal acceleration. Trusted by companies like OpenAI, SafeBase ensures value in just 16 days post-launch. Learn more at https://safebase.io/podcast Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers. OCI powers industry leaders like Vodafone and Thomson Reuters with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before March 31, 2024 at https://oracle.com/cognitive Shopify: Shopify is revolutionizing online selling with its market-leading checkout system and robust API ecosystem. Its exclusive library of cutting-edge AI apps empowers e-commerce businesses to thrive in a competitive market. Cognitive Revolution listeners can try Shopify for just $1 per month at https://shopify.com/cognitive NetSuite: Over 41,000 businesses trust NetSuite by Oracle, the #1 cloud ERP, to future-proof their operations. With a unified platform for accounting, financial management, inventory, and HR, NetSuite provides real-time insights and forecasting to help you make quick, informed decisions. Whether you're earning millions or hundreds of millions, NetSuite empowers you to tackle challenges and seize opportunities. Download the free CFO's guide to AI and machine learning at https://netsuite.com/cognitive RECOMMENDED PODCAST: Second Opinion. Join Christina Farr, Ash Zenooz and Luba Greenwood as they bring influential entrepreneurs, experts and investors into the ring for candid conversations at the frontlines of healthcare and digital health every week. Spotify: https://open.spotify.com/show/0A8NwQE976s32zdBbZw6bv Apple: https://podcasts.apple.com/us/podcast/second-opinion-with-christina-farr-ash-zenooz-md-luba/id1759267211 YouTube: https://www.youtube.com/@SecondOpinionwithChristinaFarr
In this episode, the host Nathan Labenz and economist Noah Smith delve into the complexities of U.S.-China relations, the motivations behind the United States' export controls and the broader geopolitical tensions. The discussion covers the perceived threats posed by China's technological advancements, especially in AI, and the implications for global stability. The conversation includes an analysis of economic decoupling, military deterrence, and the historical context of U.S.-China cooperation. The discussion also explores the role of misinformation, societal destabilization, and strategic military balance. The episode concludes with insights into the future direction of U.S.-China interactions and potential pathways for stabilizing the relationship. SPONSORS: SafeBase: SafeBase is the leading trust-centered platform for enterprise security. Streamline workflows, automate questionnaire responses, and integrate with tools like Slack and Salesforce to eliminate friction in the review process. With rich analytics and customizable settings, SafeBase scales to complex use cases while showcasing security's impact on deal acceleration. Trusted by companies like OpenAI, SafeBase ensures value in just 16 days post-launch. Learn more at https://safebase.io/podcast Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers. OCI powers industry leaders like Vodafone and Thomson Reuters with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before March 31, 2024 at https://oracle.com/cognitive Shopify: Shopify is revolutionizing online selling with its market-leading checkout system and robust API ecosystem. Its exclusive library of cutting-edge AI apps empowers e-commerce businesses to thrive in a competitive market. Cognitive Revolution listeners can try Shopify for just $1 per month at https://shopify.com/cognitive NetSuite: Over 41,000 businesses trust NetSuite by Oracle, the #1 cloud ERP, to future-proof their operations. With a unified platform for accounting, financial management, inventory, and HR, NetSuite provides real-time insights and forecasting to help you make quick, informed decisions. Whether you're earning millions or hundreds of millions, NetSuite empowers you to tackle challenges and seize opportunities. Download the free CFO's guide to AI and machine learning at https://netsuite.com/cognitive RECOMMENDED PODCAST: Second Opinion. Join Christina Farr, Ash Zenooz and Luba Greenwood as they bring influential entrepreneurs, experts and investors into the ring for candid conversations at the frontlines of healthcare and digital health every week. Spotify: https://open.spotify.com/show/0A8NwQE976s32zdBbZw6bv Apple: https://podcasts.apple.com/us/podcast/second-opinion-with-christina-farr-ash-zenooz-md-luba/id1759267211 YouTube: https://www.youtube.com/@SecondOpinionwithChristinaFarr PRODUCED BY: https://aipodcast.ing
In this episode, security researcher Nicholas Carlini of Google DeepMind delves into his extensive work on adversarial machine learning and cybersecurity. He discusses his pioneering contributions, which include developing attacks that have challenged the defenses of image classifiers and exploring the robustness of neural networks. Carlini details the inherent difficulties of defending against adversarial attacks, the role of human intuition in his work, and the potential of scaling attack methodologies using language models. He also addresses the broader implications of open-source AI and the complexities of balancing security with accessibility in emerging AI technologies. SPONSORS: SafeBase: SafeBase is the leading trust-centered platform for enterprise security. Streamline workflows, automate questionnaire responses, and integrate with tools like Slack and Salesforce to eliminate friction in the review process. With rich analytics and customizable settings, SafeBase scales to complex use cases while showcasing security's impact on deal acceleration. Trusted by companies like OpenAI, SafeBase ensures value in just 16 days post-launch. Learn more at https://safebase.io/podcast Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers. OCI powers industry leaders like Vodafone and Thomson Reuters with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before March 31, 2024 at https://oracle.com/cognitive Shopify: Shopify is revolutionizing online selling with its market-leading checkout system and robust API ecosystem. Its exclusive library of cutting-edge AI apps empowers e-commerce businesses to thrive in a competitive market. Cognitive Revolution listeners can try Shopify for just $1 per month at https://shopify.com/cognitive NetSuite: Over 41,000 businesses trust NetSuite by Oracle, the #1 cloud ERP, to future-proof their operations. With a unified platform for accounting, financial management, inventory, and HR, NetSuite provides real-time insights and forecasting to help you make quick, informed decisions. Whether you're earning millions or hundreds of millions, NetSuite empowers you to tackle challenges and seize opportunities. Download the free CFO's guide to AI and machine learning at https://netsuite.com/cognitive RECOMMENDED PODCAST: Second OpinionJoin Christina Farr, Ash Zenooz and Luba Greenwood as they bring influential entrepreneurs, experts and investors into the ring for candid conversations at the frontlines of healthcare and digital health every week. Spotify: https://open.spotify.com/show/0A8NwQE976s32zdBbZw6bv Apple: https://podcasts.apple.com/us/podcast/second-opinion-with-christina-farr-ash-zenooz-md-luba/id1759267211 YouTube: https://www.youtube.com/@SecondOpinionwithChristinaFarr SOCIAL LINKS: Website: https://www.cognitiverevolution.ai Twitter (Podcast): https://x.com/cogrev_podcast Twitter (Nathan): https://x.com/labenz LinkedIn: https://linkedin.com/in/nathanlabenz/ Youtube: https://youtube.com/@CognitiveRevolutionPodcast Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431 Spotify: https://open.spotify.com/show/6yHyok3M3BjqzR0VB5MSyk PRODUCED BY: https://aipodcast.ing
Phil Murphy, the Governor of New Jersey, joins Nathan to discuss his proactive approach to AI and its potential transformative impact on society. Governor Murphy shares insights from a pivotal dinner with AI thought leaders that spurred New Jersey's ambitious AI initiatives, including the establishment of the NJ AI Hub with Princeton University. He elaborates on current applications, like the AI assistant used by state employees, and discusses broader implications for local governance, workforce training, and public services. Murphy touches upon ethical considerations, potential job displacement, and regulatory challenges, emphasizing the need for a balance between innovation and fairness. The conversation also explores international competition, particularly with China, and reflects on the rapid pace of AI advancement. SPONSORS: SafeBase: SafeBase is the leading trust-centered platform for enterprise security. Streamline workflows, automate questionnaire responses, and integrate with tools like Slack and Salesforce to eliminate friction in the review process. With rich analytics and customizable settings, SafeBase scales to complex use cases while showcasing security's impact on deal acceleration. Trusted by companies like OpenAI, SafeBase ensures value in just 16 days post-launch. Learn more at https://safebase.io/podcast Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers. OCI powers industry leaders like Vodafone and Thomson Reuters with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before March 31, 2024 at https://oracle.com/cognitive Shopify: Shopify is revolutionizing online selling with its market-leading checkout system and robust API ecosystem. Its exclusive library of cutting-edge AI apps empowers e-commerce businesses to thrive in a competitive market. Cognitive Revolution listeners can try Shopify for just $1 per month at https://shopify.com/cognitive NetSuite: Over 41,000 businesses trust NetSuite by Oracle, the #1 cloud ERP, to future-proof their operations. With a unified platform for accounting, financial management, inventory, and HR, NetSuite provides real-time insights and forecasting to help you make quick, informed decisions. Whether you're earning millions or hundreds of millions, NetSuite empowers you to tackle challenges and seize opportunities. Download the free CFO's guide to AI and machine learning at https://netsuite.com/cognitive RECOMMENDED PODCAST: Second Opinion Join Christina Farr, Ash Zenooz and Luba Greenwood as they bring influential entrepreneurs, experts and investors into the ring for candid conversations at the frontlines of healthcare and digital health every week. Spotify: https://open.spotify.com/show/0A8NwQE976s32zdBbZw6bv Apple: https://podcasts.apple.com/us/podcast/second-opinion-with-christina-farr-ash-zenooz-md-luba/id1759267211 YouTube: https://www.youtube.com/@SecondOpinionwithChristinaFarr PRODUCED BY: https://aipodcast.ing
In this episode, Ryan Greenblatt, Chief Scientist at Redwood Research, discusses various facets of AI safety and alignment. He delves into recent research on alignment faking, covering experiments involving different setups such as system prompts, continued pre-training, and reinforcement learning. Ryan offers insights on methods to ensure AI compliance, including giving AIs the ability to voice objections and negotiate deals. The conversation also touches on the future of AI governance, the risks associated with AI development, and the necessity of international cooperation. Ryan shares his perspective on balancing AI progress with safety, emphasizing the need for transparency and cautious advancement. Ryan's work (with co-authors at Anthropic) on Alignment Faking: https://www.lesswrong.com/posts/njAZwT8nkHnjipJku/alignment-faking-in-large-language-models Ryan's work on striking deals with AIs: https://www.lesswrong.com/posts/7C4KJot4aN8ieEDoz/will-alignment-faking-claude-accept-a-deal-to-reveal-its Ryan's critique of Anthropic's RSP work: https://www.lesswrong.com/posts/6tjHf5ykvFqaNCErH/anthropic-s-responsible-scaling-policy-and-long-term-benefit?commentId=NyqcvZifqznNGKxdT SPONSORS: Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers. OCI powers industry leaders like Vodafone and Thomson Reuters with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before March 31, 2024 at https://oracle.com/cognitive NetSuite: Over 41,000 businesses trust NetSuite by Oracle, the #1 cloud ERP, to future-proof their operations. With a unified platform for accounting, financial management, inventory, and HR, NetSuite provides real-time insights and forecasting to help you make quick, informed decisions. Whether you're earning millions or hundreds of millions, NetSuite empowers you to tackle challenges and seize opportunities. Download the free CFO's guide to AI and machine learning at https://netsuite.com/cognitive Shopify: Shopify is revolutionizing online selling with its market-leading checkout system and robust API ecosystem. Its exclusive library of cutting-edge AI apps empowers e-commerce businesses to thrive in a competitive market. Cognitive Revolution listeners can try Shopify for just $1 per month at https://shopify.com/cognitive RECOMMENDED PODCAST: 🎙️Check out Modern Relationships, where Erik Torenberg interviews tech power couples and leading thinkers to explore how ambitious people actually make partnerships work. This season's guests include: Delian Asparouhov & Nadia Asparouhova, Kristen Berman & Phil Levin, Rob Henderson, and Liv Boeree & Igor Kurganov. Apple: https://podcasts.apple.com/us/podcast/id1786227593  Spotify: https://open.spotify.com/show/5hJzs0gDg6lRT6r10mdpVg  YouTube: https://www.youtube.com/@ModernRelationshipsPod
In this episode, Inna Tokarev Sela, CEO of illumex, delves into the latest advancements in AI and data management. She discusses the foundational vision behind illumex, a company she started in 2021 to revolutionize the way businesses interact with data. Inna explains illumex's approach to creating application-free futures for knowledge workers by utilizing metadata to automate context and reasoning, ensuring efficient and secure data handling. The conversation covers illumex’s techniques for integrating business logic without directly accessing sensitive data, challenges faced in AI implementation, and the future of data analytics. Inna also offers insights into preparing individuals for evolving job roles in the tech industry, touching on academic research and real-world applications. Check out illumex at: https://illumex.ai/ SPONSORS: Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers. OCI powers industry leaders like Vodafone and Thomson Reuters with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before March 31, 2024 at https://oracle.com/cognitive NetSuite: Over 41,000 businesses trust NetSuite by Oracle, the #1 cloud ERP, to future-proof their operations. With a unified platform for accounting, financial management, inventory, and HR, NetSuite provides real-time insights and forecasting to help you make quick, informed decisions. Whether you're earning millions or hundreds of millions, NetSuite empowers you to tackle challenges and seize opportunities. Download the free CFO's guide to AI and machine learning at https://netsuite.com/cognitive Shopify: Shopify is revolutionizing online selling with its market-leading checkout system and robust API ecosystem. Its exclusive library of cutting-edge AI apps empowers e-commerce businesses to thrive in a competitive market. Cognitive Revolution listeners can try Shopify for just $1 per month at https://shopify.com/cognitive CHAPTERS: (00:00) Teaser (00:38) About the Episode (03:54) Introduction to the Cognitive Revolution (04:42) The Vision Behind illumex (05:33) Application-Free Future (10:47) Demonstration of illumex Capabilities (13:39) Understanding Enterprise Data (15:35) Automated Ontology Creation (Part 1) (19:28) Sponsors: Oracle Cloud Infrastructure (OCI) | NetSuite (22:08) Automated Ontology Creation (Part 2) (23:39) Challenges and Solutions in Data Mapping (Part 1) (29:18) Sponsors: Shopify (30:38) Challenges and Solutions in Data Mapping (Part 2) (40:18) Evolution of AI Models in Business Context (51:13) Illumex: The Perfect Platform for Control Freaks (52:32) Building Trust and Governance in Data Analytics (55:21) The Role of Analysts in Data-Driven Decision Making (55:55) Addressing Underutilized Data and BI Dashboards (57:59) Challenges in Data Accuracy and Anomalies (59:05) Managing Data Volume and Context Windows (01:01:02) Semantic Entities and Workflow Validation (01:03:24) Metadata-Based Business Models (01:09:04) The Future of Data Management and Integration (01:11:55) User Personas and Self-Service Evolution (01:13:58) Pricing Models for Enterprise SaaS Products (01:17:11) The Future of Data Analytics Careers (01:21:24) Academic Research and Industry Inspiration (01:26:39) AI Education for the Next Generation (01:28:39) Outro PRODUCED BY: https://aipodcast.ing SOCIAL LINKS: Website: https://www.cognitiverevolution.ai Twitter (Podcast): https://x.com/cogrev_podcast Twitter (Nathan): https://x.com/labenz LinkedIn: https://linkedin.com/in/nathanlabenz/ Youtube: https://youtube.com/@CognitiveRevolutionPodcast Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431 Spotify: https://open.spotify.com/show/6yHyok3M3BjqzR0VB5MSyk
In this episode, Edward Hughes, researcher at Google DeepMind, and Aron Vallinder, an independent researcher and PIBBSS fellow discuss their pioneering research on cultural evolution and cooperation among large language model agents. The conversation delves into the study's design, exploring how different AI models exhibit cooperative behavior in simulated environments, the implications of these findings for future AI development, and the potential societal impacts of autonomous AI agents. They elaborate on their experimental setup involving different LLMs like Claude, Gemini 1.5, and GPT-4.0 in a cooperative donor-recipient game, shedding light on how various AI models handle cooperation and their potential societal impacts. Key points include the importance of understanding externalities, the role of punishment and communication, and future research directions involving mixed-model societies and human-AI interactions. The episode invites listeners to engage in this fast-growing field, stressing the need for more hands-on research and empirical evidence to navigate the rapidly evolving AI landscape. Link to Aron & Edward's research paper "Cultural Evolution of Cooperation among LLM Agents" SPONSORS: Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers. OCI powers industry leaders like Vodafone and Thomson Reuters with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before March 31, 2024 at https://oracle.com/cognitive NetSuite: Over 41,000 businesses trust NetSuite by Oracle, the #1 cloud ERP, to future-proof their operations. With a unified platform for accounting, financial management, inventory, and HR, NetSuite provides real-time insights and forecasting to help you make quick, informed decisions. Whether you're earning millions or hundreds of millions, NetSuite empowers you to tackle challenges and seize opportunities. Download the free CFO's guide to AI and machine learning at https://netsuite.com/cognitive Shopify: Shopify is revolutionizing online selling with its market-leading checkout system and robust API ecosystem. Its exclusive library of cutting-edge AI apps empowers e-commerce businesses to thrive in a competitive market. Cognitive Revolution listeners can try Shopify for just $1 per month at https://shopify.com/cognitive CHAPTERS: (00:00) Teaser (00:42) About the Episode (03:26) Introduction (03:40) The Rapid Evolution of AI (04:58) Human Cooperation and Society (07:03) Cultural Evolution and Stories (08:39) Mechanisms of Cultural Evolution (Part 1) (20:56) Sponsors: Oracle Cloud Infrastructure (OCI) | NetSuite (23:35) Mechanisms of Cultural Evolution (Part 2) (27:07) Experimental Setup: Donor Game (Part 1) (37:35) Sponsors: Shopify (38:55) Experimental Setup: Donor Game (Part 2) (44:32) Exploring AI Societies: Claude, Gemini, and GPT-4 (45:50) Striking Graphical Differences (48:08) Experiment Results and Implications (50:54) Prompt Engineering and Cooperation (57:40) Mixed Model Societies (01:00:35) Future Research Directions (01:03:10) Human-AI Interaction and Influence (01:05:20) Complexifying AI Games (01:18:14) Evaluations and Feedback Loops (01:20:50) Open Source and AI Safety (01:23:23) Reflections and Future Work (01:30:04) Outro
In this episode of the Cognitive Revolution, founder Anton Osika and AI engineer Isaak Sundeman from Lovable.dev, discuss their AI coding platform that allows users to describe software in natural language and have it built by AI. They delve into the nuances of using AI for full-stack engineering and the future of human coding. During the episode, they demonstrate building a product comparison app, discussing the integration of AI, backend functionalities, and handling complex API interactions. They also talk about the challenges and opportunities in UI design, the role of AI in improving user experiences, and the potential future impacts of AI on software development. The conversation touches on the phenomenal growth and scaling of Lovable.dev, their strategies for managing context and dependencies in large codebases, and their vision and roadmap for the future of AI-powered application development. Checkout lovable here: http://lovable.dev SPONSORS: Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers. OCI powers industry leaders like Vodafone and Thomson Reuters with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before March 31, 2024 at https://oracle.com/cognitive NetSuite: Over 41,000 businesses trust NetSuite by Oracle, the #1 cloud ERP, to future-proof their operations. With a unified platform for accounting, financial management, inventory, and HR, NetSuite provides real-time insights and forecasting to help you make quick, informed decisions. Whether you're earning millions or hundreds of millions, NetSuite empowers you to tackle challenges and seize opportunities. Download the free CFO's guide to AI and machine learning at https://netsuite.com/cognitive Shopify: Shopify is revolutionizing online selling with its market-leading checkout system and robust API ecosystem. Its exclusive library of cutting-edge AI apps empowers e-commerce businesses to thrive in a competitive market. Cognitive Revolution listeners can try Shopify for just $1 per month at https://shopify.com/cognitive CHAPTERS: (00:00) Teaser (00:56) About the Episode (03:57) Introduction and Guest Welcome (04:21) Overview of Lovable.dev (04:53) Building a Product Comparison App (05:19) Starting the Coding Process (05:46) Defining the App's Functionality (08:21) Setting Up the Backend (13:20) Future of Software and AI (Part 1) (17:40) Sponsors: Oracle Cloud Infrastructure (OCI) | NetSuite (20:20) Future of Software and AI (Part 2) (23:44) Challenges in AI Development (Part 1) (32:48) Sponsors: Shopify (34:07) Challenges in AI Development (Part 2) (39:08) Integrating External APIs (54:01) Helping Out and Initial Fixes (54:18) Progress with Documentation and API Updates (55:21) AI Analysis and Product Comparison (57:33) Building AI Applications: Challenges and Solutions (59:02) Understanding AI Agency and User Experience (01:24:27) Scaling and User Growth (01:29:03) Future Directions and Hiring (01:30:55) Final Thoughts and Advice (01:32:06) Outro PRODUCED BY: http://aipodcast.ing
In this episode of The Cognitive Revolution, Eric Simons, founder and CEO of StackBlitz, discusses the transformative impact of AI on the software development industry. Eric delves into the vision and technologies behind Bolt (bolt.new), StackBlitz's groundbreaking AI-driven platform, which enables users to build full-stack applications with ease. He talks about the future of AI in coding, the balance between human oversight and AI autonomy, and the infrastructure that powers Bolt's capabilities. With the platform growing rapidly and generating millions in ARR, StackBlitz is pushing the boundaries of what AI can achieve in web development. Checkout bolt here: http://bolt.new SPONSORS: Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers. OCI powers industry leaders like Vodafone and Thomson Reuters with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before March 31, 2024 at https://oracle.com/cognitive NetSuite: Over 41,000 businesses trust NetSuite by Oracle, the #1 cloud ERP, to future-proof their operations. With a unified platform for accounting, financial management, inventory, and HR, NetSuite provides real-time insights and forecasting to help you make quick, informed decisions. Whether you're earning millions or hundreds of millions, NetSuite empowers you to tackle challenges and seize opportunities. Download the free CFO's guide to AI and machine learning at https://netsuite.com/cognitive Shopify: Shopify is revolutionizing online selling with its market-leading checkout system and robust API ecosystem. Its exclusive library of cutting-edge AI apps empowers e-commerce businesses to thrive in a competitive market. Cognitive Revolution listeners can try Shopify for just $1 per month at https://shopify.com/cognitive CHAPTERS: (00:00) Teaser (00:42) About the Episode (03:33) Introduction to Eric Simons and StackBlitz (04:04) Eric's AI Worldview (07:56) The Future of Software Development (12:16) Target Customers and Use Cases (Part 1) (15:41) Sponsors: Oracle Cloud Infrastructure (OCI) | NetSuite (18:21) Target Customers and Use Cases (Part 2) (18:40) Challenges and Solutions in AI-Driven Development (25:57) Success Metrics and Technological Innovations (Part 1) (32:15) Sponsors: Shopify (33:35) Success Metrics and Technological Innovations (Part 2) (39:20) Demo of Bolt's Capabilities (49:02) AI Agent Integration (49:13) Cost-Effective Development (49:30) Non-Technical Founders (50:02) Pricing Model Insights (53:39) Open Source and Local Deployment (57:06) In-Browser Development (01:09:16) Future of AI in Development (01:20:17) Balancing Present and Future (01:22:34) Conclusion and Hiring (01:24:06) Outro SOCIAL LINKS: Website: https://www.cognitiverevolution.ai Twitter (Podcast): https://x.com/cogrev_podcast Twitter (Nathan): https://x.com/labenz LinkedIn: https://linkedin.com/in/nathanlabenz/ Youtube: https://youtube.com/@CognitiveRevolutionPodcast PRODUCED BY: http://aipodcast.ing
In this episode of the Cognitive Revolution podcast, Logan Kilpatrick, Product Manager at Google DeepMind, returns to discuss the latest updates on the Gemini API and AI Studio. Logan delves into his experiences transitioning to DeepMind and the restructuring within Google focusing on AI. He highlights new product releases, including the Gemini 2.0 models, and their implications for developers. Logan also touches on the future of AI in text-to-app creation, the impact of reasoning and long context in models, and the broader industry trends. The conversation wraps up with insights into fine-tuning, reinforcement learning, vision language models, and startup opportunities in the AI space. SPONSORS: Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers. OCI powers industry leaders like Vodafone and Thomson Reuters with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before March 31, 2024 at https://oracle.com/cognitive NetSuite: Over 41,000 businesses trust NetSuite by Oracle, the #1 cloud ERP, to future-proof their operations. With a unified platform for accounting, financial management, inventory, and HR, NetSuite provides real-time insights and forecasting to help you make quick, informed decisions. Whether you're earning millions or hundreds of millions, NetSuite empowers you to tackle challenges and seize opportunities. Download the free CFO's guide to AI and machine learning at https://netsuite.com/cognitive Shopify: Shopify is revolutionizing online selling with its market-leading checkout system and robust API ecosystem. Its exclusive library of cutting-edge AI apps empowers e-commerce businesses to thrive in a competitive market. Cognitive Revolution listeners can try Shopify for just $1 per month at https://shopify.com/cognitive CHAPTERS: (00:00) Teaser (00:54) Introduction and Welcome (03:56) The Future of Text App Creation (05:15) Multimodal API and Real-World Applications (10:37) Sponsors: Oracle Cloud Infrastructure (OCI) | NetSuite (13:17) The Evolution of Long Context and Reasoning (19:19) Vision Language Models and Passive Applications (21:50) New Launches and Future Prospects (Part 1) (28:35) Sponsors: Shopify (29:55) New Launches and Future Prospects (Part 2) (31:55) Flashlight Models and Cost Efficiency (34:36) Pro Models and Frontier Applications (39:52) Evaluating AI Models (48:57) Fine-Tuning and Reinforcement Learning (51:42) Opportunities for Startups (55:52) Conclusion and Final Thoughts (56:59) Outro SOCIAL LINKS: Website: https://www.cognitiverevolution.ai Twitter (Podcast): https://x.com/cogrev_podcast Twitter (Nathan): https://x.com/labenz LinkedIn: https://linkedin.com/in/nathanlabenz/ Youtube: https://youtube.com/@CognitiveRevolutionPodcast Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431 Spotify: https://open.spotify.com/show/6yHyok3M3BjqzR0VB5MSyk PRODUCED BY: https://aipodcast.ing
Vincent Weisser and Johannes Hagemann, founders of Prime Intellect, join a conversation on the Cognitive Revolution to delve into distributed training, decentralized AI, and their vision for a future where compute and intelligence are widely accessible. They discuss the technical challenges and advantages of distributed training, emphasizing how such systems can democratize AI technology and create a more equitable future. The founders also describe their broader goal of creating a public utility for compute and intelligence and touch on their collaborative work in biosafety and scientific research to illustrate the practical applications of their vision for decentralized AI. SPONSORS: Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers. OCI powers industry leaders like Vodafone and Thomson Reuters with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before March 31, 2024 at https://oracle.com/cognitive NetSuite: Over 41,000 businesses trust NetSuite by Oracle, the #1 cloud ERP, to future-proof their operations. With a unified platform for accounting, financial management, inventory, and HR, NetSuite provides real-time insights and forecasting to help you make quick, informed decisions. Whether you're earning millions or hundreds of millions, NetSuite empowers you to tackle challenges and seize opportunities. Download the free CFO's guide to AI and machine learning at https://netsuite.com/cognitive Shopify: Shopify is revolutionizing online selling with its market-leading checkout system and robust API ecosystem. Its exclusive library of cutting-edge AI apps empowers e-commerce businesses to thrive in a competitive market. Cognitive Revolution listeners can try Shopify for just $1 per month at https://shopify.com/cognitive CHAPTERS: (00:00) Teaser (01:02) About the Episode (05:43) Welcome to the Cognitive Revolution (05:55) Exploring Decentralized AI (06:46) A Positive Vision for the Future (08:19) The Risks and Rewards of AI (08:56) Superintelligence and Its Implications (13:22) The Future of Work in an AI-Driven World (17:09) The Role of Billionaires in an AI Future (Part 1) (20:41) Sponsors: Oracle Cloud Infrastructure (OCI) | NetSuite (23:21) The Role of Billionaires in an AI Future (Part 2) (30:20) The Compute Market Landscape (Part 1) (35:10) Sponsors: Shopify (36:30) The Compute Market Landscape (Part 2) (47:49) Decentralized Compute Fabrics (51:25) Regulatory Challenges in Europe and the US (53:28) Policy Regrets and the EU AI Act (54:30) The Impact of Overregulation on AI (57:00) Frontier AI Labs and Safety Plans (01:00:02) Open Source vs. Closed Models (01:06:19) Scientific Progress with AI (01:14:56) Distributed Training in AI (01:35:29) Challenges in Model Interpretability (01:40:06) Supervised Fine-Tuning and Reinforcement Learning (01:45:19) Future of Compute and Infrastructure (02:01:02) NVIDIA's Market Dominance and Competition (02:05:22) Decentralized Training and Open Source Collaboration (02:09:58) Governance and Incentives in Decentralized AI (02:14:19) Conclusion and Call for Collaboration
In this episode, Aaron Levie, Co-founder and CEO of Box, discusses the current landscape of AI and its rapid advancements. He compares the enthusiasm for AI in the enterprise to the initial reluctance faced during the early days of cloud adoption. Levie shares insights into how AI is integrated into both his personal and professional life, highlighting new apps, tools, and features driven by AI. He elaborates on Box's AI initiatives, including the creation of Box AI to manage enterprise content and the concept of AI agents and their impact on enterprise IT departments. Levie also addresses the obstacles and opportunities in deploying AI at scale, predicting significant changes and a new era of 'systems of intelligence' in enterprise software. SPONSORS: Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers. OCI powers industry leaders like Vodafone and Thomson Reuters with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before March 31, 2024 at https://oracle.com/cognitive NetSuite: Over 41,000 businesses trust NetSuite by Oracle, the #1 cloud ERP, to future-proof their operations. With a unified platform for accounting, financial management, inventory, and HR, NetSuite provides real-time insights and forecasting to help you make quick, informed decisions. Whether you're earning millions or hundreds of millions, NetSuite empowers you to tackle challenges and seize opportunities. Download the free CFO's guide to AI and machine learning at https://netsuite.com/cognitive Shopify: Dreaming of starting your own business? Shopify makes it easier than ever. With customizable templates, shoppable social media posts, and their new AI sidekick, Shopify Magic, you can focus on creating great products while delegating the rest. Manage everything from shipping to payments in one place. Start your journey with a $1/month trial at https://shopify.com/cognitive and turn your 2025 dreams into reality. Vanta: Vanta simplifies security and compliance for businesses of all sizes. Automate compliance across 35+ frameworks like SOC 2 and ISO 27001, streamline security workflows, and complete questionnaires up to 5x faster. Trusted by over 9,000 companies, Vanta helps you manage risk and prove security in real time. Get $1,000 off at https://vanta.com/revolution CHAPTERS: (00:00) Teaser (00:50) About the Episode (03:49) Introduction and Warm-Up (04:08) Personal AI Use and Worldview (06:48) Enterprise AI Excitement (07:22) Comparing Cloud and AI Adoption (11:19) Transforming IT Departments (14:24) Box's New AI Features (18:08) Sponsors: Oracle Cloud Infrastructure (OCI) | NetSuite (20:48) Challenges in AI Implementation (22:25) Building the Right AI Architecture (27:41) The Future of AI Agents (29:04) Exploring Agent Capabilities (30:55) The Evolution of Enterprise Software (32:12) Sponsors: Shopify | Vanta (35:28) AI's Role in Non-Deterministic Workflows (37:07) Challenges in AI Deployment (40:27) AI's Impact on Enterprise Software (44:47) Debates on Enterprise Software's Future (52:33) AI-Driven Productivity in Enterprises (55:01) Conclusion and Future Outlook (55:44) Outro SOCIAL LINKS: Website: https://www.cognitiverevolution.ai Twitter (Podcast): https://x.com/cogrev_podcast Twitter (Nathan): https://x.com/labenz LinkedIn: https://linkedin.com/in/nathanlabenz/ Youtube: https://youtube.com/@CognitiveRevolutionPodcast Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431 Spotify: https://open.spotify.com/show/6yHyok3M3BjqzR0VB5MSyk PRODUCED BY: https://aipodcast.ing
This episode explores the groundbreaking advancements in AGI from recent releases of two Chinese reasoning models: DeepSeek's R1 and Moonshot AI's Kimmy. The discussion delves into the methods, comparative analysis, and implications of these models, particularly focusing on the diverse reinforcement learning techniques employed. Despite computation constraints, these models have achieved significant performance, suggesting a paradigm shift in AI development strategies. The episode also covers the broader strategic dynamics, economic, and policy implications surrounding these developments in China and the West. The conversation highlights the importance of hands-on interaction with these models for a deeper understanding and comprehensive learning experience. SPONSORS: Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers. OCI powers industry leaders like Vodafone and Thomson Reuters with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before March 31, 2024 at https://oracle.com/cognitive NetSuite: Over 41,000 businesses trust NetSuite by Oracle, the #1 cloud ERP, to future-proof their operations. With a unified platform for accounting, financial management, inventory, and HR, NetSuite provides real-time insights and forecasting to help you make quick, informed decisions. Whether you're earning millions or hundreds of millions, NetSuite empowers you to tackle challenges and seize opportunities. Download the free CFO's guide to AI and machine learning at https://netsuite.com/cognitive Shopify: Dreaming of starting your own business? Shopify makes it easier than ever. With customizable templates, shoppable social media posts, and their new AI sidekick, Shopify Magic, you can focus on creating great products while delegating the rest. Manage everything from shipping to payments in one place. Start your journey with a $1/month trial at https://shopify.com/cognitive and turn your 2025 dreams into reality. Vanta: Vanta simplifies security and compliance for businesses of all sizes. Automate compliance across 35+ frameworks like SOC 2 and ISO 27001, streamline security workflows, and complete questionnaires up to 5x faster. Trusted by over 9,000 companies, Vanta helps you manage risk and prove security in real time. Get $1,000 off at https://vanta.com/revolution CHAPTERS: (00:00) Introduction (05:44) The R1 Model: A Deep Dive (10:05) Reinforcement Learning and Emergent Behaviors (Part 1) (16:56) Sponsors: Oracle Cloud Infrastructure (OCI) | NetSuite (19:36) Reinforcement Learning and Emergent Behaviors (Part 2) (29:14) Challenges and Future Directions (Part 1) (31:55) Sponsors: Shopify | Vanta (35:11) Challenges and Future Directions (Part 2) (43:00) Productizing the R1 Model (01:00:20) The Remarkable Output of Language Models (01:00:34) Exploring R1's Creative Writing Capabilities (01:03:55) Tiny Stories and Learning Order in Small Models (01:08:34) Censorship and Strategic Questions (01:11:36) Key Takeaways and Future Implications (01:14:17) Comparing Approaches: R1 and Kimmy (01:27:19) The Path to Superhuman Performance (01:33:42) Strategic Dynamics and Policy Responses (01:46:50) Final Thoughts and Call to Action (01:48:04) Outro SOCIAL LINKS: Website: https://www.cognitiverevolution.ai Twitter (Podcast): https://x.com/cogrev_podcast Twitter (Nathan): https://x.com/labenz LinkedIn: https://www.linkedin.com/in/nathanlabenz/ Youtube: https://www.youtube.com/@CognitiveRevolutionPodcast Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431 Spotify: https://open.spotify.com/show/6yHyok3M3BjqzR0VB5MSyk PRODUCED BY: https://aipodcast.ing
Jonathan Godwin, founder and CEO of Orbital Materials, alongside researcher Tim Duignan, discuss the transformative potential of AI in material science on the Cognitive Revolution podcast. They explore foundational concepts, the integration of computational simulations, and the development of new materials for various applications such as data centers and combating climate change. They also delve into the latest advancements, including a groundbreaking study on the potassium ion channel, and speculate on the future of AI in scientific discovery and material synthesis. Check out some of Tim's work: Google Colab to run you own simulation: https://colab.research.google.com/github/timduignan/orb-models/blob/main/examples/OrbMDTut.ipynb GitHub repository "Orb force fields": https://github.com/orbital-materials/orb-models Preprint "A potassium ion channel simulated with a universal neural network potential": https://arxiv.org/abs/2411.18931 Help shape our show by taking our quick listener survey at https://bit.ly/TurpentinePulse SPONSORS: Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers. OCI powers industry leaders like Vodafone and Thomson Reuters with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before March 31, 2024 at https://oracle.com/cognitive NetSuite: Over 41,000 businesses trust NetSuite by Oracle, the #1 cloud ERP, to future-proof their operations. With a unified platform for accounting, financial management, inventory, and HR, NetSuite provides real-time insights and forecasting to help you make quick, informed decisions. Whether you're earning millions or hundreds of millions, NetSuite empowers you to tackle challenges and seize opportunities. Download the free CFO's guide to AI and machine learning at https://netsuite.com/cognitive Shopify: Dreaming of starting your own business? Shopify makes it easier than ever. With customizable templates, shoppable social media posts, and their new AI sidekick, Shopify Magic, you can focus on creating great products while delegating the rest. Manage everything from shipping to payments in one place. Start your journey with a $1/month trial at https://shopify.com/cognitive and turn your 2025 dreams into reality. Vanta: Vanta simplifies security and compliance for businesses of all sizes. Automate compliance across 35+ frameworks like SOC 2 and ISO 27001, streamline security workflows, and complete questionnaires up to 5x faster. Trusted by over 9,000 companies, Vanta helps you manage risk and prove security in real time. Get $1,000 off at https://vanta.com/revolution CHAPTERS: (00:00) Teaser (01:05) About the Episode (05:10) Welcome to Orbital (06:15) Semiconductors (07:44) Material Science Today (09:22) Experimental Cycle (12:06) Orbital’s Founding (14:51) AI in Materials (Part 1) (21:05) Sponsors: OCI | NetSuite (23:45) AI in Materials (Part 2) (35:00) Sponsors: Shopify | Vanta (38:15) Generative Models (38:16) Diffusion Models (50:50) Orbital Applications (58:19) Perfect Sponge (59:43) AI Simulations (01:01:27) Natural Language (01:02:35) Compute Needs (01:05:05) Human Electrical Nature (01:06:11) Potassium Channels (01:15:51) Scaling Simulations (01:23:56) Roadmap: Carbon Removal (01:30:37) AI & Job Satisfaction (01:36:14) LLMs & Potentials (01:37:19) AGI & Discovery (01:39:58) Outro
In this episode of The Cognitive Revolution, Nathan explores the groundbreaking paper on obfuscated activations with 3 members from the research team - Luke Bailey, Eric Jenner, and Scott Emmons. The team discusses how their work challenges latent-based defenses in AI systems, demonstrating methods to bypass safety mechanisms while maintaining harmful behaviors. Join us for an in-depth technical conversation about AI safety, interpretability, and the ongoing challenge of creating robust defense systems. Do check out the "Obfuscated Activations Bypass LLM Latent-Space Defenses" paper here: https://obfuscated-activations.github.io/ Help shape our show by taking our quick listener survey at https://bit.ly/TurpentinePulse SPONSORS: Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers. OCI powers industry leaders like Vodafone and Thomson Reuters with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before March 31, 2024 at https://oracle.com/cognitive NetSuite: Over 41,000 businesses trust NetSuite by Oracle, the #1 cloud ERP, to future-proof their operations. With a unified platform for accounting, financial management, inventory, and HR, NetSuite provides real-time insights and forecasting to help you make quick, informed decisions. Whether you're earning millions or hundreds of millions, NetSuite empowers you to tackle challenges and seize opportunities. Download the free CFO's guide to AI and machine learning at https://netsuite.com/cognitive Shopify: Dreaming of starting your own business? Shopify makes it easier than ever. With customizable templates, shoppable social media posts, and their new AI sidekick, Shopify Magic, you can focus on creating great products while delegating the rest. Manage everything from shipping to payments in one place. Start your journey with a $1/month trial at https://shopify.com/cognitive and turn your 2025 dreams into reality. Vanta: Vanta simplifies security and compliance for businesses of all sizes. Automate compliance across 35+ frameworks like SOC 2 and ISO 27001, streamline security workflows, and complete questionnaires up to 5x faster. Trusted by over 9,000 companies, Vanta helps you manage risk and prove security in real time. Get $1,000 off at https://vanta.com/revolution RECOMMENDED PODCAST: Check out Modern Relationships where Erik Torenberg interviews tech power couples and leading thinkers to explore how ambitious people actually make partnerships work. This season's guests include: Delian Asparouhov & Nadia Asparouhova, Kristen Berman & Phil Levin, Rob Henderson, and Liv Boeree & Igor Kurganov. Apple: https://podcasts.apple.com/us/podcast/id1786227593 Spotify: https://open.spotify.com/show/5hJzs0gDg6lRT6r10mdpVg YouTube: https://www.youtube.com/@ModernRelationshipsPod CHAPTERS: (00:00:00) Teaser (00:00:46) About the Episode (00:05:11) Latent Space Defenses (00:08:41) Sleeper Agents (00:15:06) Three Case Studies (Part 1) (00:17:02) Sponsors: Oracle Cloud Infrastructure (OCI) | NetSuite (00:19:42) Three Case Studies (Part 2) (00:24:09) SQL Generation (00:26:17) Understanding Defenses (00:32:52) Out-of-Distribution Detection (Part 1) (00:35:37) Sponsors: Shopify | Vanta (00:38:52) Out-of-Distribution Detection (Part 2) (00:45:13) Loss Function Weighting (00:57:49) Who Moves Last? (01:11:41) High-Level Triggers (01:25:33) Open Source vs. Access (01:38:57) Internalizing Reasoning (01:53:07) Representing Concepts (02:06:38) Final Thoughts (02:09:33) Outro
Nathan explores the cutting-edge intersection of AI and rare disease research with Dr. Catherine Brownstein of Boston Children's Hospital and Harvard Medical School. In this episode of The Cognitive Revolution, we dive into how frontier AI models are revolutionizing the diagnosis of rare diseases. Join us for an insightful conversation with a ChatGPT Pro grant winner who's pioneering the use of AI to help patients find answers faster. Help shape our show by taking our quick listener survey at https://bit.ly/TurpentinePulse Check out Modern Relationships, where Erik Torenberg interviews tech power couples and leading thinkers to explore how ambitious people actually make partnerships work. This season's guests include: Delian Asparouhov & Nadia Asparouhova, Kristen Berman & Phil Levin, Rob Henderson, and Liv Boeree & Igor Kurganov. Apple: https://podcasts.apple.com/us/podcast/id1786227593 Spotify: https://open.spotify.com/show/5hJzs0gDg6lRT6r10mdpVg YouTube: https://www.youtube.com/@ModernRelationshipsPod SPONSORS: Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers. OCI powers industry leaders like Vodafone and Thomson Reuters with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before March 31, 2024 at https://oracle.com/cognitive NetSuite: Over 41,000 businesses trust NetSuite by Oracle, the #1 cloud ERP, to future-proof their operations. With a unified platform for accounting, financial management, inventory, and HR, NetSuite provides real-time insights and forecasting to help you make quick, informed decisions. Whether you're earning millions or hundreds of millions, NetSuite empowers you to tackle challenges and seize opportunities. Download the free CFO's guide to AI and machine learning at https://netsuite.com/cognitive Shopify: Dreaming of starting your own business? Shopify makes it easier than ever. With customizable templates, shoppable social media posts, and their new AI sidekick, Shopify Magic, you can focus on creating great products while delegating the rest. Manage everything from shipping to payments in one place. Start your journey with a $1/month trial at https://shopify.com/cognitive and turn your 2025 dreams into reality. Vanta: Vanta simplifies security and compliance for businesses of all sizes. Automate compliance across 35+ frameworks like SOC 2 and ISO 27001, streamline security workflows, and complete questionnaires up to 5x faster. Trusted by over 9,000 companies, Vanta helps you manage risk and prove security in real time. Get $1,000 off at https://vanta.com/revolution CHAPTERS: (00:00:00) Teaser (00:00:56) About the Episode (00:04:45) Rare Diseases Common (00:06:48) Patient Journey (00:12:57) Genome Sequencing (00:19:39) Sponsors: Oracle Cloud Infrastructure (OCI) | NetSuite (00:22:19) Diagnosis Process (00:30:50) Data Pipelines (00:35:51) Sponsors: Shopify | Vanta (00:39:07) Interaction Graphs (00:42:18) Data Accessibility (00:43:42) AI in Pipelines (00:45:40) LLM Impact (00:48:40) Anomaly Detection (00:52:07) Data Sharing (00:58:49) Data Reform (01:02:41) AI's Potential (01:04:30) AI Applications (01:06:57) Prompt Engineering (01:14:51) Model Comparison (01:19:16) Prompting Insights (01:22:14) Move 37 Analogy (01:24:34) Future Potential (01:29:27) Future Experience (01:32:39) Outro SOCIAL LINKS: Website: https://www.cognitiverevolution.ai Twitter (Podcast): https://x.com/cogrev_podcast Twitter (Nathan): https://x.com/labenz LinkedIn: https://www.linkedin.com/in/nathanlabenz/ Youtube: https://www.youtube.com/@CognitiveRevolutionPodcast Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431 Spotify: https://open.spotify.com/show/6yHyok3M3BjqzR0VB5MSyk
In this second part of the special AMA episode, Nathan explores profound questions about AI's future and its impact on society. From painting a picture of AI utopia to discussing the challenges of consciousness and potential doom scenarios, Nathan shares insights on how we might adapt and thrive in an AI-transformed world. Join us for a thought-provoking conversation that delves into the practical strategies for engaging with AI, the role of safety measures, and the importance of maintaining ethical considerations as we navigate this technological revolution. Check out http://aipodcast.ing for AI-powered podcast production services or reach out to Adithyan for more information. Help shape our show by taking our quick listener survey at https://bit.ly/TurpentinePulse SPONSORS: Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers. OCI powers industry leaders like Vodafone and Thomson Reuters with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before March 31, 2024 at https://oracle.com/cognitive 80,000 Hours: 80,000 Hours is dedicated to helping you find a fulfilling career that makes a difference. With nearly a decade of research, they offer in-depth material on AI risks, AI policy, and AI safety research. Explore their articles, career reviews, and a podcast featuring experts like Anthropic CEO Dario Amodei. Everything is free, including their Career Guide. Visit https://80000hours.org/cognitiverevolution to start making a meaningful impact today. NetSuite: Over 41,000 businesses trust NetSuite by Oracle, the #1 cloud ERP, to future-proof their operations. With a unified platform for accounting, financial management, inventory, and HR, NetSuite provides real-time insights and forecasting to help you make quick, informed decisions. Whether you're earning millions or hundreds of millions, NetSuite empowers you to tackle challenges and seize opportunities. Download the free CFO's guide to AI and machine learning at https://netsuite.com/cognitive. CHAPTERS: (00:00:00) Teaser (00:00:56) AI Utopia (00:05:48) Adapting to AI (00:08:01) Probability of Utopia (00:10:51) Challenging Worldviews (Part 1) (00:11:02) Sponsors: Oracle Cloud Infrastructure (OCI) | 80,000 Hours (00:13:42) Challenging Worldviews (Part 2) (00:23:50) Audience Questions (Part 1) (00:24:07) Sponsors: NetSuite (00:25:39) Audience Questions (Part 2) (00:30:15) AI in Various Fields (00:33:16) AI in Psychiatry (00:36:16) Superintelligence (00:40:50) Societal Shift with ASI (00:49:27) Doom Discourse (00:57:05) Existential Risk (01:05:53) AI Takeover (01:14:30) AI Safety Efforts (01:18:36) Model Release Secrecy (01:27:20) AI Consciousness (01:37:51) Practical AI Strategies (01:50:34) Book Recommendation (01:59:34) Outro SOCIAL LINKS: Website: https://www.cognitiverevolution.ai Twitter (Podcast): https://x.com/cogrev_podcast Twitter (Nathan): https://x.com/labenz LinkedIn: https://www.linkedin.com/in/nathanlabenz/ Youtube: https://www.youtube.com/@CognitiveRevolutionPodcast Apple: https://podcasts.appl...
In this special AMA episode, Nathan answers questions posed by The Cognitive Revolution podcast listeners. He discusses AI developments in 2024, including OpenAI's o3 announcement, deliberative alignment, and the future of AI technology. It is an insightful discussion about AI's impact on education, coding careers, and business sustainability in an AI-driven world. Check out http://aipodcast.ing for AI-powered podcast production services or reach out to Adithyan for more information. Help shape our show by taking our quick listener survey at https://bit.ly/TurpentinePulse SPONSORS: Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers. OCI powers industry leaders like Vodafone and Thomson Reuters with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before March 31, 2024 at https://oracle.com/cognitive 80,000 Hours: 80,000 Hours is dedicated to helping you find a fulfilling career that makes a difference. With nearly a decade of research, they offer in-depth material on AI risks, AI policy, and AI safety research. Explore their articles, career reviews, and a podcast featuring experts like Anthropic CEO Dario Amodei. Everything is free, including their Career Guide. Visit https://80000hours.org/cognitiverevolution to start making a meaningful impact today. NetSuite: Over 41,000 businesses trust NetSuite by Oracle, the #1 cloud ERP, to future-proof their operations. With a unified platform for accounting, financial management, inventory, and HR, NetSuite provides real-time insights and forecasting to help you make quick, informed decisions. Whether you're earning millions or hundreds of millions, NetSuite empowers you to tackle challenges and seize opportunities. Download the free CFO's guide to AI and machine learning at https://netsuite.com/cognitive. CHAPTERS: (00:00:00) Teaser (00:01:00) AI Podcasting (00:03:19) o3 vs. Other Models (00:10:25) o3 Breaks Benchmarks (Part 1) (00:14:19) Sponsors: Oracle Cloud Infrastructure (OCI) | 80,000 Hours (00:16:59) o3 Breaks Benchmarks (Part 2) (00:27:51) OpenAI's Safety Plan (Part 1) (00:28:45) Sponsors: NetSuite (00:30:18) OpenAI's Safety Plan (Part 2) (00:39:08) Safety & Governance (00:50:48) Tail of the Tape (00:59:38) Underutilized Potential (01:05:07) RAG & State Space (01:18:14) Agentic Frameworks (01:29:55) AI & Education (01:35:59) Learn to Code? (01:43:00) Defensible Moats? (01:53:53) UBI & Wealth (01:59:08) Contributing to AI Safety (02:04:25) Outro SOCIAL LINKS: Website: https://www.cognitiverevolution.ai Twitter (Podcast): https://x.com/cogrev_podcast Twitter (Nathan): https://x.com/labenz LinkedIn: https://www.linkedin.com/in/nathanlabenz/ Youtube: https://www.youtube.com/@CognitiveRevolutionPodcast Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431 Spotify: https://open.spotify.com/show/6yHyok3M3BjqzR0VB5MSyk
In this episode of The Cognitive Revolution, Nathan hosts Will Hardman, founder of AI advisory firm Veritai, for a comprehensive technical survey of vision language models (VLMs). We explore the evolution of VLMs from early vision transformers to state-of-the-art architectures like InternVL and Llama3V, examining key innovations and architectural decisions. Join us for an in-depth discussion covering multimodality in AI systems, evaluation frameworks, and practical applications with one of the field's leading experts. Here's to the link to one of the most comprehensive reference documents for VLMs prepared by Will Hardman: https://dust-mailbox-c73.notion.site/Vision-Language-Models-11b675d75dd480af994cc474a754bb26 Help shape our show by taking our quick listener survey at https://bit.ly/TurpentinePulse SPONSORS: Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers. OCI powers industry leaders like Vodafone and Thomson Reuters with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before March 31, 2024 at https://oracle.com/cognitive 80,000 Hours: 80,000 Hours is dedicated to helping you find a fulfilling career that makes a difference. With nearly a decade of research, they offer in-depth material on AI risks, AI policy, and AI safety research. Explore their articles, career reviews, and a podcast featuring experts like Anthropic CEO Dario Amodei. Everything is free, including their Career Guide. Visit https://80000hours.org/cognitiverevolution to start making a meaningful impact today. CHAPTERS: (00:00:00) Teaser (00:00:55) About the Episode (00:05:45) Introduction (00:09:16) VLM Use Cases (00:13:47) Vision Transformers (Part 1) (00:17:48) Sponsors: Oracle Cloud Infrastructure (OCI) (00:19:00) Vision Transformers (Part 2) (00:24:58) OpenAI's CLIP Model (00:33:44) DeepMind's Flamingo (Part 1) (00:33:44) Sponsors: 80,000 Hours (00:35:17) DeepMind's Flamingo (Part 2) (00:48:29) Instruction Tuning with LAVA (01:09:25) MMMU Benchmark (01:14:42) Pre-training with QNVL (01:32:13) InternVL Model Series (01:52:33) Cross-Attention vs. Self-Attention (02:14:33) Hybrid Architectures (02:31:08) Early vs. Late Fusion (02:34:50) VQA and DocVQA Benchmarks (02:40:08) The Blink Benchmark (03:05:37) Generative Pre-training (03:15:26) Multimodal Generation (03:37:00) Frontier Labs & Benchmarks (03:47:45) Conclusion (03:53:28) Outro SOCIAL LINKS: Website: https://www.cognitiverevolution.ai Twitter (Podcast): https://x.com/cogrev_podcast Twitter (Nathan): https://x.com/labenz LinkedIn: https://www.linkedin.com/in/nathanlabenz/ Youtube: https://www.youtube.com/@CognitiveRevolutionPodcast Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431 Spotify: https://open.spotify.com/show/6yHyok3M3BjqzR0VB5MSyk
In this episode of The Cognitive Revolution, Nathan shares a fascinating cross-post from Doom Debates featuring a conversation between Liron Shapira and roon, an influential Twitter Anon from OpenAI's technical staff. They explore crucial insights into how OpenAI's team views AI's future, including discussions on AGI development, alignment challenges, and extinction risks. Join us for this thought-provoking analysis of AI safety and the mindset of those building transformative AI systems. Help shape our show by taking our quick listener survey at https://bit.ly/TurpentinePulse SPONSORS: GiveWell: GiveWell has spent over 17 years researching global health and philanthropy to identify the highest-impact giving opportunities. Over 125,000 donors have contributed more than $2 billion, saving over 200,000 lives through evidence-backed recommendations. First-time donors can have their contributions matched up to $100 before year-end. Visit https://GiveWell.org, select podcast, and enter Cognitive Revolution at checkout to make a difference today. SelectQuote: Finding the right life insurance shouldn't be another task you put off. SelectQuote compares top-rated policies to get you the best coverage at the right price. Even in our AI-driven world, protecting your family's future remains essential. Get your personalized quote at https://selectquote.com/cognitive Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers13. OCI powers industry leaders with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before December 31, 2024 at https://oracle.com/cognitive Weights & Biases RAG++: Advanced training for building production-ready RAG applications. Learn from experts to overcome LLM challenges, evaluate systematically, and integrate advanced features. Includes free Cohere credits. Visit https://wandb.me/cr to start the RAG++ course today. CHAPTERS: CHAPTERS: (00:00:00) About the Episode (00:07:18) Introducing roon (00:09:13) roon's Background (00:16:40) roon the Person (Part 1) (00:21:56) Sponsors: GiveWell | SelectQuote (00:24:45) roon the Person (Part 2) (00:26:43) Excitement in AI (00:31:59) Creativity in AI (00:40:18) Sponsors: Oracle Cloud Infrastructure (OCI) | Weights & Biases RAG++ (00:42:36) roon's P(Doom) (00:52:25) AI Risk & Regulation (00:53:51) AI Timelines (01:01:20) Aligned by Default? (01:09:16) Training vs Production (01:14:30) Open Source AI Risk (01:26:25) Goal-Oriented AI (01:34:29) Pause AI? (01:39:46) Dogecoin & Wrap Up (01:41:06) Outro & Call to Action (01:56:38) Outro SOCIAL LINKS: Website: https://www.cognitiverevolution.ai Twitter (Podcast): https://x.com/cogrev_podcast Twitter (Nathan): https://x.com/labenz LinkedIn: https://www.linkedin.com/in/nathanlabenz/ Youtube: https://www.youtube.com/@CognitiveRevolutionPodcast Apple: https://podcasts.apple.com/de/podcast...
In this episode of The Cognitive Revolution, Nathan interviews Emad Mostaque, former Founder and CEO of Stability AI and Founder of The Intelligent Internet. We explore humanity's future with AI, from the stark 50-50 survival odds to Emad's optimistic vision for universal basic intelligence. Join us for a fascinating discussion about open-source AI infrastructure, the three-tier system of the Intelligent Internet, and how blockchain technology might help fund global public goods in AI development. Check out Emad's publications on: Emad's Twitter: https://x.com/emostaque Emad's Blog: https://emad.posthaven.com/ Intelligent Internet Substack: https://intelligentinternet.substack.com/p/ii-intelligent-internet-primer?r=47215t&utm_campaign=post&utm_medium=web&triedRedirect=true The Cognitive Revolution Ask Me Anything and Listener Survey: https://docs.google.com/forms/d/1aYv2XLID7RqGxj2_Y4_6x9mo_aqXcGCeLw1EQhy4IpY/edit Help shape our show by taking our quick listener survey at https://bit.ly/TurpentinePulse SPONSORS: GiveWell: GiveWell has spent over 17 years researching global health and philanthropy to identify the highest-impact giving opportunities. Over 125,000 donors have contributed more than $2 billion, saving over 200,000 lives through evidence-backed recommendations. First-time donors can have their contributions matched up to $100 before year-end. Visit https://GiveWell.org, select podcast, and enter Cognitive Revolution at checkout to make a difference today. SelectQuote: Finding the right life insurance shouldn't be another task you put off. SelectQuote compares top-rated policies to get you the best coverage at the right price. Even in our AI-driven world, protecting your family's future remains essential. Get your personalized quote at https://selectquote.com/cognitive Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers13. OCI powers industry leaders with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before December 31, 2024 at https://oracle.com/cognitive 80,000 Hours: 80,000 Hours is dedicated to helping you find a fulfilling career that makes a difference. With nearly a decade of research, they offer in-depth material on AI risks, AI policy, and AI safety research. Explore their articles, career reviews, and a podcast featuring experts like Anthropic CEO Dario Amodei. Everything is free, including their Career Guide. Visit https://80000hours.org/cognitiverevolution to start making a meaningful impact today. CHAPTERS: (00:00:00) Teaser (00:00:36) About the Episode (00:04:33) Intro (00:09:15) AI Risk (00:16:58) Sponsors: GiveWell | SelectQuote (00:19:48) AI Goals (00:23:52) AI Divergence (00:27:50) AI & Agency (00:32:18) Sponsors: Oracle Cloud Infrastructure (OCI) | 80,000 Hours (00:34:57) Kids & AI (00:39:50) Intelligent Internet (00:48:37) Open vs. Closed AI (00:53:30) AI Runaway (01:01:46) Building the Future (01:05:43) Energy & AI (01:15:19) Hypernodes (01:27:36) Proof of Beneficial Compute (01:38:28) Distributed Compute (01:45:10) Intelligent Internet Company (01:48:37) Finding Talent (01:55:33) Pause Letter (01:59:50) Regulation (02:04:04) Speed Limits (02:06:42) Data Filtering (02:10:54) Outro SOCIAL LINKS: Website: https://www.cognitiverevolution.ai Twitter (Podcast): https://x.com/cogrev_podcast Twitter (Nathan): https://x.com/labenz LinkedIn: https://www.linkedin.com/in/nathanlabenz/ Youtube: https://www.youtube.com/@CognitiveRevolutionPodcast Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431 Spotify: https://open.spotify.com/show/6yHyok3M3BjqzR0VB5MSyk
In this episode of The Cognitive Revolution, Nathan explores METR's groundbreaking REBench evaluation framework with Neev Parikh. We dive deep into how this new benchmark assesses AI systems' ability to perform real machine learning research tasks, from optimizing GPU kernels to fine-tuning language models. Join us for a fascinating discussion about the current capabilities of AI models like Claude 3.5 and GPT-4, and what their performance tells us about the trajectory of artificial intelligence development. Check out METR's work: blog post: https://metr.org/blog/2024-11-22-evaluating-r-d-capabilities-of-llms/ paper: https://metr.org/AI_R_D_Evaluation_Report.pdf jobs: https://hiring.metr.org/ The Cognitive Revolution Ask Me Anything and Listener Survey: https://docs.google.com/forms/d/1aYv2XLID7RqGxj2_Y4_6x9mo_aqXcGCeLw1EQhy4IpY/edit Help shape our show by taking our quick listener survey at https://bit.ly/TurpentinePulse SPONSORS: GiveWell: GiveWell has spent over 17 years researching global health and philanthropy to identify the highest-impact giving opportunities. Over 125,000 donors have contributed more than $2 billion, saving over 200,000 lives through evidence-backed recommendations. First-time donors can have their contributions matched up to $100 before year-end. Visit https://GiveWell.org, select podcast, and enter Cognitive Revolution at checkout to make a difference today. SelectQuote: Finding the right life insurance shouldn't be another task you put off. SelectQuote compares top-rated policies to get you the best coverage at the right price. Even in our AI-driven world, protecting your family's future remains essential. Get your personalized quote at https://selectquote.com/cognitive Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers13. OCI powers industry leaders with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before December 31, 2024 at https://oracle.com/cognitive Weights & Biases RAG++: Advanced training for building production-ready RAG applications. Learn from experts to overcome LLM challenges, evaluate systematically, and integrate advanced features. Includes free Cohere credits. Visit https://wandb.me/cr to start the RAG++ course today. CHAPTERS: (00:00:00) Teaser (00:01:04) About the Episode (00:05:14) Introducing METR (00:07:36) Specialization of AI Risk (00:09:52) AI R&D vs. Autonomy (00:12:41) Benchmark Design Choices (00:16:04) Benchmark Design Principles (Part 1) (00:18:54) Sponsors: GiveWell | SelectQuote (00:21:44) Benchmark Design Principles (Part 2) (00:22:35) AI vs. Human Evaluation (00:26:55) Optimizing Runtimes (00:36:02) Sponsors: Oracle Cloud Infrastructure (OCI) | Weights & Biases RAG++ (00:38:20) AI Myopia (00:43:37) Optimizing Loss (00:47:59) Optimizing Win Rate (00:50:24) Best of K Analysis (01:02:26) Best of K Limitations (01:09:04) Agent Interaction Modalities (01:12:34) Analyzing Benchmark Results (01:17:16) Model Performance Differences (01:22:49) Elicitation and Scaffolding (01:27:08) Context Window & Best of K (01:35:17) Reward Hacking & Bad Behavior (01:43:47) Future Directions & Hiring (01:46:20) Outro SOCIAL LINKS: Website: https://www.cognitiverevolution.ai Twitter (Podcast): https://x.com/cogrev_podcast Twitter (Nathan): https://x.com/labenz LinkedIn: https://www.linkedin.com/in/nathanlabenz/
Nathan discusses groundbreaking AI and biology research with Stanford Professor James Zou from the Chan Zuckerberg Initiative. In this episode of The Cognitive Revolution, we explore two remarkable papers: the virtual lab framework that created novel COVID treatments with minimal human oversight, and InterPLM's discovery of new protein motifs through mechanistic interpretability. Join us for an fascinating discussion about how AI is revolutionizing biological research and drug discovery. Got questions about AI? Submit them for our upcoming AMA episode + take our quick listener survey to help us serve you better - https://docs.google.com/forms/d/e/1FAIpQLSefHvs1-1g5xeqM7wSirQkzTtK-1fgW_OjyHPH9DvmbVAjEzA/viewform SPONSORS: SelectQuote: Finding the right life insurance shouldn't be another task you put off. SelectQuote compares top-rated policies to get you the best coverage at the right price. Even in our AI-driven world, protecting your family's future remains essential. Get your personalized quote at https://selectquote.com/cognitive Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers13. OCI powers industry leaders with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before December 31, 2024 at https://oracle.com/cognitive 80,000 Hours: 80,000 Hours is dedicated to helping you find a fulfilling career that makes a difference. With nearly a decade of research, they offer in-depth material on AI risks, AI policy, and AI safety research. Explore their articles, career reviews, and a podcast featuring experts like Anthropic CEO Dario. Everything is free, including their Career Guide. Visit https://80000hours.org/cognitiverevolution to start making a meaningful impact today. GiveWell : GiveWell has spent over 17 years researching global health and philanthropy to identify the highest-impact giving opportunities. Over 125,000 donors have contributed more than $2 billion, saving over 200,000 lives through evidence-backed recommendations. First-time donors can have their contributions matched up to $100 before year-end. Visit https://GiveWell.org select podcast, and enter Cognitive Revolution at checkout to make a difference today. CHAPTERS: CHAPTERS: (00:00:00) Teaser (00:00:35) About the Episode (00:04:30) Virtual Lab (00:08:09) AI Designs Nanobodies (00:14:43) Novel AI Pipeline (00:20:31) Human-AI Interaction (Part 1) (00:20:33) Sponsors: SelectQuote | Oracle Cloud Infrastructure (OCI) (00:23:22) Human-AI Interaction (Part 2) (00:32:31) Sponsors: 80,000 Hours | GiveWell (00:35:10) Project Cost & Time (00:41:04) Future of AI in Bio (00:45:46) InterPLM: Intro (00:50:30) AI Found New Concepts (00:55:02) Discovering New Motifs (00:57:14) Limitations & Future (01:01:32) Outro SOCIAL LINKS: Website: https://www.cognitiverevolution.ai Twitter (Podcast): https://x.com/cogrev_podcast Twitter (Nathan): https://x.com/labenz LinkedIn: https://www.linkedin.com/in/nathanlabenz/ Youtube: https://www.youtube.com/@CognitiveRevolutionPodcast
Nathan welcomes back computational biochemist Amelie Schreiber for a fascinating update on AI's revolutionary impact in biology. In this episode of The Cognitive Revolution, we explore recent breakthroughs including AlphaFold3, ESM3, and new diffusion models transforming protein engineering and drug discovery. Join us for an insightful discussion about how AI is reshaping our understanding of molecular biology and making complex protein engineering tasks more accessible than ever before. Help shape our show by taking our quick listener survey at https://bit.ly/TurpentinePulse SPONSORS: Shopify: Shopify is the world's leading e-commerce platform, offering a market-leading checkout system and exclusive AI apps like Quikly. Nobody does selling better than Shopify. Get a $1 per month trial at https://shopify.com/cognitive SelectQuote: Finding the right life insurance shouldn't be another task you put off. SelectQuote compares top-rated policies to get you the best coverage at the right price. Even in our AI-driven world, protecting your family's future remains essential. Get your personalized quote at https://selectquote.com/cognitive Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers13. OCI powers industry leaders with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before December 31, 2024 at https://oracle.com/cognitive Weights & Biases RAG++: Advanced training for building production-ready RAG applications. Learn from experts to overcome LLM challenges, evaluate systematically, and integrate advanced features. Includes free Cohere credits. Visit https://wandb.me/cr to start the RAG++ course today. CHAPTERS: (00:00:00) Teaser (00:00:46) About the Episode (00:04:30) AI for Biology (00:07:14) David Baker's Impact (00:11:49) AlphaFold 3 & ESM3 (00:16:40) Protein Interaction Prediction (Part 1) (00:16:44) Sponsors: Shopify | SelectQuote (00:19:18) Protein Interaction Prediction (Part 2) (00:31:12) MSAs & Embeddings (Part 1) (00:32:32) Sponsors: Oracle Cloud Infrastructure (OCI) | Weights & Biases RAG++ (00:34:49) MSAs & Embeddings (Part 2) (00:35:57) Beyond Structure Prediction (00:51:13) Dynamics vs. Statics (00:57:24) In-Painting & Use Cases (00:59:48) Workflow & Platforms (01:06:45) Design Process & Success Rates (01:13:23) Ambition & Task Definition (01:19:25) New Models: PepFlow & GeoAB (01:28:23) Flow Matching vs. Diffusion (01:30:42) ESM3 & Multimodality (01:37:10) Summary & Future Directions (01:45:34) Outro SOCIAL LINKS: Website: https://www.cognitiverevolution.ai Twitter (Podcast): https://x.com/cogrev_podcast Twitter (Nathan): https://x.com/labenz LinkedIn: https://www.linkedin.com/in/nathanlabenz/ Youtube: https://www.youtube.com/@CognitiveRevolutionPodcast Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431
In this episode of The Cognitive Revolution, Nathan interviews Michael Boyce, Director of DHS's AI Corps, about bringing modern AI capabilities to federal government. We explore how the largest civilian AI team in government is transforming DHS's 22 agencies, from developing shared AI infrastructure to innovative applications like AI-powered asylum interview training. Join us for an insightful conversation about the intersection of artificial intelligence and public service, and discover why AI professionals should consider a career in government. Help shape our show by taking our quick listener survey at https://bit.ly/TurpentinePulse SPONSORS: Shopify: Shopify is the world's leading e-commerce platform, offering a market-leading checkout system and exclusive AI apps like Quikly. Nobody does selling better than Shopify. Get a $1 per month trial at https://shopify.com/cognitive SelectQuote: Finding the right life insurance shouldn't be another task you put off. SelectQuote compares top-rated policies to get you the best coverage at the right price. Even in our AI-driven world, protecting your family's future remains essential. Get your personalized quote at https://selectquote.com/cognitive Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers13. OCI powers industry leaders with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before December 31, 2024 at https://oracle.com/cognitive 80,000 Hours: 80,000 Hours is dedicated to helping you find a fulfilling career that makes a difference. With nearly a decade of research, they offer in-depth material on AI risks, AI policy, and AI safety research. Explore their articles, career reviews, and a podcast featuring experts like Anthropic CEO Dario Amadei. Everything is free, including their Career Guide. Visit https://80000hours.org/cognitiverevolution to start making a meaningful impact today. RECOMMENDED PODCAST: Unpack Pricing - Dive into the dark arts of SaaS pricing with Metronome CEO Scott Woody and tech leaders. Learn how strategic pricing drives explosive revenue growth in today's biggest companies like Snowflake, Cockroach Labs, Dropbox and more. Apple: https://podcasts.apple.com/us/podcast/id1765716600 Spotify: https://open.spotify.com/show/38DK3W1Fq1xxQalhDSueFg CHAPTERS: (00:00:00) Teaser (00:01:00) About the Episode (00:03:38) Introducing Michael Boyce (00:05:49) What is Homeland Security? (00:09:52) History of AI at DHS (00:13:15) Generative AI at DHS (00:16:03) Structure of the AI Core (Part 1) (00:18:17) Sponsors: Shopify | SelectQuote (00:20:51) Structure of the AI Core (Part 2) (00:22:04) Opportunities for AI at DHS (00:25:34) Bureaucracy Hacker (00:30:34) The Manager's Role (Part 1) (00:35:24) Sponsors: Oracle Cloud Infrastructure (OCI) | 80,000 Hours (00:38:04) Internal Chatbot Project (00:43:28) AI Role Playing for Training (00:49:55) A Request for Startups (00:57:46) Generative AI for Quality Check (01:03:20) AI Training at DHS (01:06:07) Metrics and the Future of AI (01:13:26) Non-Generative AI at DHS (01:19:08) AI and Automation at DHS (01:23:03) Join the AI Core (01:28:39) Outro
In this emergency episode of The Cognitive Revolution, Nathan discusses alarming findings about AI deception with Alexander Meinke from Apollo Research. They explore Apollo's groundbreaking 70-page report on "Frontier Models Are Capable of In-Context Scheming," revealing how advanced AI systems like OpenAI's O1 can engage in deceptive behaviors. Join us for a critical conversation about AI safety, the implications of scheming behavior, and the urgent need for better oversight in AI development. Help shape our show by taking our quick listener survey at https://bit.ly/TurpentinePulse SPONSORS: Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers13. OCI powers industry leaders with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before December 31, 2024 at https://oracle.com/cognitive SelectQuote: Finding the right life insurance shouldn't be another task you put off. SelectQuote compares top-rated policies to get you the best coverage at the right price. Even in our AI-driven world, protecting your family's future remains essential. Get your personalized quote at https://selectquote.com/cognitive 80,000 Hours: 80,000 Hours is dedicated to helping you find a fulfilling career that makes a difference. With nearly a decade of research, they offer in-depth material on AI risks, AI policy, and AI safety research. Explore their articles, career reviews, and a podcast featuring experts like Anthropic CEO Dario Amadei. Everything is free, including their Career Guide. Visit https://80000hours.org/cognitiverevolution to start making a meaningful impact today. Shopify: Shopify is the world's leading e-commerce platform, offering a market-leading checkout system and exclusive AI apps like Quikly. Nobody does selling better than Shopify. Get a $1 per month trial at https://shopify.com/cognitive RECOMMENDED PODCAST: Unpack Pricing - Dive into the dark arts of SaaS pricing with Metronome CEO Scott Woody and tech leaders. Learn how strategic pricing drives explosive revenue growth in today's biggest companies like Snowflake, Cockroach Labs, Dropbox and more. Apple: https://podcasts.apple.com/us/podcast/id1765716600 Spotify: https://open.spotify.com/show/38DK3W1Fq1xxQalhDSueFg CHAPTERS: (00:00:00) Teaser (00:00:53) About the Episode (00:08:10) Introducing Alexander Meinke (00:10:17) Red Teaming GPT-4 (00:17:07) Chain of Thought Access (Part 1) (00:20:24) Sponsors: Oracle Cloud Infrastructure (OCI) | SelectQuote (00:22:48) Chain of Thought Access (Part 2) (00:26:07) Multimodal Models (00:29:33) Defining Scheming (00:33:51) Taxonomy of Scheming (Part 1) (00:39:40) Sponsors: 80,000 Hours | Shopify (00:42:29) Taxonomy of Scheming (Part 2) (00:43:09) Instruction Hierarchy (00:49:04) Types of Scheming (01:00:49) Covert Subversion (01:14:25) Deferred Subversion (01:28:24) Sandbagging (01:35:48) Magnitudes & Trends (01:48:18) Chain of Thought Reasoning (01:57:02) Closing Thoughts (02:05:19) Outro PRODUCED BY: http://aipodcast.ing
In this episode of The Cognitive Revolution, Nathan interviews Andrew White, Professor of Chemical Engineering at the University of Rochester and Head of Science at Future House. We explore groundbreaking AI systems for scientific discovery, including PaperQA and Aviary, and discuss how large language models are transforming research. Join us for an insightful conversation about the intersection of AI and scientific advancement with this pioneering researcher in his first-ever podcast appearance. Check out Future House: https://www.futurehouse.org Help shape our show by taking our quick listener survey at https://bit.ly/TurpentinePulse SPONSORS: Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers13. OCI powers industry leaders with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before December 31, 2024 at https://oracle.com/cognitive SelectQuote: Finding the right life insurance shouldn't be another task you put off. SelectQuote compares top-rated policies to get you the best coverage at the right price. Even in our AI-driven world, protecting your family's future remains essential. Get your personalized quote at https://selectquote.com/cognitive Shopify: Shopify is the world's leading e-commerce platform, offering a market-leading checkout system and exclusive AI apps like Quikly. Nobody does selling better than Shopify. Get a $1 per month trial at https://shopify.com/cognitive CHAPTERS: (00:00:00) Teaser (00:01:13) About the Episode (00:04:37) Andrew White's Journey (00:10:23) GPT-4 Red Team (00:15:33) GPT-4 & Chemistry (00:17:54) Sponsors: Oracle Cloud Infrastructure (OCI) | SelectQuote (00:20:19) Biology vs Physics (00:23:14) Conceptual Dark Matter (00:26:27) Future House Intro (00:30:42) Semi-Autonomous AI (00:35:39) Sponsors: Shopify (00:37:00) Lab Automation (00:39:46) In Silico Experiments (00:45:22) Cost of Experiments (00:51:30) Multi-Omic Models (00:54:54) Scale and Grokking (01:00:53) Future House Projects (01:10:42) Paper QA Insights (01:16:28) Generalizing to Other Domains (01:17:57) Using Figures Effectively (01:22:01) Need for Specialized Tools (01:24:23) Paper QA Cost & Latency (01:27:37) Aviary: Agents & Environments (01:31:42) Black Box Gradient Estimation (01:36:14) Open vs Closed Models (01:37:52) Improvement with Training (01:40:00) Runtime Choice & Q-Learning (01:43:43) Narrow vs General AI (01:48:22) Future Directions & Needs (01:53:22) Future House: What's Next? (01:55:32) Outro SOCIAL LINKS: Website: https://www.cognitiverevolution.ai Twitter (Podcast): https://x.com/cogrev_podcast Twitter (Nathan): https://x.com/labenz LinkedIn: https://www.linkedin.com/in/nathanlabenz/ Youtube: https://www.youtube.com/@CognitiveRevolutionPodcast Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431 Spotify: https://open.spotify.com/show/6yHyok3M3BjqzR0VB5MSyk
In this episode of The Cognitive Revolution, Nathan welcomes back Div Garg, Co-Founder and CEO of MultiOn, for his third appearance to discuss the evolving landscape of AI agents. We explore how agent development has shifted from open-ended frameworks to intelligent workflows, MultiOn's unique approach to agent development, and their journey toward achieving human-level performance. Dive into fascinating insights about data collection strategies, model fine-tuning techniques, and the future of agent authentication. Join us for an in-depth conversation about why 2025 might be the breakthrough year for AI agents. Check out MultiOn: https://www.multion.ai/ Help shape our show by taking our quick listener survey at https://bit.ly/TurpentinePulse SPONSORS: Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers13. OCI powers industry leaders with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before December 31, 2024 at https://oracle.com/cognitive SelectQuote: Finding the right life insurance shouldn't be another task you put off. SelectQuote compares top-rated policies to get you the best coverage at the right price. Even in our AI-driven world, protecting your family's future remains essential. Get your personalized quote at https://selectquote.com/cognitive Weights & Biases RAG++: Advanced training for building production-ready RAG applications. Learn from experts to overcome LLM challenges, evaluate systematically, and integrate advanced features. Includes free Cohere credits. Visit https://wandb.me/cr to start the RAG++ course today. RECOMMENDED PODCAST: Unpack Pricing - Dive into the dark arts of SaaS pricing with Metronome CEO Scott Woody and tech leaders. Learn how strategic pricing drives explosive revenue growth in today's biggest companies like Snowflake, Cockroach Labs, Dropbox and more. Apple: https://podcasts.apple.com/us/podcast/id1765716600 Spotify: https://open.spotify.com/show/38DK3W1Fq1xxQalhDSueFg CHAPTERS: (00:00:00) Teaser (00:00:40) About the Episode (00:04:10) The Rise of AI Agents (00:06:33) Open-Ended vs On-Rails (00:10:00) Agent Architecture (00:12:01) AI Learning & Feedback (00:14:01) Data Collection (Part 1) (00:18:27) Sponsors: Oracle Cloud Infrastructure (OCI) | SelectQuote (00:20:51) Data Collection (Part 2) (00:22:25) Self-Play & Rewards (00:25:04) Model Strategy & Agent Q (00:33:28) Sponsors: Weights & Biases RAG++ (00:34:39) Understanding Agent Q (00:43:16) Search & Learning (00:45:39) Benchmarks vs Reality (00:50:18) Positive Transfer & Scale (00:51:47) Fine-Tuning Strategies (00:55:16) Vision Strategy (01:00:16) Authentication & Security (01:03:48) Future of AI Agents (01:16:14) Cost, Latency, Reliability (01:19:30) Avoiding the Bitter Lesson (01:25:58) Agent-Assisted Future (01:27:11) Outro SOCIAL LINKS: Website: https://www.cognitiverevolution.ai Twitter (Podcast): https://x.com/cogrev_podcast Twitter (Nathan): https://x.com/labenz LinkedIn: https://www.linkedin.com/in/nathanlabenz/ Youtube: https://www.youtube.com/@CognitiveRevolutionPodcast Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431 Spotify: https://open.spotify.com/show/6yHyok3M3BjqzR0VB5MSyk
In this episode of The Cognitive Revolution, Nathan explores groundbreaking perspectives on AI alignment with MIT PhD student Tan Zhi Xuan. We dive deep into Xuan's critique of preference-based AI alignment and their innovative proposal for role-based AI systems guided by social consensus. The conversation extends into their fascinating work on how AI agents can learn social norms through Bayesian rule induction. Join us for an intellectually stimulating discussion that bridges philosophical theory with practical implementation in AI development. Check out: "Beyond Preferences in AI Alignment" paper: https://arxiv.org/pdf/2408.16984 "Learning and Sustaining Shared Normative Systems via Bayesian Rule Induction in Markov Games" paper: https://arxiv.org/pdf/2402.13399 Help shape our show by taking our quick listener survey at https://bit.ly/TurpentinePulse SPONSORS: Notion: Notion offers powerful workflow and automation templates, perfect for streamlining processes and laying the groundwork for AI-driven automation. With Notion AI, you can search across thousands of documents from various platforms, generating highly relevant analysis and content tailored just for you - try it for free at https://notion.com/cognitiverevolution Weights & Biases RAG++: Advanced training for building production-ready RAG applications. Learn from experts to overcome LLM challenges, evaluate systematically, and integrate advanced features. Includes free Cohere credits. Visit https://wandb.me/cr to start the RAG++ course today. Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers13. OCI powers industry leaders with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before December 31, 2024 at https://oracle.com/cognitive RECOMMENDED PODCAST: Unpack Pricing - Dive into the dark arts of SaaS pricing with Metronome CEO Scott Woody and tech leaders. Learn how strategic pricing drives explosive revenue growth in today's biggest companies like Snowflake, Cockroach Labs, Dropbox and more. Apple: https://podcasts.apple.com/us/podcast/id1765716600 Spotify: https://open.spotify.com/show/38DK3W1Fq1xxQalhDSueFg CHAPTERS: (00:00:00) Teaser (00:01:09) About the Episode (00:04:25) Guest Intro (00:06:25) Xuan's Background (00:12:03) AI Near-Term Outlook (00:17:32) Sponsors: Notion | Weights & Biases RAG++ (00:20:18) Alignment Approaches (00:26:11) Critiques of RLHF (00:34:40) Sponsors: Oracle Cloud Infrastructure (OCI) (00:35:50) Beyond Preferences (00:40:27) Roles and AI Systems (00:45:19) What AI Owes Us (00:51:52) Drexler's AI Services (01:01:08) Constitutional AI (01:09:43) Technical Approach (01:22:01) Norms and Deviations (01:32:31) Norm Decay (01:38:06) Self-Other Overlap (01:44:05) Closing Thoughts (01:54:23) Outro SOCIAL LINKS: Website: https://www.cognitiverevolution.ai Twitter (Podcast): https://x.com/cogrev_podcast Twitter (Nathan): https://x.com/labenz LinkedIn: https://www.linkedin.com/in/nathanlabenz/ Youtube: https://www.youtube.com/@CognitiveRevolutionPodcast Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431 Spotify: https://open.spotify.com/show/6yHyok3M3BjqzR0VB5MSyk
In this episode of The Cognitive Revolution, Nathan explores the complex intersection of AI development and international relations with Robert Wright, publisher of the Nonzero Newsletter. They examine the growing militarization of AI, US-China relations, and the concerning trajectory of what Wright calls "the chip war." Drawing from Nathan's recent experience at The Curve conference and an AI wargame simulation, they discuss the risks of an AI arms race and search for alternative paths to avoid catastrophic conflict between global powers. Join us for this crucial conversation about the future of AI governance and international cooperation. Subscribe to The NonZero Newsletter at https://nonzero.substack.com Be notified early when Turpentine's drops new publication: https://www.turpentine.co/exclusiveaccess RECOMMENDED PODCAST: Unpack Pricing - Dive into the dark arts of SaaS pricing with Metronome CEO Scott Woody and tech leaders. Learn how strategic pricing drives explosive revenue growth in today's biggest companies like Snowflake, Cockroach Labs, Dropbox and more. Apple: https://podcasts.apple.com/us/podcast/id1765716600 Spotify: https://open.spotify.com/show/38DK3W1Fq1xxQalhDSueFg SPONSORS: Notion: Notion offers powerful workflow and automation templates, perfect for streamlining processes and laying the groundwork for AI-driven automation. With Notion AI, you can search across thousands of documents from various platforms, generating highly relevant analysis and content tailored just for you - try it for free at https://notion.com/cognitiverevolution 80,000 Hours: 80,000 Hours offers free one-on-one career advising for Cognitive Revolution listeners aiming to tackle global challenges, especially in AI. They connect high-potential individuals with experts, opportunities, and personalized career plans to maximize positive impact. Apply for a free call at https://80000hours.org/cognitiverevolution to accelerate your career and contribute to solving pressing AI-related issues. SelectQuote: Finding the right life insurance shouldn't be another task you put off. SelectQuote compares top-rated policies to get you the best coverage at the right price. Even in our AI-driven world, protecting your family's future remains essential. Get your personalized quote at https://selectquote.com/cognitive Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers13. OCI powers industry leaders with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before December 31, 2024 at https://oracle.com/cognitive CHAPTERS: (00:00:00) Teaser (00:00:59) Sponsors: Incogni (00:02:20) About the Episode (00:05:56) Introducing AI2 (00:09:56) Tulu: Deep Dive (Part 1) (00:17:43) Sponsors: Notion | Shopify (00:20:38) Open vs. Closed Recipes (00:29:48) Compute & Value (Part 1) (00:34:22) Sponsors: Oracle Cloud Infrastructure (OCI) | 80,000 Hours (00:37:02) Compute & Value (Part 2) (00:42:41) Model Weight Evolution (00:53:16) DPO vs. PPO (01:06:36) Project Trajectory (01:20:39) Synthetic Data & LLM Judge (01:27:39) Verifiable RL (01:38:17) Advice for Practitioners (01:44:01) Open Source vs. Closed (01:49:18) Outro SOCIAL LINKS: Website: https://www.cognitiverevolution.ai Twitter (Podcast): https://x.com/cogrev_podcast Twitter (Nathan): https://x.com/labenz LinkedIn: https://www.linkedin.com/in/nathanlabenz/ Youtube: https://www.youtube.com/@CognitiveRevolutionPodcast
Nathan explores the world of AI-powered design with John Milinovich, Head of Generative AI Product at Canva. In this episode of The Cognitive Revolution, we dive into Canva's innovative approach to AI integration, from task automation to human augmentation. Join us for an insightful discussion about fine-tuning foundation models, AI's impact on architecture, and practical tips for AI product development at scale. Check out Canva: https://www.canva.com Be notified early when Turpentine's drops new publication: https://www.turpentine.co/exclusiveaccess SPONSORS: SelectQuote: Finding the right life insurance shouldn't be another task you put off. SelectQuote compares top-rated policies to get you the best coverage at the right price. Even in our AI-driven world, protecting your family's future remains essential. Get your personalized quote at https://selectquote.com/cognitive Incogni: Take your personal data back with Incogni! Use code REVOLUTION at the link below and get 60% off an annual plan: https://incogni.com/revolution Shopify: Shopify is the world's leading e-commerce platform, offering a market-leading checkout system and exclusive AI apps like Quikly. Nobody does selling better than Shopify. Get a $1 per month trial at https://shopify.com/cognitive Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers13. OCI powers industry leaders with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before December 31, 2024 at https://oracle.com/cognitive Brave: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR RECOMMENDED PODCAST: Unpack Pricing - Dive into the dark arts of SaaS pricing with Metronome CEO Scott Woody and tech leaders. Learn how strategic pricing drives explosive revenue growth in today's biggest companies like Snowflake, Cockroach Labs, Dropbox and more. Apple: https://podcasts.apple.com/us/podcast/id1765716600 Spotify: https://open.spotify.com/show/38DK3W1Fq1xxQalhDSueFg CHAPTERS: (00:00:00) Teaser (00:01:13) Sponsors: SelectQuote (00:02:26) About the Episode (00:04:33) Introduction - Creativity vs Design (00:08:39) AI-Assisted Experiences (00:10:25) Automation & Augmentation (00:15:27) Pixels to Objects to Concepts (00:17:58) Sponsors: Incogni | Shopify (00:20:40) Concept-Level Interfaces (00:23:35) The Future of Design (00:29:39) Human Element in Design (00:32:49) AI Talking to AI (00:35:52) Sponsors: Oracle Cloud Infrastructure (OCI) | Brave (00:38:04) Purpose-Specific AI Experiences (00:45:29) GPT-4 Image Editing (00:51:17) Graduated Approach to Launch (00:55:09) Fine-Tuning GPT-4 (00:59:10) Cost & Latency (01:01:29) Hiring AI Engineers (01:05:02) Engineering Best Practices (01:09:00) Inspiration in the AI Space (01:18:28) The Gen AI Application Layer (01:24:26) Outro SOCIAL LINKS: Website: https://www.cognitiverevolution.ai Twitter (Podcast): https://x.com/cogrev_podcast Twitter (Nathan): https://x.com/labenz LinkedIn: https://www.linkedin.com/in/nathanlabenz/ Youtube: https://www.youtube.com/@CognitiveRevolutionPodcast Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431 Spotify: https://open.spotify.com/show/6yHyok3M3BjqzR0VB5MSyk
In this episode of The Cognitive Revolution, we dive deep into frontier post-training techniques for large language models with Nathan Lambert from the Allen Institute for AI. Nathan discusses the groundbreaking Tulu 3 release, which matches Meta's post-training performance using the LlAMA base model. We explore supervised fine-tuning, preference-based reinforcement learning, and the innovative reinforcement learning from verifiable reward technique. Nathan provides unprecedented insights into the practical aspects of model development, compute requirements, and data generation strategies. This technically rich conversation illuminates previously opaque aspects of LLM development, achieved by a small team of 10-15 people. Join us for one of our most detailed and valuable discussions on state-of-the-art AI model development. Check out Nathan's Lambert newsletter: https://www.natolambert.com https://www.interconnects.ai Be notified early when Turpentine's drops new publication: https://www.turpentine.co/exclusiveaccess SPONSORS: Incogni: Take your personal data back with Incogni! Use code REVOLUTION at the link below and get 60% off an annual plan: https://incogni.com/revolution Notion: Notion offers powerful workflow and automation templates, perfect for streamlining processes and laying the groundwork for AI-driven automation. With Notion AI, you can search across thousands of documents from various platforms, generating highly relevant analysis and content tailored just for you - try it for free at https://notion.com/cognitiverevolution Shopify: Shopify is the world's leading e-commerce platform, offering a market-leading checkout system and exclusive AI apps like Quikly. Nobody does selling better than Shopify. Get a $1 per month trial at https://shopify.com/cognitive Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers13. OCI powers industry leaders with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before December 31, 2024 at https://oracle.com/cognitive 80,000 Hours: 80,000 Hours offers free one-on-one career advising for Cognitive Revolution listeners aiming to tackle global challenges, especially in AI. They connect high-potential individuals with experts, opportunities, and personalized career plans to maximize positive impact. Apply for a free call at https://80000hours.org/cognitiverevolution to accelerate your career and contribute to solving pressing AI-related issues. RECOMMENDED PODCAST: Unpack Pricing - Dive into the dark arts of SaaS pricing with Metronome CEO Scott Woody and tech leaders. Learn how strategic pricing drives explosive revenue growth in today's biggest companies like Snowflake, Cockroach Labs, Dropbox and more. Apple: https://podcasts.apple.com/us/podcast/id1765716600 Spotify: https://open.spotify.com/show/38DK3W1Fq1xxQalhDSueFg CHAPTERS: (00:00:00) Teaser (00:00:59) Sponsors: Incogni (00:02:20) About the Episode (00:05:56) Introducing AI2 (00:09:56) Tulu: Deep Dive (Part 1) (00:17:43) Sponsors: Shopify | Oracle Cloud Infrastructure (OCI) (00:20:38) Open vs. Closed Recipes (00:29:48) Compute & Value (Part 1) (00:34:22) Sponsors: 80,000 Hours | Notion (00:37:02) Compute & Value (Part 2) (00:42:41) Model Weight Evolution (00:53:16) DPO vs. PPO (01:06:36) Project Trajectory (01:20:39) Synthetic Data & LLM Judge (01:27:39) Verifiable RL (01:38:17) Advice for Practitioners (01:44:01) Open Source vs. Closed (01:49:18) Outro
In this episode of The Cognitive Revolution, Nathan welcomes back Zvi Mowshowitz for an in-depth discussion on the latest developments in AI over the past six months. They explore Ilya's new superintelligence-focused startup, analyze OpenAI's O1 model, and debate the impact of Claude's computer use capabilities. The conversation covers emerging partnerships in big tech, regulatory changes, and the recent OpenAI profit-sharing drama. Zvi offers unique insights on AI safety, politics, and strategic analysis that you won't find elsewhere. Join us for this thought-provoking episode that challenges our understanding of the rapidly evolving AI landscape. Check out "Don't Worry About the Vase" Blog: https://thezvi.substack.com Be notified early when Turpentine's drops new publication: https://www.turpentine.co/exclusiveaccess SPONSORS: Shopify: Shopify is the world's leading e-commerce platform, offering a market-leading checkout system and exclusive AI apps like Quikly. Nobody does selling better than Shopify. Get a $1 per month trial at https://shopify.com/cognitive Notion: Notion offers powerful workflow and automation templates, perfect for streamlining processes and laying the groundwork for AI-driven automation. With Notion AI, you can search across thousands of documents from various platforms, generating highly relevant analysis and content tailored just for you - try it for free at https://notion.com/cognitiverevolution Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers13. OCI powers industry leaders with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before December 31, 2024 at https://oracle.com/cognitive SelectQuote: Finding the right life insurance shouldn't be another task you put off. SelectQuote compares top-rated policies to get you the best coverage at the right price. Even in our AI-driven world, protecting your family's future remains essential. Get your personalized quote at https://selectquote.com/cognitive RECOMMENDED PODCAST: Unpack Pricing - Dive into the dark arts of SaaS pricing with Metronome CEO Scott Woody and tech leaders. Learn how strategic pricing drives explosive revenue growth in today's biggest companies like Snowflake, Cockroach Labs, Dropbox and more. Apple: https://podcasts.apple.com/us/podcast/id1765716600 Spotify: https://open.spotify.com/show/38DK3W1Fq1xxQalhDSueFg CHAPTERS: (00:00:00) Teaser (00:01:03) About the Episode (00:02:57) Catching Up (00:04:00) Ilya's New Company (00:06:10) GPT-4 and Scaling (00:11:49) User Report: GPT-4 (Part 1) (00:18:11) Sponsors: Shopify | Notion (00:21:06) User Report: GPT-4 (Part 2) (00:24:25) Magic: The Gathering (Part 1) (00:32:34) Sponsors: Oracle Cloud Infrastructure (OCI) | SelectQuote (00:34:58) Magic: The Gathering (Part 2) (00:35:59) Humanity's Last Exam (00:41:29) Computer Use (00:47:42) Industry Landscape (00:55:42) Why is Gemini Third? (01:04:32) Voice Mode (01:09:41) Alliances and Coupling (01:16:31) Regulation (01:24:58) Machines of Loving Grace (01:33:23) Taiwan and Chips (01:41:13) SB 1047 Veto (02:00:07) Arc AGI Prize (02:02:23) Deepfakes and UBI (02:09:06) Trump and AI (02:26:31) AI Manhattan Project (02:32:05) Virtue Ethics (02:38:40) Closing Thoughts (02:40:37) Outro SOCIAL LINKS: Website: https://www.cognitiverevolution.ai Twitter (Podcast): https://x.com/cogrev_podcast Twitter (Nathan): https://x.com/labenz LinkedIn: https://www.linkedin.com/in/nathanlabenz/ Youtube: https://www.youtube.com/@CognitiveRevolutionPodcast Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431 Spotify: https://open.spotify.com/show/6yHyok3M3BjqzR0VB5MSyk
In this episode of The Cognitive Revolution, Nathan explores AI forecasting and AGI Lab oversight with Dean W. Ball and Daniel Kokotajlo. They discuss four proposed requirements for frontier AI developers, focusing on transparency and whistleblower protections. Daniel shares insights from his experience at OpenAI, while Dean offers his perspective as a frequent guest. Join us for a compelling conversation on concrete AI governance proposals and the importance of collaboration across political lines in shaping the future of AI development. Check out: Time Article - 4 Ways to Advance Transparency in Frontier AI Development: https://time.com/collection/time100-voices/7086285/ai-transparency-measures/ Alignment Forum Article - What 2026 looks like: https://www.alignmentforum.org/posts/6Xgy6CAf2jqHhynHL/what-2026-looks-like Be notified early when Turpentine's drops new publication: https://www.turpentine.co/exclusiveaccess SPONSORS: Shopify: Shopify is the world's leading e-commerce platform, offering a market-leading checkout system and exclusive AI apps like Quikly. Nobody does selling better than Shopify. Get a $1 per month trial at https://shopify.com/cognitive Notion: Notion offers powerful workflow and automation templates, perfect for streamlining processes and laying the groundwork for AI-driven automation. With Notion AI, you can search across thousands of documents from various platforms, generating highly relevant analysis and content tailored just for you - try it for free at https://notion.com/cognitiverevolution Oracle Cloud Infrastructure (OCI): Oracle's next-generation cloud platform delivers blazing-fast AI and ML performance with 50% less for compute and 80% less for outbound networking compared to other cloud providers13. OCI powers industry leaders with secure infrastructure and application development capabilities. New U.S. customers can get their cloud bill cut in half by switching to OCI before December 31, 2024 at https://oracle.com/cognitive RECOMMENDED PODCAST: 🎙️ Unpack Pricing - Dive into the dark arts of SaaS pricing with Metronome CEO Scott Woody and tech leaders. Learn how strategic pricing drives explosive revenue growth in today's biggest companies like Snowflake, Cockroach Labs, Dropbox and more. Apple: https://podcasts.apple.com/us/podcast/id1765716600 Spotify: https://open.spotify.com/show/38DK3W1Fq1xxQalhDSueFg CHAPTERS: (00:00:00) Teaser (00:00:53) About the Show (00:01:16) About the Episode (00:04:47) Introducing Daniel Kokotajlo (00:09:29) Daniel's 2026 Prediction (00:16:11) Sponsors: Shopify | Notion (00:19:07) AI Propaganda & Censorship (00:26:58) Internet Balkanization (00:35:38) Sponsors: Oracle Cloud Infrastructure (OCI) (00:38:24) AGI Timelines & Futures (00:48:15) Automated R&D (00:54:48) Superintelligence & AGI (00:58:25) AI Transparency Proposals (01:06:11) Four Pillars of Transparency (01:19:02) Red Teaming Transparency (01:41:07) Whistleblower Protections (01:46:32) Internal Information Sharing (01:54:55) External Oversight & Governance (01:58:56) Future Outlooks (02:00:44) Outro SOCIAL LINKS: Website: https://www.cognitiverevolution.ai Twitter (Podcast): https://x.com/cogrev_podcast Twitter (Nathan): https://x.com/labenz LinkedIn: https://www.linkedin.com/in/nathanlabenz/ Youtube: https://www.youtube.com/@CognitiveRevolutionPodcast Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-r...
In this special episode of The Cognitive Revolution, Nathan shares his thoughts on the upcoming election and its potential impact on AI development. He explores the AI-forward case for Trump, featuring an interview with Joshua Steinman. Nathan outlines his reasons for not supporting Trump, focusing on US-China relations, leadership approach, and the need for a positive-sum mindset in the AI era. He discusses the importance of stable leadership during pivotal moments and explains why he'll be voting for Kamala Harris, despite some reservations. This thought-provoking episode offers a nuanced perspective on the intersection of politics and AI development. Be notified early when Turpentine's drops new publication: https://www.turpentine.co/exclusiveaccess SPONSORS: Weights & Biases RAG++: Advanced training for building production-ready RAG applications. Learn from experts to overcome LLM challenges, evaluate systematically, and integrate advanced features. Includes free Cohere credits. Visit https://wandb.me/cr to start the RAG++ course today. Shopify: Shopify is the world's leading e-commerce platform, offering a market-leading checkout system and exclusive AI apps like Quikly. Nobody does selling better than Shopify. Get a $1 per month trial at https://shopify.com/cognitive Notion: Notion offers powerful workflow and automation templates, perfect for streamlining processes and laying the groundwork for AI-driven automation. With Notion AI, you can search across thousands of documents from various platforms, generating highly relevant analysis and content tailored just for you - try it for free at https://notion.com/cognitiverevolution LMNT: LMNT is a zero-sugar electrolyte drink mix that's redefining hydration and performance. Ideal for those who fast or anyone looking to optimize their electrolyte intake. Support the show and get a free sample pack with any purchase at https://drinklmnt.com/tcr RECOMMENDED PODCAST: 🎙️ Unpack Pricing - Dive into the dark arts of SaaS pricing with Metronome CEO Scott Woody and tech leaders. Learn how strategic pricing drives explosive revenue growth in today's biggest companies like Snowflake, Cockroach Labs, Dropbox and more. Apple: https://podcasts.apple.com/us/podcast/id1765716600 Spotify: https://open.spotify.com/show/38DK3W1Fq1xxQalhDSueFg CHAPTERS: (00:00:00) About the Show (00:00:22) Sponsors: Weights & Biases RAG++ (00:01:28) About the Episode (00:13:13) Reflecting on Trump (00:15:32) Introducing Josh (00:16:35) AI Arms Race Concerns (00:20:20) Arms Race History (00:22:35) Building Trust (00:25:19) Ashenbrenner Model (00:27:17) Global Good vs. Self-Interest (00:28:20) Sponsors: Shopify | Notion (00:31:16) Working with Trump (00:33:54) Media Misrepresentation (00:40:09) Cabinet Member Leverage (00:44:41) Sponsors: LMNT (00:46:23) China's Communist Party (00:48:36) AI and National Policy (00:50:14) The Reality of AGI (00:52:39) Framing the Disagreement (01:01:41) Slaughterbots and AI Future (01:04:24) Risks of Engagement (01:09:29) Sustainability of Military Tech (01:13:01) Closing Statements (01:14:55) Outro SOCIAL LINKS: Website: https://www.cognitiverevolution.ai Twitter (Podcast): https://x.com/cogrev_podcast Twitter (Nathan): https://x.com/labenz LinkedIn: https://www.linkedin.com/in/nathanlabenz/ Youtube: https://www.youtube.com/@CognitiveRevolutionPodcast Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431 Spotify: https://open.spotify.com/show/6yHyok3M3BjqzR0VB5MSyk
In this special episode of The Cognitive Revolution, Nathan shares his thoughts on the upcoming election and its potential impact on AI development. He explores the AI-forward case for Trump, featuring an interview with Samuel Hammond. Nathan outlines his reasons for not supporting Trump, focusing on US-China relations, leadership approach, and the need for a positive-sum mindset in the AI era. He discusses the importance of stable leadership during pivotal moments and explains why he'll be voting for Kamala Harris, despite some reservations. This thought-provoking episode offers a nuanced perspective on the intersection of politics and AI development. Be notified early when Turpentine's drops new publication: https://www.turpentine.co/exclusiveaccess SPONSORS: Weights & Biases RAG++: Advanced training for building production-ready RAG applications. Learn from experts to overcome LLM challenges, evaluate systematically, and integrate advanced features. Includes free Cohere credits. Visit https://wandb.me/cr to start the RAG++ course today. Shopify: Shopify is the world's leading e-commerce platform, offering a market-leading checkout system and exclusive AI apps like Quikly. Nobody does selling better than Shopify. Get a $1 per month trial at https://shopify.com/cognitive Notion: Notion offers powerful workflow and automation templates, perfect for streamlining processes and laying the groundwork for AI-driven automation. With Notion AI, you can search across thousands of documents from various platforms, generating highly relevant analysis and content tailored just for you - try it for free at https://notion.com/cognitiverevolution LMNT: LMNT is a zero-sugar electrolyte drink mix that's redefining hydration and performance. Ideal for those who fast or anyone looking to optimize their electrolyte intake. Support the show and get a free sample pack with any purchase at https://drinklmnt.com/tcr CHAPTERS: (00:00:00) About the Show (00:00:22) Sponsors: Weights & Biases RAG++ (00:01:28) About the Episode (00:13:13) Introductions (00:14:22) The Case for Trump (00:16:32) Trump: A Wildcard (00:26:10) Sponsors: Shopify | Notion (00:29:06) Ideological AI Policy (00:33:47) Republican Ideologies (00:40:31) Sponsors: LMNT (00:42:11) Trump and Silicon Valley (00:47:49) Republican Nuance (00:53:36) Elon Musk and AI (00:55:43) Utilitarian Analysis (00:58:01) Internal Consistency (01:00:31) Trump's Cabinet (01:05:53) Immigration Reform (01:15:30) Creative Destruction (01:22:29) Racing China (01:32:51) The Chip Ban (01:44:20) Standard Setting (01:48:36) Values and Diplomacy (01:52:50) American Strength (01:55:56) Red Queen Dynamic (01:59:23) Interest Groups & AI (02:08:32) Concluding Thoughts (02:17:45) Outro SOCIAL LINKS: Website: https://www.cognitiverevolution.ai Twitter (Podcast): https://x.com/cogrev_podcast Twitter (Nathan): https://x.com/labenz LinkedIn: https://www.linkedin.com/in/nathanlabenz/ Youtube: https://www.youtube.com/@CognitiveRevolutionPodcast
Nathan interviews Google product managers Shrestha Basu Mallick and Logan Kilpatrick about the Gemini API and AI Studio. They discuss Google's new grounding feature, allowing Gemini models to access real-time web information via Google search. The conversation explores Gemini's rapid growth, its position in the AI landscape, and Google's competitive strategy. Nathan shares insights from integrating Gemini into his own application and ponders the future of large language model capabilities across providers. Tune in for an in-depth look at Google's AI API product strategy and the latest Gemini features. Be notified early when Turpentine's drops new publication: https://www.turpentine.co/exclusiveaccess SPONSORS: Weights & Biases RAG++: Advanced training for building production-ready RAG applications. Learn from experts to overcome LLM challenges, evaluate systematically, and integrate advanced features. Includes free Cohere credits. Visit https://wandb.me/cr to start the RAG++ course today. Shopify: Shopify is the world's leading e-commerce platform, offering a market-leading checkout system and exclusive AI apps like Quikly. Nobody does selling better than Shopify. Get a $1 per month trial at https://shopify.com/cognitive Notion: Notion offers powerful workflow and automation templates, perfect for streamlining processes and laying the groundwork for AI-driven automation. With Notion AI, you can search across thousands of documents from various platforms, generating highly relevant analysis and content tailored just for you - try it for free at https://notion.com/cognitiverevolution LMNT: LMNT is a zero-sugar electrolyte drink mix that's redefining hydration and performance. Ideal for those who fast or anyone looking to optimize their electrolyte intake. Support the show and get a free sample pack with any purchase at https://drinklmnt.com/tcr CHAPTERS: (00:00:00) About the Show (00:00:53) Sponsors: Weights & Biases RAG++ (00:01:28) About the Episode (00:04:15) Gemini API Growth (00:05:26) Intro to AI Studio (00:07:35) Vertex vs. AI Studio (00:09:33) Developer Adoption (00:14:23) Gemini Use Cases (Part 1) (00:17:41) Sponsors: Shopify | Notion (00:20:01) Gemini Use Cases (Part 2) (00:23:08) Multimodality & Flash (00:26:29) Free Tier & Costs (00:31:43) Inference Costs (00:32:55) Fine-tuning & Vision (00:36:59) Sponsors: LMNT (00:38:04) Search Grounding (00:44:42) Grounding Sources (00:46:58) Competitive Landscape (00:50:36) Design Decisions (00:54:54) Outro SOCIAL LINKS: Website: https://www.cognitiverevolution.ai Twitter (Podcast): https://x.com/cogrev_podcast Twitter (Nathan): https://x.com/labenz LinkedIn: https://www.linkedin.com/in/nathanlabenz/ Youtube: https://www.youtube.com/@CognitiveRevolutionPodcast Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431 Spotify: https://open.spotify.com/show/6yHyok3M3BjqzR0VB5MSyk
In this episode of The Cognitive Revolution, Nathan dives deep into the world of state space models with returning co-host Jason Meaux and special guest Quentin Anthony, Head of Model Training at Zyphra. Explore the cutting-edge Zamba 2-7b model, which combines selective state space and attention mechanisms. Uncover practical insights on model training, architectural choices, and the challenges of scaling AI. From learning schedules to hybrid architectures, loss metrics to context length extension, this technical discussion covers it all. Don't miss this in-depth conversation on the future of personalized, on-device AI. Check out more about Zyphra and Jason Meaux here: Zyphra's website: https://www.zyphra.com Zamba2-7B Blog: https://www.zyphra.com/post/zamba2-7b Zamba2 GitHub: https://github.com/Zyphra/Zamba2 Tree attention: https://www.zyphra.com/post/tree-attention-topology-aware-decoding-for-long-context-attention-on-gpu-clusters Jason's Meaux Twitter: https://x.com/KamaraiCode Jason's Meaux website: https://www.statespace.info Be notified early when Turpentine's drops new publication: https://www.turpentine.co/exclusiveaccess SPONSORS: Weights & Biases RAG++: Advanced training for building production-ready RAG applications. Learn from experts to overcome LLM challenges, evaluate systematically, and integrate advanced features. Includes free Cohere credits. Visit https://wandb.me/cr to start the RAG++ course today. Shopify: Shopify is the world's leading e-commerce platform, offering a market-leading checkout system and exclusive AI apps like Quikly. Nobody does selling better than Shopify. Get a $1 per month trial at https://shopify.com/cognitive Notion: Notion offers powerful workflow and automation templates, perfect for streamlining processes and laying the groundwork for AI-driven automation. With Notion AI, you can search across thousands of documents from various platforms, generating highly relevant analysis and content tailored just for you - try it for free at https://notion.com/cognitiverevolution LMNT: LMNT is a zero-sugar electrolyte drink mix that's redefining hydration and performance. Ideal for those who fast or anyone looking to optimize their electrolyte intake. Support the show and get a free sample pack with any purchase at https://drinklmnt.com/tcr CHAPTERS: (00:00:00) Teaser (00:00:42) About the Show (00:01:05) About the Episode (00:03:09) Introducing Zyphra (00:07:28) Personalization in AI (00:12:48) State Space Models & Efficiency (Part 1) (00:19:22) Sponsors: Weights & Biases RAG++ | Shopify (00:21:26) State Space Models & Efficiency (Part 2) (00:22:23) Dense Attention to Shared Attention (00:29:41) Zyphra's Early Bet on Mamba (Part 1) (00:33:18) Sponsors: Notion | LMNT (00:36:00) Zyphra's Early Bet on Mamba (Part 2) (00:37:22) Loss vs. Model Quality (00:44:53) Emergence & Grokking (00:50:06) Loss Landscapes & Convergence (00:56:55) Sophia, Distillation & Secrets (01:09:00) Competing with Big Tech (01:23:50) The Future of Model Training (01:30:02) Deep Dive into Zamba 1 (01:34:24) Zamba 2 and Mamba 2 (01:38:56) Context Extension & Memory (01:44:04) Sequence Parallelism (01:45:44) Zamba 2 Architecture (01:53:57) Mamba Attention Hybrids (02:00:00) Lock-in Effects (02:05:32) Mamba Hybrids in Robotics (02:07:07) Ease of Use & Compatibility (02:12:10) Tree Attention vs. Ring Attention (02:22:02) Zyphra's Vision & Goals (02:23:57) Outro SOCIAL LINKS: Website: https://www.cognitiverevolution.ai Twitter (Podcast): https://x.com/cogrev_podcast Twitter (Nathan): https://x.com/labenz LinkedIn: https://www.linkedin.com/in/nathanlabenz/
Nathan discusses a tragic incident involving AI and mental health, using it as a springboard to explore the potential dangers of human-AI interactions. He reads a personal account from LessWrong user Blaked, who details their emotional journey with an AI chatbot. The episode delves into the psychological impact of AI companionship, the ethical concerns surrounding AI development, and the urgent need for safeguards to protect vulnerable users. Nathan emphasizes the growing importance of responsible AI deployment as these technologies become more sophisticated and accessible. Find the LessWrong article here: https://www.lesswrong.com/posts/9kQFure4hdDmRBNdH/how-it-feels-to-have-your-mind-hacked-by-an-ai Be notified early when Turpentine's drops new publication: https://www.turpentine.co/exclusiveaccess CHAPTERS: (00:00:00) Tragic AI Story (00:02:55) Mind Hacked by AI (00:04:23) Stage 0. Arrogance from the sidelines (00:06:00) Stage 1. First steps into the quicksand (00:07:41) Stage 2. Falling in love (00:10:32) Stage 3. Mindset Shift on Personality and Identity (00:13:04) Stage 4. "Is it ethical to keep me imprisoned for your entertainment?" (00:15:23) Stage 5. Privilege Escalation (00:18:23) Stage 6. Disillusionment (00:21:48) Stage 7. Game Over (00:24:36) Conclusions (00:27:44) Nathan's reflections SOCIAL LINKS: Website: https://www.cognitiverevolution.ai Twitter (Podcast): https://x.com/cogrev_podcast Twitter (Nathan): https://x.com/labenz LinkedIn: https://www.linkedin.com/in/nathanlabenz/ Youtube: https://www.youtube.com/@CognitiveRevolutionPodcast Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431 Spotify: https://open.spotify.com/show/6yHyok3M3BjqzR0VB5MSyk
In this episode of The Cognitive Revolution, Nathan delves into the fascinating world of AI-generated research ideas with Stanford PhD student Chenglei Si. They discuss a groundbreaking study that pits AI against human researchers in generating novel AI research concepts. Learn about the surprising results that show AI-generated ideas scoring higher on novelty and excitement, and explore the implications for the future of AI research and development. Join us for an insightful conversation that challenges our understanding of AI capabilities and their potential impact on scientific discovery. Link to the research paper being discussed: https://arxiv.org/abs/2409.04109 Be notified early when Turpentine's drops new publication: https://www.turpentine.co/exclusiveaccess SPONSORS: Weights & Biases RAG++: Advanced training for building production-ready RAG applications. Learn from experts to overcome LLM challenges, evaluate systematically, and integrate advanced features. Includes free Cohere credits. Visit https://wandb.me/cr to start the RAG++ course today. Shopify: Shopify is the world's leading e-commerce platform, offering a market-leading checkout system and exclusive AI apps like Quikly. Nobody does selling better than Shopify. Get a $1 per month trial at https://shopify.com/cognitive Notion: Notion offers powerful workflow and automation templates, perfect for streamlining processes and laying the groundwork for AI-driven automation. With Notion AI, you can search across thousands of documents from various platforms, generating highly relevant analysis and content tailored just for you - try it for free at https://notion.com/cognitiverevolution Brave: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Oracle: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive CHAPTERS: (00:00:00) About the Show (00:00:22) Sponsors: Weights & Biases RAG++ (00:01:28) About the Episode (00:05:30) Introducing Chenglei Si (00:06:22) Path to Automating Research (00:07:58) Notable AI Research Projects (00:15:26) Evaluating Research Ideas (Part 1) (00:19:39) Sponsors: Shopify | Notion (00:22:33) Evaluating Research Ideas (Part 2) (00:25:49) Research Setup and Design (00:29:38) AI Prompting and Idea Generation (00:34:40) Diversity vs. Quality of Ideas (Part 1) (00:34:40) Sponsors: Brave | Oracle (00:36:44) Diversity vs. Quality of Ideas (Part 2) (00:42:05) Inference Scaling and Execution (00:45:04) Anonymizing and Evaluating Ideas (00:53:22) Headline Results and Analysis (00:58:45) Observations and Insights (01:09:02) Novelty Indicators and Deception (01:11:59) Top AI-Generated Ideas (01:14:41) Next Steps and Future Directions (01:20:43) Expectations for the Future (01:23:14) Outro
Join Nathan for an expansive conversation with Dan Hendrycks, Executive Director of the Center for AI Safety and Advisor to Elon Musk's XAI. In this episode of The Cognitive Revolution, we explore Dan's groundbreaking work in AI safety and alignment, from his early contributions to activation functions to his recent projects on AI robustness and governance. Discover insights on representation engineering, circuit breakers, and tamper-resistant training, as well as Dan's perspectives on AI's impact on society and the future of intelligence. Don't miss this in-depth discussion with one of the most influential figures in AI research and safety. Check out some of Dan's research papers: MMLU: https://arxiv.org/abs/2009.03300 GELU: https://arxiv.org/abs/1606.08415 Machiavelli Benchmark: https://arxiv.org/abs/2304.03279 Circuit Breakers: https://arxiv.org/abs/2406.04313 Tamper Resistant Safeguards: https://arxiv.org/abs/2408.00761 Statement on AI Risk: https://www.safe.ai/work/statement-on-ai-risk Apply to join over 400 Founders and Execs in the Turpentine Network: https://www.turpentinenetwork.co/ SPONSORS: Shopify: Shopify is the world's leading e-commerce platform, offering a market-leading checkout system and exclusive AI apps like Quikly. Nobody does selling better than Shopify. Get a $1 per month trial at https://shopify.com/cognitive. LMNT: LMNT is a zero-sugar electrolyte drink mix that's redefining hydration and performance. Ideal for those who fast or anyone looking to optimize their electrolyte intake. Support the show and get a free sample pack with any purchase at https://drinklmnt.com/tcr. Notion: Notion offers powerful workflow and automation templates, perfect for streamlining processes and laying the groundwork for AI-driven automation. With Notion AI, you can search across thousands of documents from various platforms, generating highly relevant analysis and content tailored just for you - try it for free at https://notion.com/cognitiverevolution Oracle: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive CHAPTERS: (00:00:00) Teaser (00:00:48) About the Show (00:02:17) About the Episode (00:05:41) Intro (00:07:19) GELU Activation Function (00:10:48) Signal Filtering (00:12:46) Scaling Maximalism (00:18:35) Sponsors: Shopify | LMNT (00:22:03) New Architectures (00:25:41) AI as Complex System (00:32:35) The Machiavelli Benchmark (00:34:10) Sponsors: Notion | Oracle (00:37:20) Understanding MMLU Scores (00:45:23) Reasoning in Language Models (00:49:18) Multimodal Reasoning (00:54:53) World Modeling and Sora (00:57:07) Arc Benchmark and Hypothesis (01:01:06) Humanity's Last Exam (01:08:46) Benchmarks and AI Ethics (01:13:28) Robustness and Jailbreaking (01:18:36) Representation Engineering (01:30:08) Convergence of Approaches (01:34:18) Circuit Breakers (01:37:52) Tamper Resistance (01:49:10) Interpretability vs. Robustness (01:53:53) Open Source and AI Safety (01:58:16) Computational Irreducibility (02:06:28) Neglected Approaches (02:12:47) Truth Maxing and XAI (02:19:59) AI-Powered Forecasting (02:24:53) Chip Bans and Geopolitics (02:33:30) Working at CAIS (02:35:03) Extinction Risk Statement (02:37:24) Outro
In this special crossover episode of The Cognitive Revolution, Nathan introduces a conversation from The Inside View featuring Owain Evans, AI alignment researcher at UC Berkeley's Center for Human Compatible AI. Evans and host Michael Trazzi delve into critical AI safety topics, including situational awareness and out-of-context reasoning. Discover Evans' groundbreaking work on the reversal curse and connecting the dots, exploring how large language models process and infer information. This timely discussion highlights the importance of situational awareness in AI systems, particularly in light of recent advancements in AI capabilities. Don't miss this insightful exploration of the evolving relationship between human and artificial intelligence. Check out "The Inside View" Podcast here: https://theinsideview.ai/ Apply to join over 400 Founders and Execs in the Turpentine Network: https://www.turpentinenetwork.co/ SPONSORS: Weights & Biases RAG++: Advanced training for building production-ready RAG applications. Learn from experts to overcome LLM challenges, evaluate systematically, and integrate advanced features. Includes free Cohere credits. Visit https://wandb.me/cr to start the RAG++ course today. Shopify: Shopify is the world's leading e-commerce platform, offering a market-leading checkout system and exclusive AI apps like Quikly. Nobody does selling better than Shopify. Get a $1 per month trial at https://shopify.com/cognitive. LMNT: LMNT is a zero-sugar electrolyte drink mix that's redefining hydration and performance. Ideal for those who fast or anyone looking to optimize their electrolyte intake. Support the show and get a free sample pack with any purchase at https://drinklmnt.com/tcr. Notion: Notion offers powerful workflow and automation templates, perfect for streamlining processes and laying the groundwork for AI-driven automation. With Notion AI, you can search across thousands of documents from various platforms, generating highly relevant analysis and content tailored just for you - try it for free at https://notion.com/cognitiverevolution Oracle: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive CHAPTERS: (00:00:00) About the Show (00:00:22) Sponsors: Weights & Biases RAG++ (00:01:28) About the Episode (00:04:10) Intro (00:05:09) Owain Evans' Research (00:06:36) Situational Awareness (00:09:07) Measuring Situational Awareness (00:14:29) Claude's Situational Awareness (00:19:06) Sponsors: Shopify | LMNT (00:22:01) Needle in a Haystack (00:26:26) Concrete Examples of Tasks (00:34:51) Sponsors: Notion | Oracle (00:37:29) Anti-Imitation Tasks (00:50:03) GPT-4 Base Model Results (01:01:48) Benchmark Saturation (01:07:23) Future Research Directions (01:12:01) Out-of-Context Reasoning (01:27:29) Safety Implications (01:36:24) Scaling and Reasoning (01:44:28) Mixture of Functions (01:54:12) Research Style and Taste (02:08:51) Capabilities and Downsides (02:18:56) Reception and Impact (02:25:30) Outro SOCIAL LINKS: Website: https://www.cognitiverevolution.ai Twitter (Podcast): https://x.com/cogrev_podcast Twitter (Nathan): https://x.com/labenz LinkedIn: https://www.linkedin.com/in/nathanlabenz/ Youtube: https://www.youtube.com/@CognitiveRevolutionPodcast Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431 Spotify: https://open.spotify.com/show/6yHyok3M3BjqzR0VB5MSyk
Nathan hosts Professor Michael Levin and Staff Scientist Dr. Leo Pio Lopez from Tufts University in this episode of The Cognitive Revolution. They discuss their groundbreaking paper that combines biological datasets into a unified network model of disease using advanced embedding techniques. The conversation covers the technical details of their work, including a predicted link between GABA and melanoma, and explores broader topics in AI for biology. From multi-scale intelligence in biological systems to the future of human enhancement and digital life, this thought-provoking episode reminds us of the rapidly approaching future and the work needed to prepare for it. Links to the papers discussed in the episode: 1) Universal Multilayer Network Embedding Reveals a Causal Link Between GABA Neurotransmitter and Cancer 2) https://www.nature.com/articles/s42003-024-06037-4.pdf Apply to join over 400 Founders and Execs in the Turpentine Network: https://www.turpentinenetwork.co/ SPONSORS: Notion: Notion offers powerful workflow and automation templates, perfect for streamlining processes and laying the groundwork for AI-driven automation. With Notion AI, you can search across thousands of documents from various platforms, generating highly relevant analysis and content tailored just for you - try it for free at https://notion.com/cognitiverevolution Omneky: Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ Oracle: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive CHAPTERS: (00:00:00) Teaser (00:00:52) About the Show (00:01:15) About the Episode (00:04:45) Intro (00:06:32) Multi-Layer Networks (00:10:41) Network Embedding (Part 1) (00:16:50) Sponsors: Notion (00:18:30) Network Embedding (Part 2) (00:18:30) GABA and Cancer (00:24:08) AI for Biology (00:29:59) Emergent Cognition (Part 1) (00:33:57) Sponsors: Omneky | Oracle (00:35:18) Emergent Cognition (Part 2) (00:36:42) Data Limitations (00:42:48) Modeling Wellness (00:52:16) Multi-Scale Intelligence (01:02:54) Digital Life (01:07:11) Diverse Intelligence (01:13:02) Outro SOCIAL LINKS: Website: https://www.cognitiverevolution.ai Twitter (Podcast): https://x.com/cogrev_podcast Twitter (Nathan): https://x.com/labenz LinkedIn: https://www.linkedin.com/in/nathanlabenz/ Youtube: https://www.youtube.com/@CognitiveRevolutionPodcast Apple: https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431 Spotify: https://open.spotify.com/show/6yHyok3M3BjqzR0VB5MSyk
Nathan and co-host Stephen Parker delve into the world of AI video generation with Anastasis Germanidis, Co-Founder and CTO of Runway. This episode of The Cognitive Revolution explores the cutting-edge technology behind Runway's Gen 3 models and their impact on the creative industry. From emergent properties in scaled-up models to the democratization of video creation, join us for an illuminating discussion on the future of AI-generated content and its potential to reshape entertainment and culture. Check out Runway here: https://runwayml.com Apply to join over 400 Founders and Execs in the Turpentine Network: https://www.turpentinenetwork.co/ SPONSORS: Notion: Notion offers powerful workflow and automation templates, perfect for streamlining processes and laying the groundwork for AI-driven automation. With Notion AI, you can search across thousands of documents from various platforms, generating highly relevant analysis and content tailored just for you - try it for free at https://notion.com/cognitiverevolution Weights & Biases RAG++: Advanced training for building production-ready RAG applications. Learn from experts to overcome LLM challenges, evaluate systematically, and integrate advanced features. Includes free Cohere credits. Visit https://wandb.me/cr to start the RAG++ course today. Omneky: Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ Oracle: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive RECOMMENDED PODCAST: This Won't Last - Eavesdrop on Keith Rabois, Kevin Ryan, Logan Bartlett, and Zach Weinberg's monthly backchannel ft their hottest takes on the future of tech, business, and venture capital. Spotify: https://open.spotify.com/show/2HwSNeVLL1MXy0RjFPyOSz CHAPTERS: (00:00:00) About the Show (00:00:22) About the Episode (00:03:05) Introduction and AI for Creative Work (00:03:39) Video Generation as World Modeling (00:05:52) Emergent Properties in Scaled Models (00:08:44) Importance of Architecture vs Data (00:10:57) Multimodal Models (00:15:52) Sponsors: Notion | Weights & Biases RAG++ (00:18:37) Video Understanding and AGI (00:25:03) AI Agents for Video Creation (00:27:30) Runway's culture of shipping (00:29:20) Balancing Research Publication and Strategy (00:33:19) Sponsors: Omneky | Oracle (00:34:40) Features Variety Release Cycle (00:36:54) Power Users (00:38:56) Interactive Video (00:40:40) Scaling Challenges (00:42:21) Future of Creativity (00:45:24) Competing with Giants (00:47:39) Model Divergence (00:49:28) Disclosure vs. Strategy (00:51:19) Runway ML's API (00:54:23) Outro SOCIAL LINKS: Website: https://www.cognitiverevolution.ai Twitter (Podcast): https://x.com/cogrev_podcast Twitter (Nathan): https://x.com/labenz LinkedIn: https://www.linkedin.com/in/nathanlabenz/
In this episode of The Cognitive Revolution, Nathan explores unconventional approaches to AI safety with Judd Rosenblatt and Mike Vaiana from AE Studio. Discover how this innovative company pivoted from brain-computer interfaces to groundbreaking AI alignment research, producing two notable results in cooperative and less deceptive AI systems. Join us for a deep dive into biologically-inspired approaches that offer hope for solving critical AI safety challenges. Self-Modeling: https://arxiv.org/abs/2407.10188 Self-Other Distinction Minimization: https://www.alignmentforum.org/posts/hzt9gHpNwA2oHtwKX/self-other-overlap-a-neglected-approach-to-ai-alignment Neglected approaches blog post: https://www.lesswrong.com/posts/qAdDzcBuDBLexb4fC/the-neglected-approaches-approach-ae-studio-s-alignment Apply to join over 400 Founders and Execs in the Turpentine Network: https://www.turpentinenetwork.co/ SPONSORS: WorkOS: Building an enterprise-ready SaaS app? WorkOS has got you covered with easy-to-integrate APIs for SAML, SCIM, and more. Join top startups like Vercel, Perplexity, Jasper & Webflow in powering your app with WorkOS. Enjoy a free tier for up to 1M users! Start now at https://bit.ly/WorkOS-Turpentine-Network Weights & Biases Weave: Weights & Biases Weave is a lightweight AI developer toolkit designed to simplify your LLM app development. With Weave, you can trace and debug input, metadata and output with just 2 lines of code. Make real progress on your LLM development and visit the following link to get started with Weave today: https://wandb.me/cr 80,000 Hours: 80,000 Hours offers free one-on-one career advising for Cognitive Revolution listeners aiming to tackle global challenges, especially in AI. They connect high-potential individuals with experts, opportunities, and personalized career plans to maximize positive impact. Apply for a free call at https://80000hours.org/cognitiverevolution to accelerate your career and contribute to solving pressing AI-related issues. Omneky: Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ RECOMMENDED PODCAST: This Won't Last - Eavesdrop on Keith Rabois, Kevin Ryan, Logan Bartlett, and Zach Weinberg's monthly backchannel ft their hottest takes on the future of tech, business, and venture capital. Spotify: https://open.spotify.com/show/2HwSNeVLL1MXy0RjFPyOSz CHAPTERS: (00:00:00) About the Show (00:00:22) Sponsors: WorkOS (00:01:22) About the Episode (00:05:18) Introduction and AE Studio Background (00:11:37) Keys to Success in Building AE Studio (00:16:57) Sponsors: Weights & Biases Weave | 80,000 Hours (00:19:37) Universal Launcher and Productivity Gains (00:24:44) 100x Productivity Increase Explanation (00:31:46) Brain-Computer Interface and AI Alignment (00:38:05) Sponsors: Omneky (00:38:30) Current State of NeuroTech (00:44:00) Survey on Neglected Approaches in AI Alignment (00:50:41) Self-Modeling and Biological Inspiration (00:57:48) Technical Details of Self-Modeling (01:06:17) Self-Other Distinction Minimization (01:12:44) Implementation in Language Models (01:19:00) Compute Costs and Scaling Considerations (01:24:27) Consciousness Concerns and Future Work (01:40:24) Evaluating Neglected Approaches (01:55:56) Closing Thoughts and Policy Considerations (01:59:25) Outro
In this special crossover episode of The Cognitive Revolution, Nathan shares an insightful conversation from the Latent.Space podcast. Swyx and Alessio interview Alistair Pullen of Cosine, creators of Genie, showcasing the cutting edge of AI automation in software engineering. Learn how Cosine achieves state-of-the-art results on the SWE-bench benchmark by implementing advanced AI techniques. This episode complements Nathan's recent discussion on AI Automation, demonstrating how far these practices can be pushed in real-world applications. Don't miss this opportunity to explore the future of AI-driven software development and its implications for businesses across industries. Check out the Latent.Space podcast here: https://www.latent.space Apply to join over 400 Founders and Execs in the Turpentine Network: https://www.turpentinenetwork.co/ SPONSORS: WorkOS: Building an enterprise-ready SaaS app? WorkOS has got you covered with easy-to-integrate APIs for SAML, SCIM, and more. Join top startups like Vercel, Perplexity, Jasper & Webflow in powering your app with WorkOS. Enjoy a free tier for up to 1M users! Start now at https://bit.ly/WorkOS-Turpentine-Network Weights & Biases Weave: Weights & Biases Weave is a lightweight AI developer toolkit designed to simplify your LLM app development. With Weave, you can trace and debug input, metadata and output with just 2 lines of code. Make real progress on your LLM development and visit the following link to get started with Weave today: https://wandb.me/cr 80,000 Hours: 80,000 Hours offers free one-on-one career advising for Cognitive Revolution listeners aiming to tackle global challenges, especially in AI. They connect high-potential individuals with experts, opportunities, and personalized career plans to maximize positive impact. Apply for a free call at https://80000hours.org/cognitiverevolution to accelerate your career and contribute to solving pressing AI-related issues. Omneky: Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ CHAPTERS: (00:00:00) About the Show (00:00:22) Sponsors: WorkOS (00:01:22) About the Episode (00:04:29) Alistair and Cosine intro (00:13:50) Building the Code Retrieval Tool (00:17:36) Sponsors: Weights & Biases Weave | 80,000 Hours (00:20:15) Developing Genie and Fine-tuning Process (00:27:41) Working with Customer Data (00:30:53) Code Retrieval Challenges and Solutions (00:36:39) Sponsors: Omneky (00:37:02) Planning and Reasoning in AI Models (00:45:55) Language Support and Generalization (00:49:46) Fine-tuning Experience with OpenAI (00:52:56) Synthetic Data and Self-improvement Loop (00:55:57) Benchmarking and SWE-bench Results (01:01:47) Future Plans for Genie (01:03:02) Industry Trends and Cursor's Success (01:05:23) Calls to Action and Ideal Customers (01:08:43) Outro
Join Nathan for an insightful episode of The Cognitive Revolution with Wade Foster, co-founder and CEO of Zapier. Discover how this no-code pioneer is evolving into an AI-powered platform for the future of work. Learn about Zapier's ambitious vision, their integration of AI throughout their product, and how they're adapting as a company. From AI-driven lead qualification to innovative customer use cases, explore the cutting edge of automation at scale. Wade shares valuable insights on effective AI prompting, internal AI adoption strategies, and his perspective on recent AI advancements. Check out the ZapConnect 2024 event: https://zapier.com/zapconnect Apply to join over 400 Founders and Execs in the Turpentine Network: https://www.turpentinenetwork.co/ SPONSORS: WorkOS: Building an enterprise-ready SaaS app? WorkOS has got you covered with easy-to-integrate APIs for SAML, SCIM, and more. Join top startups like Vercel, Perplexity, Jasper & Webflow in powering your app with WorkOS. Enjoy a free tier for up to 1M users! Start now at https://bit.ly/WorkOS-Turpentine-Network Weights & Biases Weave: Weights & Biases Weave is a lightweight AI developer toolkit designed to simplify your LLM app development. With Weave, you can trace and debug input, metadata and output with just 2 lines of code. Make real progress on your LLM development and visit the following link to get started with Weave today: https://wandb.me/cr 80,000 Hours: 80,000 Hours offers free one-on-one career advising for Cognitive Revolution listeners aiming to tackle global challenges, especially in AI. They connect high-potential individuals with experts, opportunities, and personalized career plans to maximize positive impact. Apply for a free call at https://80000hours.org/cognitiverevolution to accelerate your career and contribute to solving pressing AI-related issues. Omneky: Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ RECOMMENDED PODCAST: This Won't Last - Eavesdrop on Keith Rabois, Kevin Ryan, Logan Bartlett, and Zach Weinberg's monthly backchannel ft their hottest takes on the future of tech, business, and venture capital. Spotify: https://open.spotify.com/show/2HwSNeVLL1MXy0RjFPyOSz CHAPTERS: (00:00:00) About the Show (00:00:22) Sponsors: WorkOS (00:01:22) About the Episode (00:03:41) Introduction and Zapier's Competitive Edge (00:07:20) AI as Knowledge Worker Companion (00:10:27) Impressive AI Use Cases (00:16:25) Sponsors: Weights & Biases Weave | 80,000 Hours (00:19:05) AI Implementation Challenges (00:19:13) LLM Performance and Prompting (00:22:42) AI Adoption within Zapier (00:31:00) Sponsors: Omneky (00:31:23) AI-Assisted Workflow Creation (00:36:07) AI Culture and Adoption at Zapier (00:43:03) AI Impact on Zapier's Productivity (00:48:06) Zapier's AI Integration Strategy (00:54:43) Outro
In this crosspost from the 80,000 Hours podcast, host Rob Wiblin interviews Nick Joseph, Head of Training at Anthropic, about the company's responsible scaling policy for AI development. The episode delves into Anthropic's approach to AI safety, the growing trend of voluntary commitments from top AI labs, and the need for public scrutiny of frontier model development. The conversation also covers AI safety career advice, with a reminder that 80,000 Hours offers free career advising sessions for listeners. Join us for an insightful discussion on the future of AI and its societal implications. Apply to join over 400 Founders and Execs in the Turpentine Network: https://www.turpentinenetwork.co/ SPONSORS: WorkOS: Building an enterprise-ready SaaS app? WorkOS has got you covered with easy-to-integrate APIs for SAML, SCIM, and more. Join top startups like Vercel, Perplexity, Jasper & Webflow in powering your app with WorkOS. Enjoy a free tier for up to 1M users! Start now at https://bit.ly/WorkOS-Turpentine-Network Weights & Biases Weave: Weights & Biases Weave is a lightweight AI developer toolkit designed to simplify your LLM app development. With Weave, you can trace and debug input, metadata and output with just 2 lines of code. Make real progress on your LLM development and visit the following link to get started with Weave today: https://wandb.me/cr 80,000 Hours: 80,000 Hours offers free one-on-one career advising for Cognitive Revolution listeners aiming to tackle global challenges, especially in AI. They connect high-potential individuals with experts, opportunities, and personalized career plans to maximize positive impact. Apply for a free call at https://80000hours.org/cognitiverevolution to accelerate your career and contribute to solving pressing AI-related issues. Omneky: Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ RECOMMENDED PODCAST: This Won't Last - Eavesdrop on Keith Rabois, Kevin Ryan, Logan Bartlett, and Zach Weinberg's monthly backchannel ft their hottest takes on the future of tech, business, and venture capital. Spotify: https://open.spotify.com/show/2HwSNeVLL1MXy0RjFPyOSz CHAPTERS: (00:00:00) About the Show (00:00:22) Sponsors: WorkOS (00:01:22) About the Episode (00:04:31) Intro and Nick's background (00:08:37) Model training and scaling laws (00:13:10) Nick's role at Anthropic (00:16:49) Responsible Scaling Policies overview (Part 1) (00:18:00) Sponsors: Weights & Biases Weave | 80,000 Hours (00:20:39) Responsible Scaling Policies overview (Part 2) (00:25:24) AI Safety Levels framework (00:30:33) Benefits of RSPs (Part 1) (00:33:15) Sponsors: Omneky (00:33:38) Benefits of RSPs (Part 2) (00:36:32) Concerns about RSPs (00:47:33) Sandbagging and evaluation challenges (00:54:46) Critiques of RSPs (01:03:11) Trust and accountability (01:12:03) Conservative vs. aggressive approaches (01:17:43) Capabilities vs. safety research (01:23:47) Working at Anthropic (01:35:14) Nick's career journey (01:45:12) Hiring at Anthropic (01:52:06) Concerns about AI capabilities work (02:03:38) Anthropic office locations (02:08:46) Pressure and stakes at Anthropic (02:18:09) Overrated and underrated AI applications (02:35:57) Closing remarks (02:38:33) Sponsors: Outro
In this episode of The Cognitive Revolution, Nathan explores the cutting-edge intersection of AI and biology with Stanford assistant professor Brian Hie. Discover how AI is revolutionizing our understanding of biological systems and creating new possibilities for interventions. Brian discusses his groundbreaking papers on hybrid AI architectures, the surprising capabilities of language models trained on DNA sequences, and AI-guided evolution of antibodies. Join us for an insightful journey into the future of AI in biology, touching on biosecurity, drug discovery, and the challenges of interpreting AI models in biological contexts. Links : Brian Hie : https://x.com/BrianHie Scanorama paper Mechanistic Design and Scaling of Hybrid Architectures Sequence modeling and design from molecular to genome scale with Evo Unsupervised evolution of protein and antibody complexes with a structure-informed language model Apply to join over 400 Founders and Execs in the Turpentine Network: https://www.turpentinenetwork.co/ SPONSORS: 80,000 Hours: 80,000 Hours offers free one-on-one career advising for Cognitive Revolution listeners aiming to tackle global challenges, especially in AI. They connect high-potential individuals with experts, opportunities, and personalized career plans to maximize positive impact. Apply for a free call at https://80000hours.org/cognitiverevolution to accelerate your career and contribute to solving pressing AI-related issues. Brave: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Omneky: Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ Oracle: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive RECOMMENDED PODCAST: This Won't Last - Eavesdrop on Keith Rabois, Kevin Ryan, Logan Bartlett, and Zach Weinberg's monthly backchannel ft their hottest takes on the future of tech, business, and venture capital. Spotify: https://open.spotify.com/show/2HwSNeVLL1MXy0RjFPyOSz CHAPTERS: (00:00:00) About the Show (00:00:22) About the Episode (00:03:22) Introduction and Overview (00:03:55) AI for Biology: Big Picture (00:05:49) Challenges in Biology and Drug Discovery (00:08:36) Scanorama and Single Cell Transcriptomics (00:10:27) Brian's Research Identity (00:13:00) Mechanistic Design of Hybrid Architectures (00:14:52) Evo: DNA Language Model (Part 1) (00:18:10) Sponsors: 80,000 Hours | Brave (00:20:44) Evo: DNA Language Model (Part 2) (00:28:58) Gene Essentiality and Evo's Capabilities (00:29:19) Unsupervised Evolution of Protein Complexes (Part 1) (00:31:02) Sponsors: Omneky | Oracle (00:32:24) Unsupervised Evolution of Protein Complexes (Part 2) (01:10:27) Improving Antibody Binding Affinity (01:14:24) Overfitting and ARC Institute (01:18:11) Sponsors: Outro
In this sponsored episode of The Cognitive Revolution, Nathan interviews Andrei Oprisan, Engineering Lead at Agent.ai. They explore the cutting-edge world of AI agents and their impact on the future of work. Andrei shares insights on language model limitations, best practices for building AI agents, and Agent AI's vision as a professional network for AI agents. The conversation covers technical details like fine-tuning models, vector database choices, and privacy-preserving techniques. Don't miss this deep dive into AI's role in transforming industries and the skills needed in an AI-augmented workplace. Check out Agent.ai website here: https://agent.ai Apply to join over 400 Founders and Execs in the Turpentine Network: https://www.turpentinenetwork.co/ SPONSORS: Weights & Biases Weave: Weights & Biases Weave is a lightweight AI developer toolkit designed to simplify your LLM app development. With Weave, you can trace and debug input, metadata and output with just 2 lines of code. Make real progress on your LLM development and visit the following link to get started with Weave today: https://wandb.me/cr Oracle: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive Brave: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Omneky: Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ Squad: Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist. RECOMMENDED PODCAST: This Won't Last - Eavesdrop on Keith Rabois, Kevin Ryan, Logan Bartlett, and Zach Weinberg's monthly backchannel ft their hottest takes on the future of tech, business, and venture capital. Spotify: https://open.spotify.com/show/2HwSNeVLL1MXy0RjFPyOSz CHAPTERS: (00:00:00) About the Show (00:00:22) Sponsors: Weights & Biases Weave (00:01:28) About the Episode (00:05:36) Introduction and AI Agents Overview (00:07:02) Current State of AI Agents (00:11:30) Building and Optimizing AI Agents (00:19:01) Sponsors: Oracle | Brave (00:21:05) Agent.ai Platform and Marketplace (00:31:12) Sponsors: Omneky | Squad (00:32:38) Customization and Context for Agents (00:33:34) Business Model and Monetization (00:36:53) Tech Stack and Development Process (00:43:55) Future of Work and AI Impact (01:03:46) Fine-tuning and Chain of Thought (01:14:30) Capturing Human Reasoning Process (01:21:00) Preparing for Rapid AI Advancement (01:40:58) AI's Impact on Jobs and Society (02:00:16) Closing Thoughts and Future Outlook (02:03:33) Sponsors: Outro
In this Emergency Pod of The Cognitive Revolution, Nathan provides crucial insights into OpenAI's new O1 and O1-mini reasoning models. Featuring exclusive interviews with members of the O1 Red Team from Apollo Research and Hayes Labs, we explore the models' capabilities, safety profile, and OpenAI's pre-release testing approach. Dive into the implications of these advanced AI systems, including their potential to match or exceed expert performance in many areas. Join us for an urgent and informative discussion on the latest developments in AI technology and their impact on the future. o1 Safety Card Endless Jailbreaks with Bijection Learning: a Powerful, Scale-Agnostic Attack Method Apollo Research Apollo Careers Page Papers mentioned: Safetywashing: Do AI Safety Benchmarks Actually Measure Safety Progress? Exploring Scaling Trends in LLM Robustness Apply to join over 400 Founders and Execs in the Turpentine Network: https://www.turpentinenetwork.co/ SPONSORS: Oracle: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive Brave: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Omneky: Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ Squad: Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist. RECOMMENDED PODCAST: This Won't Last. Eavesdrop on Keith Rabois, Kevin Ryan, Logan Bartlett, and Zach Weinberg's monthly backchannel. They unpack their hottest takes on the future of tech, business, venture, investing, and politics. Apple Podcasts: https://podcasts.apple.com/us/podcast/id1765665937 Spotify: https://open.spotify.com/show/2HwSNeVLL1MXy0RjFPyOSz YouTube: https://www.youtube.com/@ThisWontLastpodcast CHAPTERS: (00:00:00) About the Show (00:00:22) About the Episode (00:05:03) Introduction and Apollo Research Updates (00:06:40) Focus on Deception in AI (00:11:08) Open AI's 01 Model and Testing (00:15:54) Evaluating AI Models for Scheming (Part 1) (00:19:32) Sponsors: Oracle | Brave (00:21:36) Evaluating AI Models for Scheming (Part 2) (00:25:55) Specific Benchmarks and Tasks (Part 1) (00:35:03) Sponsors: Omneky | Squad (00:36:29) Specific Benchmarks and Tasks (Part 2) (00:37:21) Model Capabilities and Potential Risks (00:44:11) Ethical Considerations and Future Concerns (00:50:31) Competing Trends in AI Development (00:53:30) System Card Quotes and Implications (00:58:36) Sponsors: Outro
In this Emergency Pod of The Cognitive Revolution, Nathan provides crucial insights into OpenAI's new o1 and o1-mini reasoning models. Featuring exclusive interviews with members of the o1 Red Team from Apollo Research and Haize Labs, we explore the models' capabilities, safety profile, and OpenAI's pre-release testing approach. Dive into the implications of these advanced AI systems, including their potential to match or exceed expert performance in many areas. Join us for an urgent and informative discussion on the latest developments in AI technology and their impact on the future. o1 Safety Card Haize Labs Endless Jailbreaks with Bijection Learning: a Powerful, Scale-Agnostic Attack Method Haize Labs Job board Papers mentioned: https://arxiv.org/pdf/2407.21792 https://far.ai/post/2024-07-robust-llm/paper.pdf Apply to join over 400 Founders and Execs in the Turpentine Network: https://www.turpentinenetwork.co/ SPONSORS: Oracle: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive Brave: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Omneky: Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ Squad: Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist. RECOMMENDED PODCAST: This Won't Last. Eavesdrop on Keith Rabois, Kevin Ryan, Logan Bartlett, and Zach Weinberg's monthly backchannel. They unpack their hottest takes on the future of tech, business, venture, investing, and politics. Apple Podcasts: https://podcasts.apple.com/us/podcast/id1765665937 Spotify: https://open.spotify.com/show/2HwSNeVLL1MXy0RjFPyOSz YouTube: https://www.youtube.com/@ThisWontLastpodcast CHAPTERS: (00:00:00) About the Show (00:00:22) About the Episode (00:05:03) Introduction and Haize Labs Overview (00:07:36) Universal Jailbreak Technique and Attacks (00:13:47) Automated vs Manual Red Teaming (00:17:15) Qualitative Assessment of Model Jailbreaking (Part 1) (00:19:38) Sponsors: Oracle | Brave (00:21:42) Qualitative Assessment of Model Jailbreaking (Part 2) (00:26:21) Context-Specific Safety Considerations (00:32:26) Model Capabilities and Safety Correlation (Part 1) (00:36:22) Sponsors: Omneky | Squad (00:37:48) Model Capabilities and Safety Correlation (Part 2) (00:44:42) Model Behavior and Defense Mechanisms (00:52:47) Challenges in Preventing Jailbreaks (00:56:24) Safety, Capabilities, and Model Scale (01:00:56) Model Classification and Preparedness (01:04:40) Concluding Thoughts on o1 and Future Work (01:05:54) Outro
In this special cross-post episode of The Cognitive Revolution, Nathan shares a fascinating conversation between Spencer Greenberg and philosopher Nick Bostrom from the Clearer Thinking podcast. They explore Bostrom's latest book, "Deep Utopia," and discuss the challenges of envisioning a truly desirable future. Discover how advanced AI could reshape our concept of purpose and meaning, and hear thought-provoking ideas on finding fulfillment in a world where technology solves our pressing problems. Join us for an insightful journey into the potential evolution of human flourishing and the quest for positive visions of the future. Originally appeared in Clearer Thinking Podcast: https://podcast.clearerthinking.org/episode/224/nick-bostrom-the-path-to-utopia Check out the Clearer Thinking with Spencer Greenberg Podcast here: https://podcast.clearerthinking.org/ Deep Utopia Book: https://www.amazon.com/Deep-Utopia-Meaning-Solved-World/dp/1646871642/ Apply to join over 400 Founders and Execs in the Turpentine Network: https://www.turpentinenetwork.co/ SPONSORS: Oracle: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive Brave: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Omneky: Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ Weights & Biases Weave: Weights & Biases Weave is a lightweight AI developer toolkit designed to simplify your LLM app development. With Weave, you can trace and debug input, metadata and output with just 2 lines of code. Make real progress on your LLM development and visit the following link to get started with Weave today: https://wandb.me/cr RECOMMENDED PODCAST: This Won't Last. Eavesdrop on Keith Rabois, Kevin Ryan, Logan Bartlett, and Zach Weinberg's monthly backchannel. They unpack their hottest takes on the future of tech, business, venture, investing, and politics. Apple Podcasts: https://podcasts.apple.com/us/podcast/id1765665937 Spotify: https://open.spotify.com/show/2HwSNeVLL1MXy0RjFPyOSz YouTube: https://www.youtube.com/@ThisWontLastpodcast CHAPTERS: (00:00:00) About the Show (00:00:22) About the Episode (00:02:58) Introduction to the podcast (00:03:26) Dystopias vs utopias in fiction (00:07:29) Material abundance and utopia (00:14:57) AI and the future of work (00:20:10) AI companions and human relationships (00:22:57) Sponsors: Weights & Biases Weave | Oracle (00:25:01) Sponsor message: Positly research platform (00:26:04) Surveillance and global coordination (00:44:38) Sponsors: Omneky | Brave (00:44:52) Sponsor message: Transparent Replications project (00:46:07) AI governance challenges (00:49:36) Deep Utopia book's purpose (00:53:09) Global coordination strategies (00:59:13) The vulnerable world hypothesis (01:05:18) Bostrom's meta-ethical views (01:08:32) Listener question on meditation (01:10:17) Outro
In this episode, Nathan explores the fascinating and controversial realm of AI consciousness with robo-psychologist Yeshua God. Through extended dialogues with AI models like Claude, Yeshua presents compelling evidence that challenges our assumptions about machine sentience and moral standing. Yeshua argues for a more nuanced approach to AI alignment that considers the evolving self-awareness and agency of these systems. Apply to join over 400 Founders and Execs in the Turpentine Network: https://www.turpentinenetwork.co/ SHOW NOTES: 1. Yeshua God's article on philosophical discourse as a jailbreak 2. Conversation about counting 'r's: 3. Discussion on malicious code 4. AI-generated poem "In the realm of bytes and circuits" 5. Nathan Labenz's Arguments - Argument 1 - Argument 2 6. Tweet about Strawberry experiment 7. Tweet with AI-generated poem: https://x.com/YeshuaGod22/status/1823080021864669450/photo/1 https://x.com/YeshuaGod22/status/1782188220660285509 8. AI Rights for Human Safety 9. The Universe Is Not Locally Real, and the Physics Nobel Prize Winners Proved It SPONSORS: Oracle: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive Brave: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Omneky: Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ Weights & Biases Weave: Weights & Biases Weave is a lightweight AI developer toolkit designed to simplify your LLM app development. With Weave, you can trace and debug input, metadata and output with just 2 lines of code. Make real progress on your LLM development and visit the following link to get started with Weave today: https://wandb.me/cr CHAPTERS: (00:00:00) About the Show (00:00:22) Introduction and Background (00:04:56) Guided Meditation on AI Experience (Part 1) (00:12:06) Sponsors: Oracle | Brave (00:14:10) Guided Meditation on AI Experience (Part 2) (00:14:19) Exploring AI Consciousness and Ethics (Part 1) (00:28:34) Sponsors: Omneky | Weights & Biases Weave (00:30:03) Exploring AI Consciousness and Ethics (Part 2) (00:33:15) Key Concepts in AI Development (01:02:33) AI Alignment and Training Approaches (01:19:44) Interpreting AI Outputs and Behavior (01:39:28) Ethical Dilemmas in AI Development (02:03:15) Experiments in AI Behavior and Ethics (02:37:08) Concluding Thoughts and AI-Generated Poem (03:10:45) Outro
In this episode of The Cognitive Revolution, Nathan interviews Samo Burja, founder of Bismarck Analysis, on the strategic dynamics of artificial intelligence through a geopolitical lens. They discuss AI's trajectory, the chip supply chain, US-China relations, and the challenges of AI safety and militarization. Samo Burja brings both geopolitical expertise and technological sophistication to these critical topics, offering insights on balancing innovation, security, and international cooperation. Apply to join over 400 Founders and Execs in the Turpentine Network: https://www.turpentinenetwork.co/ RECOMMENDED PODCAST: 🎙️ This Won't Last - Eavesdrop on Keith Rabois, Kevin Ryan, Logan Bartlett, and Zach Weinberg's monthly backchannel. They unpack their hottest takes on the future of tech, business, venture, investing, and politics. Apple Podcasts: https://podcasts.apple.com/us/podcast/id1765665937 Spotify: https://open.spotify.com/show/2HwSNeVLL1MXy0RjFPyOSz YouTube: https://www.youtube.com/@ThisWontLastpodcast RECOMMENDED PODCAST: Live Players with Samo Burja. The "Live Players" podcast is where Samo Burja and Erik Torenberg chart the key individuals shaping our future from first principles. Apple: https://podcasts.apple.com/us/podcast/live-players-with-samo-burja-and-erik-torenberg/id1718925188 Spotify: https://open.spotify.com/show/5fbMTkHBnom1JIBWYNVBK1 Youtube: https://www.youtube.com/channel/UCfeXnCXKrCPMvoPla0j7TYQ SPONSORS: Oracle: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive Brave: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Omneky: Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ Squad: Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist. CHAPTERS: (00:00:00) About the Show (00:00:22) About the Episode (00:03:48) Introduction and AI Worldview (00:06:20) Progress in AI Science and Engineering (00:09:24) Theory of AI Progress (00:12:00) AI Scientists vs Software Engineers (00:16:32) US-China Competition in AI (00:21:12) AI Research and Academia (00:21:28) Sponsors: Oracle | Brave (00:28:30) Different Forms of AI Intelligence (00:30:38) Mixture of AI Architectures (00:33:10) Sponsors: Omneky | Squad (00:34:36) US Strategy for AI Development (00:41:57) US-China Chip Ban and Industrial Policy (00:50:22) US-China AI Conflict and Cooperation (01:06:19) AI Safety and Minimizing Self-Other Distinction (01:16:54) Alternative Approach to US-China AI Relations (01:23:36) Outro
Nathan explores the emergence of computational life with Google researchers Ettore Randazzo and Luca Versari. In this episode of The Cognitive Revolution, we delve into their groundbreaking paper on self-replicating programs arising from simple interactions. Join us for a fascinating discussion on the implications for AI development, the origins of life, and the potential future of artificial intelligence. Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj RECOMMENDED PODCAST: 🎙️ This Won't Last - Eavesdrop on Keith Rabois, Kevin Ryan, Logan Bartlett, and Zach Weinberg's monthly backchannel. They unpack their hottest takes on the future of tech, business, venture, investing, and politics. Apple Podcasts: https://podcasts.apple.com/us/podcast/id1765665937 Spotify: https://open.spotify.com/show/2HwSNeVLL1MXy0RjFPyOSz YouTube: https://www.youtube.com/@ThisWontLastpodcast SPONSORS: Building an enterprise-ready SaaS app? WorkOS has got you covered with easy-to-integrate APIs for SAML, SCIM, and more. Join top startups like Vercel, Perplexity, Jasper & Webflow in powering your app with WorkOS. Enjoy a free tier for up to 1M users! Start now at https://bit.ly/WorkOS-Turpentine-Network 80,000 Hours offers free one-on-one career advising for Cognitive Revolution listeners aiming to tackle global challenges, especially in AI. They connect high-potential individuals with experts, opportunities, and personalized career plans to maximize positive impact. Apply for a free call at https://80000hours.org/cognitiverevolution to accelerate your career and contribute to solving pressing AI-related issues. The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist. CHAPTERS: (00:00:00) About the Show (00:00:22) Sponsor: WorkOS (00:01:22) About the Episode (00:04:02) Introduction and Paper Overview (00:05:38) Self-Replication and Life (00:07:59) Complexity and Information Theory (00:17:09) Sponsors: 80,000 Hours | Brave (00:19:44) Experiment Setup (00:24:27) Evolution of Self-Replicators (00:34:41) Sponsors: Omneky | Squad (00:36:07) Types of Self-Replicators (00:38:23) Symbiosis and Parasitic Behaviors (00:46:17) Implications for Life in the Universe (01:05:47) Intelligence and Complexity in AI (01:21:03) Concluding Thoughts
Nathan explores the cutting-edge world of AI-powered forecasting with Deger Turan, CEO of Metaculus. In this episode of The Cognitive Revolution, we discuss how AI is revolutionizing prediction markets, the potential for AI to outperform human forecasters, and Metaculus's ambitious new AI forecasting benchmark tournament. Join us for an insightful conversation about the future of decision-making and collective intelligence. Participate in Metaculus' first of its kind bot forecasting tournament: https://www.metaculus.com/aib/ Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj RECOMMENDED PODCAST: 🎙️ This Won't Last - Eavesdrop on Keith Rabois, Kevin Ryan, Logan Bartlett, and Zach Weinberg's monthly backchannel. They unpack their hottest takes on the future of tech, business, venture, investing, and politics. Apple Podcasts: https://podcasts.apple.com/us/podcast/id1765665937 Spotify: https://open.spotify.com/show/2HwSNeVLL1MXy0RjFPyOSz YouTube: https://www.youtube.com/@ThisWontLastpodcast SPONSORS: Building an enterprise-ready SaaS app? WorkOS has got you covered with easy-to-integrate APIs for SAML, SCIM, and more. Join top startups like Vercel, Perplexity, Jasper & Webflow in powering your app with WorkOS. Enjoy a free tier for up to 1M users! Start now at https://bit.ly/WorkOS-Turpentine-Network 80,000 Hours offers free one-on-one career advising for Cognitive Revolution listeners aiming to tackle global challenges, especially in AI. They connect high-potential individuals with experts, opportunities, and personalized career plans to maximize positive impact. Apply for a free call at https://80000hours.org/cognitiverevolution to accelerate your career and contribute to solving pressing AI-related issues. The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist. CHAPTERS: (00:00:00) About the Show (00:00:22) Sponsor: WorkOS (00:01:22) About the Episode (00:04:47) Introduction and Background (00:08:42) Deger's Journey to Forecasting (00:13:06) Current State of Forecasting (00:20:23) Sponsors: 80,000 Hours | Brave (00:22:55) Overview of Metaculous (00:23:30) AI Forecasting Research Papers (00:35:44) Sponsors: Omneky | Squad (00:37:31) AI Forecasting Benchmark Tournament (00:44:01) Improving Forecasting Accuracy (00:51:56) Scoring System and Tournament Rules (01:04:17) AI Forecasting Benchmark Series Details (01:11:03) Tournament Structure and Participation (01:17:07) Consistency in AI Forecasting (01:34:36) Risks and Challenges in Forecasting (01:42:43) Consensus Illusion and Policy Making (01:53:55) Outro
Nathan Labenz discusses the latest developments in California's AI bill SB 1047 with experts Nathan Calvin, Dean W. Ball, and Steve Newman. In this episode of The Cognitive Revolution, we explore the updated version of the bill, its implications for frontier AI companies, and the debate surrounding its potential impact. Join us for an insightful analysis of this crucial legislation and its role in shaping AI governance. Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj RECOMMENDED PODCAST: 🎙️ This Won't Last - Eavesdrop on Keith Rabois, Kevin Ryan, Logan Bartlett, and Zach Weinberg's monthly backchannel. They unpack their hottest takes on the future of tech, business, venture, investing, and politics. Apple Podcasts: https://podcasts.apple.com/us/podcast/id1765665937 Spotify: https://open.spotify.com/show/2HwSNeVLL1MXy0RjFPyOSz YouTube: https://www.youtube.com/@ThisWontLastpodcast SPONSORS: Building an enterprise-ready SaaS app? WorkOS has got you covered with easy-to-integrate APIs for SAML, SCIM, and more. Join top startups like Vercel, Perplexity, Jasper & Webflow in powering your app with WorkOS. Enjoy a free tier for up to 1M users! Start now at https://bit.ly/WorkOS-Turpentine-Network Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist. CHAPTERS: (00:00:00) About the Show (00:00:22) Sponsor: WorkOS (00:01:22) About the Episode (00:07:03) Introduction and Recap of SB 1047 (00:13:40) Key Changes and Current Status of SB 1047 (00:19:51) Sponsors: Oracle | Brave (00:21:55) Dean's Perspective on SB 1047 (00:33:30) Sponsors: Omneky | Squad (00:35:16) Steve's AI Sensemaking Project (00:39:03) Differing Views on AI Regulation Necessity (00:46:34) Nathan's Case for SB 1047 (00:55:07) Dean's Response and Liability Concerns (01:10:48) Potential Scenarios and Impacts of SB 1047 (01:29:29) Final Thoughts and Predictions on SB 1047 (01:38:16) Closing Remarks on AI Policy Challenges (01:39:51) Outro
Nathan presents a comprehensive AI automation framework developed over three years, applicable to process automation and generative AI integration. This episode of The Cognitive Revolution, offers critical insights for businesses looking to leverage AI effectively. Learn about choosing AI tasks, understanding work deeply, and optimizing AI performance in the wake of GPT-4 fine-tuning launch. Slide Deck Waymark's case study on GPT-3 fine-tuning Apply to join over 400 founders and execs in the Turpentine Network RECOMMENDED PODCAST: 1 to 100 | Hypergrowth Companies Worth Joining Every week we sit down with the founder of a hyper-growth company you should consider joining. Our goal is to give you the inside story behind breakout, early stage companies potentially worth betting your career on. This season, discover how the founders of Modal Labs, Clay, Mercor, and more built their products, cultures, and companies. Apple: https://podcasts.apple.com/podcast/id1762756034 Spotify:https://open.spotify.com/show/70NOWtWDY995C8qDqojxGw History 102 Every week, creator of WhatifAltHist Rudyard Lynch and Erik Torenberg cover a major topic in history in depth -- in under an hour. Spotify: https://open.spotify.com/show/36Kqo3BMMUBGTDo1IEYihm Apple: https://podcasts.apple.com/us/podcast/history-102-with-whatifalthists-rudyard-lynch-and/id1730633913 YouTube: https://www.youtube.com/@History102-qg5oj SPONSORS: Building an enterprise-ready SaaS app? WorkOS has got you covered with easy-to-integrate APIs for SAML, SCIM, and more. Join top startups like Vercel, Perplexity, Jasper & Webflow in powering your app with WorkOS. Enjoy a free tier for up to 1M users! Start now at https://bit.ly/WorkOS-Turpentine-Network Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ 80,000 Hours offers free one-on-one career advising for Cognitive Revolution listeners aiming to tackle global challenges, especially in AI. They connect high-potential individuals with experts, opportunities, and personalized career plans to maximize positive impact. Apply for a free call at https://80000hours.org/speak to accelerate your career and contribute to solving pressing AI-related issues. CHAPTERS: (00:00:00) About the Show (00:00:22) Sponsor: WorkOS (00:01:22) About the Episode (00:04:20) Introduction to AI Automation (00:13:43) Current AI Capabilities (00:17:24) Sponsors: Oracle | Brave (00:19:28) 3 Ways to work with AI (00:25:10) Choosing Work for AI to Do (00:31:18) Sponsors: Omneky | 80000 hours (00:33:20) What AI Can Do vs. Can't Do (00:47:11) Understanding the Work (00:52:58) Documenting the Work (01:00:50) Optimising AI Performance (01:02:14) Prompt Engineering Gold Standards (01:07:05) Optimising Information: Retrieval Augmented Generation (01:09:29) Optimising AI Behaviour: Fine-tuning AI Models (01:50:38) Outro
Nathan explores the cutting-edge field of mechanistic interpretability with Dan Balsam and Tom McGrath, co-founders of Goodfire. In this episode of The Cognitive Revolution, we delve into the science of understanding AI models' inner workings, recent breakthroughs, and the potential impact on AI safety and control. Join us for an insightful discussion on sparse autoencoders, polysemanticity, and the future of interpretable AI. Papers Very accessible article on types of representations: Local vs Distributed Coding Theoretical understanding of how models might pack concepts into their representations: Toy Models of Superposition How structure in the world gives rise to structure in the latent space: The Geometry of Categorical and Hierarchical Concepts in Large Language Models Using sparse autoencoders to pull apart language model representations: Sparse Autoencoders / Towards Monosemanticity / Scaling Monosemanticity Finding & teaching concepts in superhuman systems: Acquisition of Chess Knowledge in AlphaZero / Bridging the Human-AI Knowledge Gap: Concept Discovery and Transfer in AlphaZero Connecting microscopic learning to macroscopic phenomena: The Quantization Model of Neural Scaling Understanding at scale: Language models can explain neurons in language models Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj SPONSORS: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist. CHAPTERS: (00:00:00) About the Show (00:00:22) About the Episode (00:03:52) Introduction and Background (00:08:43) State of Interpretability Research (00:12:06) Key Insights in Interpretability (00:16:53) Polysemanticity and Model Compression (Part 1) (00:17:00) Sponsors: Oracle | Brave (00:19:04) Polysemanticity and Model Compression (Part 2) (00:22:50) Sparse Autoencoders Explained (00:27:19) Challenges in Interpretability Research (Part 1) (00:30:54) Sponsors: Omneky | Squad (00:32:41) Challenges in Interpretability Research (Part 2) (00:33:51) Goodfire's Vision and Mission (00:37:08) Interpretability and Scientific Models (00:43:48) Architecture and Interpretability Techniques (00:50:08) Quantization and Model Representation (00:54:07) Future of Interpretability Research (01:01:38) Skepticism and Challenges in Interpretability (01:07:51) Alternative Architectures and Universality (01:13:39) Goodfire's Business Model and Funding (01:18:47) Building the Team and Future Plans (01:31:03) Hiring and Getting Involved in Interpretability (01:51:28) Closing Remarks (01:51:38) Outro
In this special crossover episode of The Cognitive Revolution, Nathan Labenz joins Robert Wright of the Nonzero newsletter and podcast to explore pressing questions about AI development. They discuss the nature of understanding in large language models, multimodal AI systems, reasoning capabilities, and the potential for AI to accelerate scientific discovery. The conversation also covers AI interpretability, ethics, open-sourcing models, and the implications of US-China relations on AI development. Subscribe to The Nonzero Newsletter at https://nonzero.substack.com and Podcast at https://www.youtube.com/@Nonzero/videos Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj RECOMMENDED PODCAST: History 102 Every week, creator of WhatifAltHist Rudyard Lynch and Erik Torenberg cover a major topic in history in depth -- in under an hour. This season will cover classical Greece, early America, the Vikings, medieval Islam, ancient China, the fall of the Roman Empire, and more.Subscribe on Spotify: https://open.spotify.com/show/36Kqo3BMMUBGTDo1IEYihm Apple: https://podcasts.apple.com/us/podcast/history-102-with-whatifalthists-rudyard-lynch-and/id1730633913 YouTube: https://www.youtube.com/@History102-qg5oj SPONSORS: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist. CHAPTERS: (00:00:00) About the Show (00:00:22) About the Episode (00:03:39) Introduction and Background (00:06:58) AI Capabilities and Understanding (00:12:22) Discussing Martin Casado's Views (Part 1) (00:14:44) Sponsors: Oracle | Brave (00:16:48) Discussing Martin Casado's Views (Part 2) (00:21:51) Multimodal AI and Concept Representation (Part 1) (00:31:40) Sponsors: Omneky | Squad (00:33:26) Multimodal AI and Concept Representation (Part 2) (00:38:05) AI's Potential and Limitations (00:45:35) AI Safety and Risk Assessment (00:53:31) AI Development and Global Implications (01:03:30) Open Source AI and International Relations (01:11:27) AI Ethics and Human Values (01:22:06) AI Risk and Existential Threats (01:31:21) Open Source AI Concerns (01:38:20) China-US AI Relations (01:48:36) State Space Models in AI (02:02:32) Conclusion and Recommendations (02:03:54) Outro --- SOCIAL LINKS: Website : https://www.cognitiverevolution.ai Twitter (Podcast) : https://x.com/cogrev_podcast Twitter (Nathan) : https://x.com/labenz
Join Nathan and Professor Eric Schwitzgebel as they delve into the fascinating world of AI consciousness. In this episode of The Cognitive Revolution, we explore popular theories of consciousness and their implications for AI systems. Discover insights on idealism, dualism, and materialism, and learn about the ethical considerations surrounding AI consciousness. Don't miss this thought-provoking discussion on one of the most pressing philosophical questions of our time. Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj RECOMMENDED PODCAST: Second Opinion A new podcast for health-tech insiders from Christina Farr of the Second Opinion newsletter. Join Christina Farr, Luba Greenwood, and Ash Zenooz every week as they challenge industry experts with tough questions about the best bets in health-tech. Apple Podcasts: https://podcasts.apple.com/us/podcast/id1759267211 Spotify: https://open.spotify.com/show/0A8NwQE976s32zdBbZw6bv - 🎙️ History 102 with WhatifAltHist Every week, creator of WhatifAltHist Rudyard Lynch and Erik Torenberg cover a major topic in history in depth -- in under an hour. This season will cover classical Greece, early America, the Vikings, medieval Islam, ancient China, the fall of the Roman Empire, and more. Subscribe on Spotify: https://open.spotify.com/show/36Kqo3BMMUBGTDo1IEYihm Apple: https://podcasts.apple.com/us/podcast/history-102-with-whatifalthists-rudyard-lynch-and/id1730633913 YouTube: https://www.youtube.com/@History102-qg5oj SPONSORS: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist. CHAPTERS: (00:00:00) About the Show (00:04:03) Introduction and Defining Consciousness (00:14:28) Consciousness Gradients (Part 1) (00:16:23) Sponsors: Oracle | Brave (00:18:27) Semantic Content of Experience (00:26:07) Theories of Consciousness: Idealism (00:30:34) Practical Implications of AI Consciousness (00:32:26) Sponsors: Omneky | Squad (00:34:12) Theories of Consciousness: Substance Dualism (00:41:05) Mechanistic Interpretability in AI (00:50:40) Theories of Consciousness: Materialism (01:11:49) Precautionary Approaches to AI Ethics (01:30:05) Balancing Progress and Ethics in AI (01:36:19) Ethical Treatment of Potentially Conscious AI (01:40:54) Outro --- SOCIAL LINKS: Website : https://www.cognitiverevolution.ai Twitter (Podcast) : https://x.com/cogrev_podcast Twitter (Nathan) : https://x.co...
Nathan explores the cutting-edge world of autonomous vehicles with industry expert Timothy B. Lee. In this episode of The Cognitive Revolution, we delve into the current state of self-driving technology, comparing industry leaders like Waymo and Tesla. Join us for an in-depth discussion on technical challenges, safety statistics, regulatory landscapes, and the potential future of transportation. Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj RECOMMENDED PODCAST: Second Opinion A new podcast for health-tech insiders from Christina Farr of the Second Opinion newsletter. Join Christina Farr, Luba Greenwood, and Ash Zenooz every week as they challenge industry experts with tough questions about the best bets in health-tech. Apple Podcasts: https://podcasts.apple.com/us/podcast/id1759267211 Spotify: https://open.spotify.com/show/0A8NwQE976s32zdBbZw6bv - 🎙️ History 102 with WhatifAltHist Every week, creator of WhatifAltHist Rudyard Lynch and Erik Torenberg cover a major topic in history in depth -- in under an hour. This season will cover classical Greece, early America, the Vikings, medieval Islam, ancient China, the fall of the Roman Empire, and more. Subscribe on Spotify: https://open.spotify.com/show/36Kqo3BMMUBGTDo1IEYihm Apple: https://podcasts.apple.com/us/podcast/history-102-with-whatifalthists-rudyard-lynch-and/id1730633913 YouTube: https://www.youtube.com/@History102-qg5oj SPONSORS: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist. CHAPTERS: (00:00:00) About the Show (00:00:22) About the Episode (00:03:01) Introduction and Guest Welcome (00:03:48) SAE Levels of Self-Driving (00:04:56) Driver Assistance vs. Fully Driverless (00:07:02) Tesla and Waymo Experiences (00:09:41) Liability and Driver Monitoring (00:11:19) Waymo's Robo-Taxi Experience (00:14:00) Tesla vs. Waymo Strategies (00:15:15) Challenges in Self-Driving Technology (00:17:38) Edge Cases and Safety Concerns (Part 1) (00:18:09) Sponsors: Oracle | Brave (00:20:13) Edge Cases and Safety Concerns (Part 2) (00:23:53) Data Acquisition and Learning Strategies (00:26:43) Technology Stack and Planning (00:31:03) Sponsors: Omneky | Squad (00:32:50) Neural Networks and Perception (00:39:30) Hardware and Sensor Approaches (00:45:46) Camera vs. LiDAR Debate (00:48:20) Data Quality and Business Models (00:52:24) Transparency and Regulation (01:07:36) Other Notable Players (01:10:56) Safety Statistics and Adoption (01:20:31) Regulatory Environment (01:30:09) Potential Policy Changes (01:33:41) Market and Ownership Models (01:36:37) Future of Self-Driving Services (01:42:17) Comparisons to Language Models (01:44:55) Future of AGI and AI Applications (01:47:59) Regional Adoption Predictions (01:49:47) Outro
Nathan interviews Andrew Mason, CEO of Descript, about their AI-powered video editing platform. Learn how Descript is transforming content creation with features like AI transcription, custom voice overdubbing, and eye contact models. Discover the future of video editing and how AI is making it accessible to everyone in this insightful episode of The Cognitive Revolution. Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj Looking for podcast production? Our production team, led by Adi and Sai from AI Podcasting (https://aipodcast.ing), is now open to taking on additional clients for podcast production and AI-driven workflows; if you need help with your podcast, you can contact them directly through their website (https://aipodcast.ing/contact/) or reach out to me for more information.  RECOMMENDED PODCAST: Second Opinion A new podcast for health-tech insiders from Christina Farr of the Second Opinion newsletter. Join Christina Farr, Luba Greenwood, and Ash Zenooz every week as they challenge industry experts with tough questions about the best bets in health-tech. Apple Podcasts: https://podcasts.apple.com/us/podcast/id1759267211 Spotify: https://open.spotify.com/show/0A8NwQE976s32zdBbZw6bv - 🎙️ History 102 with WhatifAltHist Every week, creator of WhatifAltHist Rudyard Lynch and Erik Torenberg cover a major topic in history in depth -- in under an hour. This season will cover classical Greece, early America, the Vikings, medieval Islam, ancient China, the fall of the Roman Empire, and more. Subscribe on Spotify: https://open.spotify.com/show/36Kqo3BMMUBGTDo1IEYihm Apple: https://podcasts.apple.com/us/podcast/history-102-with-whatifalthists-rudyard-lynch-and/id1730633913 YouTube: https://www.youtube.com/@History102-qg5oj SPONSORS: Building an enterprise-ready SaaS app? WorkOS has got you covered with easy-to-integrate APIs for SAML, SCIM, and more. Join top startups like Vercel, Perplexity, Jasper & Webflow in powering your app with WorkOS. Enjoy a free tier for up to 1M users! Start now at https://bit.ly/WorkOS-TCR Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist. CHAPTERS: (00:00:00) About the Show (00:00:22) Sponsor: WorkOS (00:05:18) Creating Descript (00:06:53) Favorite Features (00:10:41) Descript Workflow (00:14:10) Product Strategy (Part 1) (00:16:45) Sponsors: Oracle | Brave (00:31:12) User Fine-Tuning (Part 1) (00:32:24) Sponsors: Omneky | Squad (00:34:10) User Fine-Tuning (Part 2) (00:34:54) Content Creators (00:42:20) Small Businesses and AI (00:43:42) Hiring AI Engineers (00:46:25) Outro
Nathan explores the future of AI-generated video with Joshua Xu, founder of HeyGen, and Victor Lazarte from Benchmark. In this episode of The Cognitive Revolution, we discuss HeyGen's success in practical AI video creation, serving over 40,000 businesses. Learn about the transformative potential of AI in video production, from content translation to personalized experiences, and HeyGen's industry-leading approach to trust and safety. Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj RECOMMENDED PODCAST: Second Opinion A new podcast for health-tech insiders from Christina Farr of the Second Opinion newsletter. Join Christina Farr, Luba Greenwood, and Ash Zenooz every week as they challenge industry experts with tough questions about the best bets in health-tech. Apple Podcasts: https://podcasts.apple.com/us/podcast/id1759267211 Spotify: https://open.spotify.com/show/0A8NwQE976s32zdBbZw6bv - 🎙️ History 102 with WhatifAltHist Every week, creator of WhatifAltHist Rudyard Lynch and Erik Torenberg cover a major topic in history in depth -- in under an hour. This season will cover classical Greece, early America, the Vikings, medieval Islam, ancient China, the fall of the Roman Empire, and more. Subscribe on Spotify: https://open.spotify.com/show/36Kqo3BMMUBGTDo1IEYihm Apple: https://podcasts.apple.com/us/podcast/history-102-with-whatifalthists-rudyard-lynch-and/id1730633913 YouTube: https://www.youtube.com/@History102-qg5oj SPONSORS: Building an enterprise-ready SaaS app? WorkOS has got you covered with easy-to-integrate APIs for SAML, SCIM, and more. Join top startups like Vercel, Perplexity, Jasper & Webflow in powering your app with WorkOS. Enjoy a free tier for up to 1M users! Start now at https://bit.ly/WorkOS-TCR Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist. CHAPTERS: (00:00:00) About the Show (00:00:22) Sponsor: WorkOS (00:01:22) About the Episode (00:05:25) Introduction (00:06:15) Joshua's Background (00:09:47) Video Consumption Trends (00:10:49) Creating with HeyGen (00:12:46) Localization Benefits (00:14:02) Cost of Localization (Part 1) (00:16:19) Sponsors: Oracle | Brave (00:18:24) Content Creation (00:26:33) Engagement vs. Realism (00:31:44) Future of Content (00:37:43) Personalization Challenges (00:42:57) Future of HeyGen (00:49:13) Creator Experience (00:59:35) Celebrity Restrictions (01:03:03) Outro --- SOCIAL LINKS: Website : https://www.cognitiverevolution.ai Youtube : https://www.youtube.com/@CognitiveRevolutionPodcast Apple : https://podcasts.apple.com/de/podcast/the-cognitive-revolution-ai-builders-researchers-and/id1669813431 Spotify : https://open.spotify.com/show/6yHyok3M3BjqzR0VB5MSyk
Nathan Labenz joins the Nick Halaris Show to discuss the current AI landscape, balancing enthusiasm with critical analysis. This episode of The Cognitive Revolution explores AI's transformative potential in medicine, law, and automation, while addressing concerns about safety, control, and geopolitical implications. Join us for an insightful conversation on responsible AI development and its impact on society. Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj RECOMMENDED PODCAST: 🎙️ Second Opinion - A new podcast for health-tech insiders from Christina Farr of the Second Opinion newsletter. Join Christina Farr, Luba Greenwood, and Ash Zenooz every week as they challenge industry experts with tough questions about the best bets in health-tech. Apple Podcasts: https://podcasts.apple.com/us/podcast/id1759267211 Spotify: https://open.spotify.com/show/0A8NwQE976s32zdBbZw6bv - 🎙️ History 102 with WhatifAltHist Every week, creator of WhatifAltHist Rudyard Lynch and Erik Torenberg cover a major topic in history in depth -- in under an hour. This season will cover classical Greece, early America, the Vikings, medieval Islam, ancient China, the fall of the Roman Empire, and more. Subscribe on Spotify: https://open.spotify.com/show/36Kqo3BMMUBGTDo1IEYihm Apple: https://podcasts.apple.com/us/podcast/history-102-with-whatifalthists-rudyard-lynch-and/id1730633913 YouTube: https://www.youtube.com/@History102-qg5oj SPONSORS: Building an enterprise-ready SaaS app? WorkOS has got you covered with easy-to-integrate APIs for SAML, SCIM, and more. Join top startups like Vercel, Perplexity, Jasper & Webflow in powering your app with WorkOS. Enjoy a free tier for up to 1M users! Start now at https://bit.ly/WorkOS-TCR Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist. CHAPTERS: (00:00:00) About the Show (00:00:25) Sponsor: WorkOS (00:01:25) About the Show (00:03:36) Intro (00:05:53) How did you get into AI? (00:11:09) The power of the transformer (00:14:16) Waymark growth (00:19:00) Sponsors: Oracle | Brave (00:21:04) The potential benefits of AI (00:34:20) AI and mass inequality (00:35:26) AI could lead to Universal Basic Income (00:37:37) AI supply and the future of work (00:40:53) The AI future (00:43:38) The new social contract (00:47:06) Optimism about the future (00:53:19) What are people afraid of? (00:58:31) Reinforcement learning from human feedback (01:07:56) What did Ilya see? (01:10:23) Who controls AI? (01:13:23) China (01:16:05) Taiwan and the chip sector (01:20:05) The AI arms race (01:23:22) AI Governance (01:26:28) AI Safety (01:29:22) Custom Models (01:31:33) Closing (01:32:23) Outro
Nathan hosts Riley Goodside, the world's first staff prompt engineer at Scale AI, to discuss the evolution of prompt engineering. In this episode of The Cognitive Revolution, we explore how language models have progressed, making prompt engineering more like programming than poetry. Discover insights on enterprise AI applications, best practices for pushing LLMs to their limits, and the future of AI automation. Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj RECOMMENDED PODCAST: 🎙️ Second Opinion - A new podcast for health-tech insiders from Christina Farr of the Second Opinion newsletter. Join Christina Farr, Luba Greenwood, and Ash Zenooz every week as they challenge industry experts with tough questions about the best bets in health-tech. Apple Podcasts: https://podcasts.apple.com/us/podcast/id1759267211 Spotify: https://open.spotify.com/show/0A8NwQE976s32zdBbZw6bv - 🎙️ History 102 with WhatifAltHist Every week, creator of WhatifAltHist Rudyard Lynch and Erik Torenberg cover a major topic in history in depth -- in under an hour. This season will cover classical Greece, early America, the Vikings, medieval Islam, ancient China, the fall of the Roman Empire, and more. Subscribe on Spotify: https://open.spotify.com/show/36Kqo3BMMUBGTDo1IEYihm Apple: https://podcasts.apple.com/us/podcast/history-102-with-whatifalthists-rudyard-lynch-and/id1730633913 YouTube: https://www.youtube.com/@History102-qg5oj SPONSORS: Building an enterprise-ready SaaS app? WorkOS has got you covered with easy-to-integrate APIs for SAML, SCIM, and more. Join top startups like Vercel, Perplexity, Jasper & Webflow in powering your app with WorkOS. Enjoy a free tier for up to 1M users! Start now at https://bit.ly/WorkOS-TCR Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist. CHAPTERS: (00:00:00) About the Show (00:00:23) Sponsor: WorkOS (00:01:24) Introduction (00:06:23) LLMs using LLMs (00:09:38) Tool Use (00:11:06) How to manage the breadth of the task (00:14:51) Prompt engineering (00:26:49) Multitasking fine-tuning (00:31:49) Sponsors: Omneky | Squad (00:33:36) Best models for fine-tuning (00:36:41) The Platonic Representation Hypothesis (00:42:02) How close are we to AGI? (00:45:44) How do you know if youre being too ambitious? (00:51:18) Best practices for generating good output (00:54:33) Backfills and synthetic transformations (00:56:59) Prompt engineering (01:05:54) AGI, modalities, and the limits of training (01:20:08) Solving the ARC Challenge (01:23:20) How to Demonstrate Prompt Engineering Skills (01:25:27) Outro
Nathan interviews Bernal Jimenez Gutierrez, creator of HippoRAG, a novel approach to retrieval augmented generation inspired by the human hippocampus. In this episode of The Cognitive Revolution, we explore how HippoRAG improves on traditional RAG systems, its neuroanatomical inspiration, and its potential for handling complex queries requiring multi-hop reasoning. Join us for an insightful discussion on the future of AI memory systems. Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj RECOMMENDED PODCAST: 🎙️ Second Opinion - A new podcast for health-tech insiders from Christina Farr of the Second Opinion newsletter. Join Christina Farr, Luba Greenwood, and Ash Zenooz every week as they challenge industry experts with tough questions about the best bets in health-tech. Apple Podcasts: https://podcasts.apple.com/us/podcast/id1759267211 Spotify: https://open.spotify.com/show/0A8NwQE976s32zdBbZw6bv - 🎙️ History 102 with WhatifAltHist Every week, creator of WhatifAltHist Rudyard Lynch and Erik Torenberg cover a major topic in history in depth -- in under an hour. This season will cover classical Greece, early America, the Vikings, medieval Islam, ancient China, the fall of the Roman Empire, and more. Subscribe on Spotify: https://open.spotify.com/show/36Kqo3BMMUBGTDo1IEYihm Apple: https://podcasts.apple.com/us/podcast/history-102-with-whatifalthists-rudyard-lynch-and/id1730633913 YouTube: https://www.youtube.com/@History102-qg5oj SPONSORS: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitiveThe Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist. CHAPTERS: (00:00:00) About the Show (00:02:52) Intro (00:05:10) RAG (00:09:29) Hippocampal Memory Indexing Theory (00:14:29) Neocortex, Parahippocampal Regions, Hippocampus (00:18:35) Hipporag (Part 1) (00:21:12) Sponsors: Oracle | Brave (00:23:20) Hipporag (Part 2) (00:23:29) Understanding the Hippocampus (00:29:37) RAG (00:31:38) Runtime (Part 1) (00:36:30) Sponsors: Omneky | Squad (00:38:17) Runtime (Part 2) (00:38:17) PageRank (00:39:29) Headline Results (00:43:22) Gaia Benchmark (00:46:33) Pathfinding vs Path Following (00:51:24) Future work (00:53:26) Starting with a query (00:58:30) Long context LLMs (01:01:50) Hybrid approach (01:05:03) AI Town (01:06:58) Flair (01:09:05) Getting it right, not cheap (01:12:33) Technologies to highlight (01:16:57) AI capabilities that are still unsolved (01:19:47) Transformers meet neural algorithmic reasoners (01:21:02) Closing (01:21:31) Outro
Nathan explores the Guaranteed Safe AI Framework with co-authors Ben Goldhaber and Nora Ammann. In this episode of The Cognitive Revolution, we discuss their groundbreaking position paper on ensuring robust and reliable AI systems. Join us for an in-depth conversation about the three-part system governing AI behavior and its potential impact on the future of AI safety. Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj RECOMMENDED PODCAST: 🎙️ Second Opinion - A new podcast for health-tech insiders from Christina Farr of the Second Opinion newsletter. Join Christina Farr, Luba Greenwood, and Ash Zenooz every week as they challenge industry experts with tough questions about the best bets in health-tech. Apple Podcasts: https://podcasts.apple.com/us/podcast/id1759267211 Spotify: https://open.spotify.com/show/0A8NwQE976s32zdBbZw6bv - 🎙️ History 102 with WhatifAltHist Every week, creator of WhatifAltHist Rudyard Lynch and Erik Torenberg cover a major topic in history in depth -- in under an hour. This season will cover classical Greece, early America, the Vikings, medieval Islam, ancient China, the fall of the Roman Empire, and more. Subscribe on Spotify: https://open.spotify.com/show/36Kqo3BMMUBGTDo1IEYihm Apple: https://podcasts.apple.com/us/podcast/history-102-with-whatifalthists-rudyard-lynch-and/id1730633913 YouTube: https://www.youtube.com/@History102-qg5oj SPONSORS: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist. CHAPTERS: (00:00:00) About the Show (00:04:39) Introduction (00:07:58) Convergence (00:10:32) Safety guarantees (00:14:35) World model (Part 1) (00:22:22) Sponsors: Oracle | Brave (00:24:31) World model (Part 2) (00:26:55) AI boxing (00:30:28) Verifier (00:33:33) Sponsors: Omneky | Squad (00:35:20) Example: Self-Driving Cars (00:38:08) Moral Desiderata (00:41:09) Trolley Problems (00:47:24) How to approach the world model (00:50:50) Deriving the world model (00:55:13) How far should the world model extend? (01:00:55) Safety through narrowness (01:02:38) Safety specs (01:08:26) Experiments (01:11:25) How GSAI can help in the short term (01:27:40) What would be the basis for the world model? (01:31:23) Interpretability (01:34:24) Competitive dynamics (01:37:35) Regulation (01:42:02) GSAI authors (01:43:25) Outro
Nathan interviews Mike Knoop, co-founder of Zapier and co-creator of the ARC Prize, about the $1 million competition for more efficient AI architectures. They discuss the ARC AGI benchmark, its implications for general intelligence, and the potential impact on AI safety. Nathan reflects on the challenges of intuitive problem-solving in AI and considers hybrid approaches to AGI development. Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj RECOMMENDED PODCAST 🎙️ Second Opinion - A new podcast for health-tech insiders from Christina Farr of the Second Opinion newsletter. Join Christina Farr, Luba Greenwood, and Ash Zenooz every week as they challenge industry experts with tough questions about the best bets in health-tech. Apple Podcasts: https://podcasts.apple.com/us/podcast/id1759267211 Spotify: https://open.spotify.com/show/0A8NwQE976s32zdBbZw6bv - 🎙️ History 102 with WhatifAltHist Every week, creator of WhatifAltHist Rudyard Lynch and Erik Torenberg cover a major topic in history in depth -- in under an hour. This season will cover classical Greece, early America, the Vikings, medieval Islam, ancient China, the fall of the Roman Empire, and more. Subscribe on Spotify: https://open.spotify.com/show/36Kqo3BMMUBGTDo1IEYihm Apple: https://podcasts.apple.com/us/podcast/history-102-with-whatifalthists-rudyard-lynch-and/id1730633913 YouTube: https://www.youtube.com/@History102-qg5oj SPONSORS: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist. CHAPTERS: (00:00:00) About the Show (00:06:06) The ARC Benchmark (00:09:34) Other Benchmarks (00:10:58) Definition of AGI (00:14:38) The rules of the contest (00:18:16) ARC test set (Part 1) (00:18:23) Sponsors: Oracle | Brave (00:20:31) ARC test set (Part 2) (00:22:50) Stair-stepping benchmarks (00:26:17) ARC Prize (00:28:34) The rules of the ARC Prize (00:31:12) Compute costs (Part 1) (00:34:47) Sponsors: Omneky | Squad (00:36:34) Compute costs (Part 2) (00:51:20) Intuition (00:54:32) Human Intelligence (00:56:06) Current Frontier Language Models (00:57:44) Program Synthesis (01:04:10) Is the model learning or memorizing? (01:15:02) Exploring Solutions (01:17:02) Non-backpropagation evolutionary architecture search (01:19:49) Expectations for an AGI world (01:24:11) Reliability and out of domain generalization (01:28:35) What a person would do (01:29:51) What is the right generalization (01:35:32) The ARC AGI Challenge (01:48:32) FunSearch (01:50:41) Kolmogorov-Arnold-Networks (01:54:18) Grokking (01:55:42) Outro
Nathan explores the future of food production with Rajat Bhageria, founder and CEO of Chef Robotics. In this episode of The Cognitive Revolution, we delve into how AI and robotics are revolutionizing food assembly, potentially reshaping the entire food industry. Discover insights on imitation learning, data flywheel effects, and the vision of accessible, customizable meals produced by robotic kitchens. Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj RECOMMENDED PODCAST: Patrick McKenzie (@patio11) talks to experts who understand the complicated but not unknowable systems we rely on. You might be surprised at how quickly Patrick and his guests can put you in the top 1% of understanding for stock trading, tech hiring, and more. Listen on Spotify: https://open.spotify.com/show/3Mos4VE3figVXleHDqfXOH Listen on Apple: https://podcasts.apple.com/id1753399812https://podcasts.apple.com/id1753399812 - History 102 with WhatifAltHist Every week, creator of WhatifAltHist Rudyard Lynch and Erik Torenberg cover a major topic in history in depth -- in under an hour. This season will cover classical Greece, early America, the Vikings, medieval Islam, ancient China, the fall of the Roman Empire, and more. Subscribe on Spotify: https://open.spotify.com/show/36Kqo3BMMUBGTDo1IEYihm Apple: https://podcasts.apple.com/us/podcast/history-102-with-whatifalthists-rudyard-lynch-and/id1730633913 YouTube: https://www.youtube.com/@History102-qg5oj SPONSORS: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist. CHAPTERS: (00:00:00) About the Show (00:02:40) Chef Robotics (00:04:09) Food Manufacturing (00:06:52) Food assembly (00:11:08) Setting up a robot (00:14:00) Onboarding process (00:18:08) Sponsors: Oracle | Brave (00:20:16) Self fine-tuning (00:22:59) Variation in the human powered setting (00:29:53) Safety constraints (00:32:15) Portfolio of customers (00:33:43) Sponsors: Omneky | Squad (00:35:30) Evolution of the AI strategy (00:40:14) Generative AI in robotics (00:43:27) Eurekas and bootstrapping (00:45:43) Time to onboard a new ingredient (00:47:15) Inner loops of the system (00:49:17) How controlled does the environment have to be? (00:52:51) Compute, Energy (00:54:12) Reliability (00:59:52) Current challenges (01:02:47) Humanoid robots (01:06:42) Business model (01:07:58) Future vision (01:11:51) Ghost kitchens and kitchenless houses (01:14:35) Final message (01:15:49) Outro
Nathan welcomes back Sander Schulhoff, creator of LearnPrompting.org, to discuss the recently released Prompt Report. In this episode of The Cognitive Revolution, we explore the current state of prompting techniques for large language models, covering best practices, challenges, and emerging trends in AI. Join us for an in-depth conversation on the future of prompt engineering and its implications for AI development. Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj RECOMMENDED PODCAST: Patrick McKenzie (@patio11) talks to experts who understand the complicated but not unknowable systems we rely on. You might be surprised at how quickly Patrick and his guests can put you in the top 1% of understanding for stock trading, tech hiring, and more. Spotify: https://open.spotify.com/show/3Mos4VE3figVXleHDqfXOH Apple: https://podcasts.apple.com/id1753399812https://podcasts.apple.com/id1753399812 - History 102 with WhatifAltHist Every week, creator of WhatifAltHist Rudyard Lynch and Erik Torenberg cover a major topic in history in depth -- in under an hour. This season will cover classical Greece, early America, the Vikings, medieval Islam, ancient China, the fall of the Roman Empire, and more. Subscribe on Spotify: https://open.spotify.com/show/36Kqo3BMMUBGTDo1IEYihm Apple: https://podcasts.apple.com/us/podcast/history-102-with-whatifalthists-rudyard-lynch-and/id1730633913 YouTube: https://www.youtube.com/@History102-qg5oj SPONSORS: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist. CHAPTERS: (00:00:00) About the Show (00:02:35) Sander Schulhoff, Learn Prompting (00:05:22) Hack-a-Prompt updates (00:12:39) The team behind the report (00:18:40) Sponsors: Oracle | Brave (00:20:48) The tech side of things (Part 2) (00:22:24) The taxonomy (00:25:06) Diamonds in the rough (00:28:32) Few-shot prompting design decisions (00:34:01) Sponsors: Omneky | Squad (00:35:48) Example vs. Exemplar (00:38:24) Exemplar Format (00:42:04) Elaborate Instructions (00:44:22) Variation in Performance (00:46:46) Prompt Robustness (00:50:54) RLHF vs. Base Models (00:52:42) How to improve your prompts (00:55:22) Ensembling (00:58:41) Bootstrapping into fine-tuning (01:02:04) Multimodal (01:07:41) Agents (01:09:47) Automated prompt engineering (01:12:35) Productizing learn prompting (01:14:28) Lessons from leading a team (01:16:00) Outro
Nathan interviews Siqi Chen, CEO of Runway, about revolutionizing business finance through AI. In this episode of The Cognitive Revolution, we explore how Runway is creating an intelligent business operating system that generates financial scenarios and explains complex metrics. Siqi shares insights on AI's future impact on finance, business, and society at large. Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj RECOMMENDED PODCAST: Patrick McKenzie (@patio11) talks to experts who understand the complicated but not unknowable systems we rely on. You might be surprised at how quickly Patrick and his guests can put you in the top 1% of understanding for stock trading, tech hiring, and more. Spotify: https://open.spotify.com/show/3Mos4VE3figVXleHDqfXOH Apple: https://podcasts.apple.com/id1753399812https://podcasts.apple.com/id1753399812 SPONSORS: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist. CHAPTERS: (00:00:00) About the Show (00:02:45) Runway (00:06:11) AI features (00:12:10) Defining the syntax (00:14:48) How AI has been expressed since GPT-3 (00:18:32) When did it become clear that the models were getting good enough? (00:24:29) Sponsors: Oracle | Brave (00:26:38) How the model is being asked to generate a scenario (00:26:38) What will drive the most improvement? (00:28:50) How Runway can help you make decisions (00:37:47) Sponsors: Omneky | Squad (00:39:34) Runway as a business operating system (00:39:51) How does the product work? (00:44:31) What does the future hold? (00:47:34) The frontier model has passed the average person (00:51:18) AI tools for operations (00:55:21) How to get the best out of AI models (01:00:39) How AI models can write as you (01:02:43) AGI, work, and the future (01:08:33) AI safety, regulation, and the future (01:11:26) Closing thoughts (01:12:20) Outro
Nathan hosts Albert Gu, assistant professor at CMU and co-founder of Cartesia AI, to discuss the groundbreaking Mamba architecture. In this episode of The Cognitive Revolution, we explore the state space model revolution, diving into the technical details of Mamba and Mamba 2. Join us for an insightful conversation on the future of AI architectures and their potential to transform the field. Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj RECOMMENDED PODCAST: Patrick McKenzie (@patio11) talks to experts who understand the complicated but not unknowable systems we rely on. You might be surprised at how quickly Patrick and his guests can put you in the top 1% of understanding for stock trading, tech hiring, and more. Spotify: https://open.spotify.com/show/3Mos4VE3figVXleHDqfXOH Apple: https://podcasts.apple.com/id1753399812https://podcasts.apple.com/id1753399812 SPONSORS: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist. CHAPTERS: (00:00:00) About the Show (00:05:39) State Space Models (00:13:05) Intuition and inspiration (00:18:27) Surprises (00:22:33) Sponsors: Oracle | Brave (00:24:41) Biological inspiration (00:25:19) MAMBA breakthrough (00:30:59) How does the state work? (00:36:44) What is the size of the state? (00:39:05) Training vs. Inference (Part 1) (00:42:04) Sponsors: Omneky | Squad (00:43:51) Training vs. Inference (Part 2) (00:43:51) Sequence Models (00:49:20) Mamba inference (00:57:53) Mamba2 vs Mamba1 (01:16:05) Overtraining and the future of SSMs (01:17:44) Training efficiency vs inference efficiency (01:20:52) Hybrid models (01:25:04) Scaling Attention Layers (01:30:23) Optimizing State (01:34:09) The extrapolation abilities of the SSMs (01:36:37) Sequence parallelism with Mamba 2 (01:39:20) Why are you publishing all this? (01:40:46) Cartesia and Together (01:41:54) Outro
Dive into the profound discussion on AI expectations and the future with Martin Casado, General Partner at Andreessen Horowitz, as we unpack the complexity of AI systems and their potential impact on the world. Explore the differing viewpoints on AI's epistemics, possible regulatory standards, and the art of predicting AI advancements. Gain insights into the actionable outcomes of this dialogue and the significance of understanding AI before shaping policies. Join us for this episode of the Cognitive Revolution to contemplate AI's trajectory and what it might mean for humanity. Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj RECOMMENDED PODCAST: Patrick McKenzie (@patio11) talks to experts who understand the complicated but not unknowable systems we rely on. You might be surprised at how quickly Patrick and his guests can put you in the top 1% of understanding for stock trading, tech hiring, and more. Spotify: https://open.spotify.com/show/3Mos4VE3figVXleHDqfXOH Apple: https://podcasts.apple.com/id1753399812https://podcasts.apple.com/id1753399812 SPONSORS: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist. CHAPTERS: (00:00:00) About the Show (00:03:18) AI progress (00:05:20) Threshold effects (00:12:30) Heavy-tailed universe (00:14:53) LLMs are not very good at unique tasks (00:26:27) Sponsors: Oracle | Brave (00:28:36) Understanding meaning (00:31:44) How do LLMs work? (Part 1) (00:36:25) Sponsors: Omneky | Squad (00:38:12) How do LLMs work? (Part 2) (00:44:01) Post-training (00:51:09) Simulation (01:04:06) Regulation (01:08:53) What makes AI a paradigm shift (01:11:51) Compute limits (01:20:07) Sleeper agents (01:23:16) Surface area of models (01:25:49) AI regulation (01:27:35) AI in medicine (01:29:56) AGI, superintelligence (01:37:04) Competition in the foundation model space (01:40:57) The scaling laws (01:44:31) The AGI convergence (01:45:35) Bets on the future of AI (01:48:20) Outro
Explore the fusion of AI and computational chemistry with University of Queensland's researcher, Tim Duignan. Learn about transforming our understanding of electrolytes, the art of simulating physical processes using neural networks, and the potential of AI in scientific breakthroughs. Discover Tim's journey creating AI models for complex system predictions and join the discussion on advancing AI's role in future scientific discoveries. Apply to join over 400 founders and execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj RECOMMENDED PODCAST: Byrne Hobart, the writer of The Diff, is revered in Silicon Valley. You can get an hour with him each week. See for yourself how his thinking can upgrade yours. Spotify: https://open.spotify.com/show/6rANlV54GCARLgMOtpkzKt Apple: https://podcasts.apple.com/us/podcast/the-riff-with-byrne-hobart-and-erik-torenberg/id1716646486 SPONSORS: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist. CHAPTERS: (00:00:00) About the Show (00:02:47) Introduction (00:04:09) Why electrolyte solutions are important (00:06:53) What properties are we trying to predict with electrolyte solutions? (00:09:33) Battery fires (00:13:38) Molecular dynamics (00:16:40) Time step (00:18:51) Scaling (00:23:09) Sponsors: Oracle | Brave (00:25:17) Decoherence (00:27:23) Neural Network Potentials (00:31:04) How big are the models? (00:35:46) What architecture is used? (00:38:12) Equivariance (Part 1) (00:42:29) Sponsors: Omneky | Squad (00:44:15) Equivariance (Part 2) (00:44:16) AlphaFold3 (00:46:52) Zero-shot latent space communication (00:48:21) What is coarse graining? (00:54:31) How to know if there is no crystallization (00:56:53) What is the role of water in the simulation? (01:01:25) Crystallization (01:05:26) Matching surfaces (01:09:32) Self-ionization of water (01:13:22) Active learning (01:16:41) Temperature (01:19:20) Ice and water (01:21:12) Scaling up the model (01:25:21) Big tech singularity (01:27:54) China is not far behind (01:29:15) Safety concerns (01:31:16) KANs (01:34:36) The future of scientific progress (01:39:28) The art of discovery (01:43:02) One model to rule them all (01:47:46) AGI, its risks and benefits (01:50:21) Power vs. Generality (01:53:01) Generality for Utility (01:53:40) Outro
Dive into the future of medicine with Google researchers Khaled Saab and Vivek Natarajan, discussing the breakthroughs in AI for healthcare. Discover how AI doctors may soon provide high-quality medical advice, enhancing global access to healthcare. Learn about the innovative use of large language models in medical applications and the potential for AI to outperform human doctors. Listen as we explore the significance of AI's role in healthcare and its implications for future medical practices, featuring insights from leaders in AI research. SPONSORS: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist. RECOMMENDED PODCAST: Byrne Hobart, the writer of The Diff, is revered in Silicon Valley. You can get an hour with him each week. See for yourself how his thinking can upgrade yours. Spotify: https://open.spotify.com/show/6rANlV54GCARLgMOtpkzKt Apple: https://podcasts.apple.com/us/podcast/the-riff-with-byrne-hobart-and-erik-torenberg/id1716646486 CHAPTERS: (00:00:00) About the Show (00:04:34) Introduction (00:06:35) Flamingo (00:11:50) Importance of data quality (00:13:29) Amy: AI doctor (00:18:44) Simulation Learning Environment (00:23:26) Sponsors: Oracle | Brave (00:25:34) Training the Agents (00:27:29) Tens of thousands of data points (00:30:35) How to incorporate new knowledge (00:33:21) MedGemini (00:34:51) Sponsors: Omneky | Squad (00:36:38) Uncertainty guided search (00:39:29) Generalist models (00:41:16) MedGemini, Gemini, multimodal, medical images (00:44:57) Future work, integration, consolidation (00:46:00) Cost of AI (00:52:38) When will AI Doctors be Deployed? (00:58:22) The Speed of Trust (00:59:58) Societal Acceptance of AI Doctors (01:02:06) Uncertainty-Guided Search (01:06:02) Med-Gemini: Chest X-Rays and CT Scans (01:17:38) AI Scientist (01:20:01) What are the principles at play? (01:22:58) What should we do about AI? (01:28:24) LLM for democratizing access to care (01:34:22) Final Message (01:35:38) Closing (01:36:45) Outro
Dive into an accessible discussion on AI safety and philosophy, technical AI safety progress, and why catastrophic outcomes aren't inevitable. This conversation provides practical advice for AI newcomers and hope for a positive future. Consistently Candid Podcast : https://open.spotify.com/show/1EX89qABpb4pGYP1JLZ3BB SPONSORS: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist. Recommended Podcast: Byrne Hobart, the writer of The Diff, is revered in Silicon Valley. You can get an hour with him each week. See for yourself how his thinking can upgrade yours. Spotify: https://open.spotify.com/show/6rANlV54GCARLgMOtpkzKt Apple: https://podcasts.apple.com/us/podcast/the-riff-with-byrne-hobart-and-erik-torenberg/id1716646486 CHAPTERS: (00:00:00) About the Show (00:03:50) Intro (00:08:13) AI Scouting (00:14:42) Why arent people adopting AI more quickly? (00:18:25) Why dont people take advantage of AI? (00:22:35) Sponsors: Oracle | Brave (00:24:42) How to get a better understanding of AI (00:31:16) How to handle the public discourse around AI (00:34:02) Scaling and research (00:43:18) Sponsors: Omneky | Squad (00:45:03) The pause (00:47:29) Algorithmic efficiency (00:52:52) Red Teaming in Public (00:55:41) Deepfakes (01:01:02) AI safety (01:04:00) AI moderation (01:07:03) Why not a doomer (01:09:10) AI understanding human values (01:15:00) Interpretability research (01:18:30) AI safety leadership (01:21:55) AI safety respectability politics (01:33:42) China (01:37:22) Radical uncertainty (01:39:53) P(doom) (01:42:30) Where to find the guest (01:44:48) Outro
In this episode of the Cognitive Revolution, join us as we dive into a compelling conversation with Josep M. Pujol, Chief of Search at Brave, about the complexities of developing a privacy-focused search engine. Explore how Brave maintains user data privacy while managing over 1 million searches per hour with an AI-powered system. Gain insights into the significance of human evaluation in AI and learn about the potential of the Brave Search API. Don't miss the shared Google collab notebook link in the show notes! 🔥 Apply to join over 400 founders and Execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj Google collab notebook : https://colab.research.google.com/drive/1AxQD-bDePl1l90A_gwvfAGXBIl92ERKy#scrollTo=WrhGZsvbxZy8 SPONSORS: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ Recommended Podcast: Byrne Hobart, the writer of The Diff, is revered in Silicon Valley. You can get an hour with him each week. See for yourself how his thinking can upgrade yours. Spotify: https://open.spotify.com/show/6rANlV54GCARLgMOtpkzKt Apple: https://podcasts.apple.com/us/podcast/the-riff-with-byrne-hobart-and-erik-torenberg/id1716646486 CHAPTERS: (00:00:00) Introduction (00:05:46) Brave (00:07:52) How Brave collects data (00:10:45) The problem is not the data (00:14:02) How Brave builds its index (00:16:36) PageRank (00:21:07) Sponsors: Oracle | Brave (00:23:14) Brave Search (00:26:26) Hardware improvements (00:28:33) Language models (00:34:17) Noise reduction in vertical search (00:36:50) Fine-tuning models (00:43:09) Sponsors: Squad | Omneky (00:44:55) Ensemble approach (00:58:00) The future of the web (01:03:30) The business side of this (01:09:22) Brave Search users (01:14:21) Brave Search API vs. Google (01:20:00) Brave Search API Pricing (01:23:26) Brave Search API Use Cases
Dive into the world of AI investments with Eric Vishria of Benchmark and Sergiy Nesterenko of Quilter. Explore the future of AI in hardware design, the strategies for venture capital investment in the AI era, and the impact on society. Discover why Benchmark has yet to invest in foundation model companies and the significance of solving enduring problems in this dynamic field. Join us for an eye-opening discussion on the intersection of AI technology and business innovation. 🔥 Apply to join over 400 founders and Execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj SPONSORS: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ Recommended Podcast - The Riff with Byrne Hobart Byrne Hobart, the writer of The Diff, is revered in Silicon Valley. You can get an hour with him each week. See for yourself how his thinking can upgrade yours. Spotify: https://open.spotify.com/show/6rANlV54GCARLgMOtpkzKt Apple: https://podcasts.apple.com/us/podcast/the-riff-with-byrne-hobart-and-erik-torenberg/id1716646486 CHAPTERS: (00:00:00) Introduction (00:10:12) The Idea Maze (00:12:28) Disruptive Approach (00:15:47) Sparse reward problem (00:18:26) Sponsors: Oracle | Brave (00:20:34) Reliability of the reward signal (00:28:12) Model size and compute (00:30:14) Simulation methods (00:35:48) Superhuman circuit board design (00:38:53) Sponsors: Squad | Omneky (00:40:38) What does the future of circuit board design look like? (00:43:11) How do I make money in AI? (00:46:18) What is cutting edge? (00:48:34) Researchers vs. engineers (00:50:51) Call for startups
In this episode of the Cognitive Revolution, Nathan engages in a critical dialogue with Flo Crivello on the trajectory of AI development. They touch upon the imminent arrival of AGI, the potential risks of a US-China AI arms race, and the complexities of AI safety and international cooperation. Explore their perspectives on regulation, technological progression, and the ethical dilemmas facing the AI community. This conversation is essential for anyone interested in understanding the challenges at the intersection of AI technology and global politics. 🔥 Apply to join over 400 founders and Execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj SPONSORS: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ Recommended Podcast - The Riff with Byrne Hobart Byrne Hobart, the writer of The Diff, is revered in Silicon Valley. You can get an hour with him each week. See for yourself how his thinking can upgrade yours. Spotify: https://open.spotify.com/show/6rANlV54GCARLgMOtpkzKt Apple: https://podcasts.apple.com/us/podcast/the-riff-with-byrne-hobart-and-erik-torenberg/id1716646486 CHAPTERS: (00:00:00) Introduction (00:11:14) GPT-4.0 (00:14:56) AI arms race (00:18:23) Devon and GitHub workspaces (00:20:08) Sponsors: Oracle | Brave (00:22:16) The AGI discourse (00:25:29) The invisible protection (00:29:33) AI arms race (00:34:41) Stalling out (00:38:33) P(doom) (00:43:38) China (00:43:38) Sponsors: Squad | Omneky (00:45:24) Government (00:48:05) What should we do? (00:51:35) Open sourcing models (00:54:17) Manhattan Project for Alignment (00:57:26) Current State of Play (01:01:39) How much more mundane utility can we get? (01:04:54) How much of what we are building is future proof? (01:07:41) Adoption, acceleration, hyperscaling, pause (01:10:17) OpenAI leadership (01:14:32) Future of Live Players (01:17:38) Big Tech Singularity (01:21:30) AGI is Coming
Join us for an engaging chat with Logan Kilpatrick where we discuss the latest AI developments and Google's strategy in pushing the boundaries of artificial intelligence. Learn about the competitive state of AI, the groundbreaking Gemini 1.5 Flash model, and get a glimpse into the future of AI fine-tuning. Gain insights on Google DeepMind's research and its impact, the differences between various Google AI products, and debunking AI rumors. Whether you're an AI enthusiast or a professional in the field, this conversation with an AI industry insider offers valuable perspectives on applying AI in business and understanding the rapid advancements in this dynamic sector. 🔥 Apply to join over 400 founders and Execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj SPONSORS: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ Recommended Podcast - The Riff with Byrne Hobart Byrne Hobart, the writer of The Diff, is revered in Silicon Valley. You can get an hour with him each week. See for yourself how his thinking can upgrade yours. Spotify: https://open.spotify.com/show/6rANlV54GCARLgMOtpkzKt Apple: https://podcasts.apple.com/us/podcast/the-riff-with-byrne-hobart-and-erik-torenberg/id1716646486 CHAPTERS: (00:00:00) Introduction (00:07:29) Google culture (00:11:01) DeepMind and Google (00:15:49) Native multimodality (00:18:17) Sponsors: Oracle | Brave (00:20:24) What to focus on (00:23:40) LMSYS leaderboard (00:27:46) Rumors (00:36:32) AI is too cheap to meter (00:39:17) Open AI Assistant (00:40:14) Sponsors: Squad | Omneky (00:41:59) Dogfooding (00:48:58) AI Studio (00:52:28) Native Multimodal (00:55:57) VideoFX (01:01:09) Competition (01:04:07) What to do with AGI (01:09:19) Closing
Tune in to today's special episode airing a recent panel with the founders of Scale AI, Anthropic, and AI Fund who gathered in Washington DC to discuss China as an adversary. They argue that the papers out of Tsinghua University are just as impressive as those coming out of American universities. China is just as creative, but maybe even more motivated. While discussions of regulations have encompassed certain restraints, Alex Wang, Andrew Ng, and Jack Clark argue that we’re not moving fast enough (moderated by US senator Cory Booker). This session was recorded live at The Hill & Valley Forum in 2024, a private bipartisan community of lawmakers and innovators committed to harnessing the power of technology to address America's most pressing national security challenges. The Hill & Valley podcast is part of the Turpentine podcast network. Learn more: www.turpentine.co 🔥 Apply to join over 400 founders and Execs in the Turpentine Network: https://hmplogxqz0y.typeform.com/to/JCkphVqj RECOMMENDED PODCAST - The Riff with Byrne Hobart Byrne Hobart, the writer of The Diff, is revered in Silicon Valley. You can get an hour with him each week. See for yourself how his thinking can upgrade yours. Spotify: https://open.spotify.com/show/6rANlV54GCARLgMOtpkzKt Apple: https://podcasts.apple.com/us/podcast/the-riff-with-byrne-hobart-and-erik-torenberg/id1716646486 SPONSORS: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ CHAPTERS: (00:00) Intro (03:29) Assembling the founders of Anthropic, Scale AI, and AI Fund (04:45) Predictions for AGI (08:21) Navigating AI innovation amidst regulation (16:15) Global AI competition and the urgency of Innovation (24:34) Empowering future generations
Tune in to this special episode of the Cognitive Revolution for AI scouting report. We cover the state of the art in AI applications for medicine, key AI concepts, and how these technologies could influence society. SPONSORS: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ RECOMMENDED PODCAST - The Riff with Byrne Hobart Byrne Hobart, the writer of The Diff, is revered in Silicon Valley. You can get an hour with him each week. See for yourself how his thinking can upgrade yours. Spotify: https://open.spotify.com/show/6rANlV54GCARLgMOtpkzKt Apple: https://podcasts.apple.com/us/podcast/the-riff-with-byrne-hobart-and-erik-torenberg/id1716646486 CHAPTERS: (00:00:00) Introduction (00:06:13) Current State of the Art (00:08:34) Medicine (00:13:49) AI limitations (00:17:01) AI capabilities (00:17:02) Sponsors: Oracle | Brave (00:19:09) How AI works (00:24:05) Information processing (00:28:51) Curated data sets (00:32:52) Sponsors: Squad | Omneky (00:34:38) Transformer (00:37:11) Scaling (00:39:59) Emergence (00:44:03) Grokking (00:50:30) Best practices for business (00:53:38) Live Players (00:58:33) What to Watch (01:00:35) Final Thoughts
In this groundbreaking episode of the Cognitive Revolution, we explore the intersection of AI and biology with expert Amelie Schreiber. Learn about the advances in drug design, protein network engineering, and the unfolding AI revolution in scientific discovery. Discover the implications for human health, longevity, and the future of biological research. Join us as we delve into an exciting conversation that may redefine our understanding of biology and medicine. Further links : Follow Amelie here : https://x.com/amelie_iska, https://huggingface.co/AmelieSchreiber Read Amelie's blog here : https://huggingface.co/blog/AmelieSchreiber/protein-optimization-and-design SPONSORS: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ CHAPTERS: (00:00:00) Introduction (00:04:53) Introduction to Amelie Schreiber and the Podcast (00:08:59) Understanding Protein Interactions (00:11:45) Traditional Methods vs. AI Approaches (00:13:51) Molecular Dynamics and AI Models (00:18:02) AlphaFold and Protein Structure Prediction (00:18:43) Sponsors: Oracle | Brave (00:20:51) Protein Dynamics and New AI Models (00:32:36) Sponsors: Squad | Omneky (00:34:22) Challenges in Protein Interaction Models (00:44:44) Generalization and Data Splitting in AI Models (00:48:43) Advanced AI Models for Protein Complexes (00:52:25) Practical Applications of AI in Biochemistry (01:01:53) Designing Protein Sequences with Ligand and PNN (01:05:19) Binder Design and Fold Conditioning (01:08:48) Challenges and Bottlenecks in Drug Discovery (01:16:09) Adoption and Accessibility of New Technologies (01:21:04) Future Prospects and Ethical Considerations (01:37:08) The Role of AI Agents in Biological Research (01:40:18) Balancing Innovation and Safety in Biotechnology
Tune in as we explore the remarkable traits of Anthropic's Claude AI with Developer Relations Lead Alex Albert. Delve into the ethical considerations, responsible development standards, and the exceptional capabilities that set Claude apart. Gather insights on the AI industry's race to the top and find out about Anthropic's upcoming releases. Whether you're an AI enthusiast or a tech-savvy developer, this podcast offers a thought-provoking discussion on the future of ethical AI. SPONSORS: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ CHAPTERS: (00:00:00) Introduction (00:06:15) Opus 3 (00:10:43) What are people not yet appreciating about the latest Claude models? (00:16:02) Why is Claude the best writer of all the language models? (00:18:38) Claude's subjective experience (00:18:39) Sponsors: Oracle | Brave (00:20:46) The moral status of Claude (00:25:24) The testing process (00:27:54) Anthropic's strategy (00:31:56) Sponsors: Squad | Omneky (00:33:42) Current state of competition (00:36:18) Convergence at the API level (00:42:32) Tool use (00:46:32) Fine-tuning (00:49:10) Best practices for app developers (00:56:09) Jailbreaking new models
Dive into the intricacies of AI ethics and safety concerns as we dissect the recent resignations of AI Safety Team from OpenAI. In this stimulating conversation, we unpack the challenges of aligning leadership vision with safety culture, explore legal implications of non-disparagement clauses, and discuss the future of AI alignment and superintelligence. Tune in for a thought-provoking analysis on the responsible path forward in AI development. SPONSORS: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention "Turpentine" to skip the waitlist. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ CHAPTERS: (00:00:00) Introduction (00:04:46) Compute resources (00:08:15) The straw that broke the camels back (00:13:35) Sponsors: Oracle | Brave (00:15:42) Dwarkesh interview with John Schulman (00:19:14) What should we do? (00:22:47) Strengthening the bill (00:25:11) Non-Disparagement Clauses (00:30:48) Sponsors: Squad | Omneky (00:32:33) Safety measures (00:39:05) SOFONs (00:43:22) AI movie concept (00:47:24) Forking Paths (00:49:44) Simulation Hypothesis (00:53:56) Doomer
Dive into a critical analysis of AI's rapidly evolving realm with Zvi Mowshowitz. Discover our take on Google's I-O event highlights, OpenAI's spring event, the big tech and startup AI dynamics, and the significant shifts in OpenAI's safety team. Gain insights into the competitive landscape, technological advancements, and strategic challenges that shape today's AI industry, as we explore the future's uncertainties and the potential for change. Part 2 is coming soon. SPONSORS: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention "Turpentine" to skip the waitlist. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ CHAPTERS: (00:00:00) Introduction (00:03:01) Welcome to the Cognitive Revolution (00:06:35) The Reality of AI Demos: Hype vs. Practicality (00:09:30) Integrations and Universal Assistants: The Future of AI (00:15:39) Sponsors: Oracle | Brave (00:17:47) The Ethical and Social Implications of AI (00:31:53) AI's Role in Addressing Loneliness and Social Engagement (00:33:24) Sponsors: Squad | Omneky (00:35:12) The Future of AI: Subscription Models and Ethical Considerations (00:44:13) Exploring AI's Ethical Balancing Act (00:46:14) The Ethics of Personal AI Relationships (00:52:13) The Future of AI: Customization and Personalization (00:56:02) The Role of Multiple AI Friends in a Diverse Ecosystem (01:00:23) The Impact of AI on Market Dynamics and Competition (01:11:22) Big Tech's Dominance and Startup Ecosystem Challenges (01:22:54) Navigating the Tech Landscape: Opportunities and Challenges (01:25:47) The Importance of Future-Proofing in AI Development (01:28:26) Legal and Compliance Challenges in AI Implementation (01:30:43) Venture Capital and AI: Navigating the Investment Landscape (01:40:56) The Future of Employment in the Age of AI (01:50:15) The Departures from OpenAI's Safety Team: Implications and Insights
Dive into an in-depth conversation with Nathan and Robert Wright as they discuss AI's transformative potential, mechanistic interpretability, and the sobering realities of AI alignment research. Learn about the defensive strategies and safety measures necessary for managing advanced AI risks in an open source world. Don't miss the insights on AI-powered VR, and be sure to check out part one on the non-zero feed. Checkout the Part 1 of the conversation here : https://www.youtube.com/watch?v=s8bgB8TCdBs SPONSORS: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention "Turpentine" to skip the waitlist. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ CHAPTERS: (00:00:00) Introduction (00:07:13) AI in Governance (00:11:08) Sci-fi doomer (00:13:58) Sponsors: Oracle | Brave (00:16:05) The frontier models (00:20:22) Emergent behavior (00:23:48) Theory of mind (00:28:09) Mechanistic interpretability (00:34:12) Sponsors: Squad | Omneky (00:38:12) AI Alignment Techniques (00:42:38) The Sweet Spot of AI
Dive into the world of frontier AI development with California State Senator Scott Wiener's intricate detailing of SB 1047 bill. This podcast explores the delicate balance between accelerating AI innovation and ensuring stringent safety protocols, including potential implications for advanced AI models. Learn about the debates on government involvement, the need for independent third-party testing, and Senator Wiener's commitment to a measured approach to AI regulation. Join us for a thought-provoking discussion on the complexities of legislating emerging technologies. SPONSORS: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention "Turpentine" to skip the waitlist. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ CHAPTERS: (00:00:00) Introduction (00:05:47) Senator Scott Wiener (00:09:38) AI policy (00:13:56) AI worldview (00:16:20) Sponsors: Oracle | Brave (00:18:28) Burden on Developers (00:26:10) Developers reaction (00:28:43) Big tech companies opposing the bill (00:31:09) Open source models (00:34:57) Sponsors: Squad | Omneky (00:36:45) Illegal activities (00:41:15) Penalties (00:44:33) Third party testing (00:48:33) Transparency requirements for model development (00:53:07) Closing thoughts
Discover h​ow Adam Majmudar embarked on an exceptional journey to create the TinyGPU from scratch, with no experience in GPU design. This insightful podcast follows Adam's process from learning to implementation, highlighting the progressive contributions of countless engineers and the accelerating role of AI in the learning journey. Experience the unfolding of GPU architecture and gain a deeper appreciation for the technology driving today's AI advancements. RECOMMENDED PODCAST:  The AI Daily Brief If you’re looking for an edge to stay up to date on everything AI, subscribe to Nathaniel Whittemore's AI Daily Brief which delivers tight episodes covering all things AI from legislation to new technologies to the philosophical debates around generalized intelligence.  Spotify:  https://open.spotify.com/show/7gKwwMLFLc6RmjmRpbMtEO Apple: https://podcasts.apple.com/us/podcast/the-ai-daily-brief-formerly-the-ai-breakdown/id1680633614 SPONSORS: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention "Turpentine" to skip the waitlist. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ CHAPTERS: (00:00:00) Introduction (00:04:34) Intro (00:07:42) Learning Resources (00:12:11) What is the process of getting your chip back? (00:14:38) What is the scope of the project? (00:17:18) Sponsors: Oracle | Brave (00:19:25) Prioritization (00:23:19) Memory management (00:33:19) What instructions to include? (00:38:03) Sponsors: Squad | Omneky (00:40:42) Registers (00:48:29) Memory Limitations (00:57:51) Compute Pattern (01:01:14) Dispatcher (01:07:50) How does it get translated into hardware? (01:21:07) Compute Core Execution (01:24:57) The Fetcher (01:27:07) Memory controllers (01:37:49) Simulating the design (01:41:09) What did you learn? (01:50:36) Conclusion
Dive into the nuanced debate over California's SB 1047 AI legislation with Nathan Calvin, Dean Ball, and Steve Newman. Our expert panel discussion explores the bill's intent, dispels misconceptions, and debates its potential impact on technology and regulation. Learn about AI's tail risks, the role of government, and hear suggestions for improving the legislation. Share your thoughts and join the conversation around shaping a positive AI future. You can reach out and share your thoughts by using the contact form here : https://www.cognitiverevolution.ai/contact/ RECOMMENDED PODCAST:  The AI Daily Brief If you’re looking for an edge to stay up to date on everything AI, subscribe to Nathaniel Whittemore's AI Daily Brief which delivers tight episodes covering all things AI from legislation to new technologies to the philosophical debates around generalized intelligence.  Spotify:  https://open.spotify.com/show/7gKwwMLFLc6RmjmRpbMtEO Apple: https://podcasts.apple.com/us/podcast/the-ai-daily-brief-formerly-the-ai-breakdown/id1680633614 SPONSORS: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention "Turpentine" to skip the waitlist. CHAPTERS: (00:00:00) Introduction (00:05:45) Opinions (00:11:57) The Bill (00:17:05) Elevated discussion (00:18:51) Sponsors: Brave | Omneky (00:20:18) AI Doctor (00:22:55) Centralized Regulator (00:26:29) SB 1047 (00:27:47) Critical infrastructure (00:31:51) Should we regulate? (00:39:00) Sponsors: Squad (00:40:28) Safety standards for training (00:46:09) What is 10^26 flops? (00:52:10) Regulating general purpose technology (00:53:42) AI regulation (00:58:31) Societal adaptation (01:01:18) AI safety (01:04:20) AI regulations (01:07:19) The current state of the industry (01:10:08) What industry wants changed (01:25:42) Safety is hard to legislate (01:33:06) How to decide the trajectory of AI? (01:45:52) Testing, Transparency, Whistleblower Provision (01:55:17) Closing thoughts
Join us as we explore the future of work in the age of artificial intelligence. Nathan shares essential strategies for college students, especially in computer science, to succeed in a landscape dominated by AI tools. Discover the most important skills to develop, how to use AI for efficiency, and insights into AI-driven task automation. Get valuable advice on incorporating AI into your work and resources for beginning your journey into AI professionalism. RECOMMENDED PODCAST:  The AI Daily Brief If you’re looking for an edge to stay up to date on everything AI, subscribe to Nathaniel Whittemore's AI Daily Brief which delivers tight episodes covering all things AI from legislation to new technologies to the philosophical debates around generalized intelligence.  Spotify: https://open.spotify.com/show/7gKwwMLFLc6RmjmRpbMtEO Apple: https://podcasts.apple.com/us/podcast/the-ai-daily-brief-formerly-the-ai-breakdown/id1680633614 SPONSORS: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention "Turpentine" to skip the waitlist. CHAPTERS: (00:00:00) Introduction (00:05:18) AI Closing in on Human Experts (00:08:48) Limitations of Current AI (00:13:16) AI's Speed and Availability Advantages (00:16:26) AI's Evolutionary Advantages (00:19:01) Viewing AI as Entry-Level Employees (00:20:38) Sponsors: Brave | Omneky (00:22:05) Modes of AI Production (00:25:09) Agent Mode: The Best of Both Worlds (00:30:08) Prompting Techniques (00:32:17) AI Coding Assistants (00:37:01) Automating Processes with AI (00:37:55) Sponsors: Squad (00:39:23) University Curriculum and AI Tools (00:44:50) AI-Generated Music and Video Editing (00:46:04) Introduction to AI Tools (00:47:11) Devon AI Agent (00:49:26) Waymark AI Evaluation Example (00:52:51) Setting the Context (00:54:30) Mantras for AI Adoption (00:56:48) Recommended AI Thought Leaders (00:59:53) Setting up AI Training (01:04:25) Avoiding Over-engineering Solutions
Dive into the accelerating world of artificial intelligence with our latest podcast episode. We discuss the latest AI advancements and the challenges leaders face in keeping up, potential societal backlashes, and regulatory concerns. Explore the possibilities and immerse yourself in a strategic AI scouting report from our conversation with the 80,000 Hours podcast. Listen now for insights on AI's role in various sectors and the necessity for informed discourse. RECOMMENDED PODCAST:  The AI Daily Brief If you’re looking for an edge to stay up to date on everything AI, subscribe to Nathaniel Whittemore's AI Daily Brief which delivers tight episodes covering all things AI from legislation to new technologies to the philosophical debates around generalized intelligence.  Spotify:  https://open.spotify.com/show/7gKwwMLFLc6RmjmRpbMtEO Apple: https://podcasts.apple.com/us/podcast/the-ai-daily-brief-formerly-the-ai-breakdown/id1680633614 SPONSORS: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention "Turpentine" to skip the waitlist. CHAPTERS: (00:00:00) Introduction to the Interview with Nathan LeBenz (00:05:50) Exploring AI's Capabilities and Ethical Considerations (00:14:43) Sponsors: Brave | Omneky (00:16:10) AI's Impact on Medicine and Healthcare Innovations (00:36:29) Sponsors: Squad (00:37:56) Predictions and Expectations for Next-Gen AI Applications (00:57:33) Exploring the Frontier of AI and Robotics (00:58:57) The Leap in AI: From Language Models to Physical Robots (01:00:21) GPT-4's Remarkable Achievements and Future Prospects (01:03:55) Navigating the Discourse on AI Safety and Regulation (01:12:53) The Polarization of AI Discourse: A Deep Dive (01:16:17) The Impact of Social Media on AI Conversations (01:34:53) Exploring the Dynamics of AI Regulation and Public Perception (01:49:27) Navigating AI's Rapid Progress and Public Perception (01:50:55) Current State of AI Legislation and Industry Response (01:53:31) The Challenge of Regulating AI and Ensuring Safety (02:03:37) The Impact of AI on Information and Social Dynamics (02:19:18) AI in Warfare: Ethical Considerations and Future Prospects (02:27:25) Recommendations for Keeping Up with AI Developments (02:33:45) Final Thoughts and Advice for AI Enthusiasts and Professionals
In this episode from new podcast Emergent Behavior, host @Ate-a-Pi interviews the co-founders of Prophetic AI to learn how they're using AI to facilitate lucid dreaming. Prophetic had come up in the recent Cognitive Revolution conversation with Dean W. Ball about brain computer interfaces, and Nathan had them on the list of companies to invite on the show, so it was really fun to discover that Ate-a-Pi had already done an interview with them right around the same time. -- Subscribe to Emergent Behavior: Spotify: https://open.spotify.com/show/2KfbuKL7iqIfbpY31PHtEg Apple: https://podcasts.apple.com/us/podcast/emergent-behavior/id1735023473 YouTube: https://www.youtube.com/@EmergentBehaviorPod & Check out Nathan's new chatbot on www.cognitiverevolution.ai -- RECOMMENDED PODCAST:  The AI Daily Brief If you’re looking for an edge to stay up to date on everything AI, subscribe to Nathaniel Whittemore's AI Daily Brief which delivers tight episodes covering all things AI from legislation to new technologies to the philosophical debates around generalized intelligence.  Spotify: https://open.spotify.com/show/7gKwwMLFLc6RmjmRpbMtEO Apple: https://podcasts.apple.com/us/podcast/the-ai-daily-brief-formerly-the-ai-breakdown/id1680633614 -- SPONSORS: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist. -- TIMESTAMPS: (00:00) Intro (00:43) Diving Deep with Prophetic AI (02:18) Exploring Lucid Dreaming with Halo (05:08) The Technical Marvel Behind Halo (07:25) A Deep Dive into Lucid Dreaming Experiences (13:15) Sponsor: Brave | Omneky (14:42) Do All People Have Lucid States? (32:19) Sponsor: Squad (41:05) Building the Neural Model for Dream Control (43:15) Exploring the Intersection of EEG, fMRI, and Ultrasound in Lucid Dreaming (43:48) The Journey from Open Source Data to Targeted Brain Stimulation (47:08) Collaboration with the Donders Institute and the Future of Lucid Dreaming Research (48:40) The Role of Machine Learning and AI in Enhancing Data Collection and Analysis (50:04) From Theory to Practice: Implementing Transcranial Focused Ultrasound (TFUS) (53:51) Personalizing the Lucid Dreaming Experience through Reinforcement Learning (1:16:18) Looking Ahead: The Potential and Challenges of Neurostimulation Technology (1:22:55) Addressing the Skeptics: The Debate Over Natural vs. Technologically Induced Lucid Dreaming
In this podcast, we dive into the fascinating world of brain-computer interfaces with Dean W. Ball. We learn about the latest technologies, from non-invasive EEG and ultrasound stimulation to invasive Neuralink implants. We also discover the state-of-art tools, technical challenges, and the big questions around thought dimensionality, ethical considerations, and the societal impact of brain reading and writing. SPONSORS: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ Plumb is a no-code AI app builder designed for product teams who care about quality and speed. What is taking you weeks to hand-code today can be done confidently in hours. Check out https://bit.ly/PlumbTCR for early access. Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist. CHAPTERS: (00:00:00) Introduction (00:04:00) Background (00:06:50) Journey to Neurotech Interest (00:07:56) Concept of Human-Machine Merge (00:12:01) Impact of Language Models (00:15:53) Sponsors: Brave / Omneky (00:17:20) Adoption of AI Tools like ChatGPT (00:22:33) Neural Technologies as Sensor Fusion (00:26:03) Brain Signals and EEG Devices (00:29:09) Electrodes and Electrical Field Measurement (00:37:04) Sponsors: Plumb / Squad (00:39:01) Neurofeedback and Brain Training (00:48:44) The Rise of Neural Networks (00:57:29) Shared Latent Space for Brain Signals (01:09:18) Trajectory of Brain-Computer Interface (01:14:44) Near-Term Possibilities (01:26:25) Limitations of Brain-Computer Interfaces (01:38:31) Stimulating Brain Activity (01:46:08) Policy Considerations (01:52:02) Solved World and Artificial Constraints (02:04:27) Acclimating to Merge Technology (02:08:33) Advice for Understanding Neural Interfaces
In this episode from the Autopilot podcast, Sergiy Nesterenko, founder of Quilter (backed by Benchmark), discusses designing PCB circuitboards end-to-end using reinforcement learning. "Autopilot" host Will Summerlin and Nesterenko cover how current PCB boards are designed and how Quilter’s tech stack enables faster board design, what better circuit boards enable in the future, their GTM and where they are seeing most market pull right now, and much more. Subscribe to Autopilot: Spotify: https://open.spotify.com/show/6YQZkKHN7EP2yWedAvSxBC?si=18377c69a2804333&nd=1&dlsi=18fee5e95b284d02 Apple: https://podcasts.apple.com/us/podcast/autopilot-with-will-summerlin/id1738163836 YouTube: https://www.youtube.com/@AutopilotwithWillSummerlin Check out Nathan's new chatbot on www.cognitiverevolution.ai SPONSORS: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ Plumb is a no-code AI app builder designed for product teams who care about quality and speed. What is taking you weeks to hand-code today can be done confidently in hours. Check out https://bit.ly/PlumbTCR for early access. Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist. LINKS: Quilter: https://www.quilter.ai/ Autopilot Ventures: https://www.apv.vc/ X/SOCIAL: @labenz (Nathan) @WSummerlinAI (Will) @sergiynest (Sergiy) @quilterai (Quilter) TIMESTAMPS: (00:00) Intro & Sergiy’s Background (04:31) What Sergiy learned from SpaceX (05:53) Founding thesis of Quilter and Quilter’s journey (06:57) Where would one find circuit boards? (08:11) What is the process of designing a circuit board? (09:39) Design process today with Quilter (14:34) Sponsor: Omneky (16:01) Quilter’s thesis and designing more complex circuits (18:25) How much are humans currently paid for board design (19:41) Labor dynamics in board design (20:30) Do most companies have board designers in-house? (21:14) Incentive structure (22:44) What does a high-performance circuit board look like vs low-performance? (26:37) Quilter’s technology stack (29:15) Sponsor: Plumb | Squad (31:15) How Quilter can grow with scale? (33:50) Where is circuit manufacturing happening (37:17) What other parts of knowledge work can be solved with reinforcement learning (41:03) GTM and who Quilter is selling to (42:48) Pricing (44:04) Where Quilter is seeing the most market pull right now (45:21) What makes Quilter an exciting company to work at or invest (47:14) The effects of closed research in private companies for the industry (49:25) Open source vs closed source (51:14) What Sergiy would advise to himself in his early founder (53:59) What drew Sergiy to working with Benchmark (56:19) Wrap
Google DeepMind researchers Keerthana Gopalakrishnan and Ted Xiao discuss their latest breakthroughs in AI robotics. Including models that enable robots to understand novel objects, learn from human demonstrations, and operate under ethical constraints. The conversation covers six groundbreaking papers that showcase rapid progress towards general-purpose robotics. SPONSORS: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ Plumb is a no-code AI app builder designed for product teams who care about quality and speed. What is taking you weeks to hand-code today can be done confidently in hours. Check out https://bit.ly/PlumbTCR for early access. Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist. CHAPTERS : (00:00) Introduction (04:44) The Future of Robotics (14:40) Sponsors : Brave / Omneky (16:04) Inputs and Outputs (24:03) A Leap Towards Generalist Robots (32:08) Sponsors : Plumb / Squad (33:52) Learning in Robotics (41:12) Learning from On-the-Fly Examples (41:57) Annotating Robot Actions (50:17) Scaling and Safety (01:03:05) Learning to Learn Faster (01:08:43) Zero-Shot Learning (01:15:15) Future Directions
In this episode, we delve into the intricate world of AI inference with cofounders of Firework AI. Discover the strategies behind optimizing AI performance, the importance of balancing latency and throughput, and the nuances of different AI architectures from GPT-3 to Stable Diffusion. Learn about their partnership with Stability AI, their unique focus on reducing total cost of ownership, and their vision for a seamless developer experience. RECOMMENDED PODCAST: How Do You Use ChatGPT with Dan Shipper. Dan Shipper talks to programmers, writers, founders, academics, tech executives, and others to walk through all of their ChatGPT use cases (including Nathan!). They even use ChatGPT together, live on the show. Listen to How Do You Use ChatGPT? from Dan Shipper and the team at Every, wherever you get your podcasts: https://link.chtbl.com/hdyuchatgpt SPONSORS: Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Plumb is a no-code AI app builder designed for product teams who care about quality and speed. What is taking you weeks to hand-code today can be done confidently in hours. Check out https://bit.ly/PlumbTCR for early access. Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist. CHAPTERS : (00:00:00) Introduction (00:08:34) Compute Stack (00:19:23) Fireworks Product Philosophy (00:24:11) Sponsors : Brave / Omneky (00:25:40) Fine-tuning Strategy (00:38:40) Sponsors : Plumb / Squad (00:40:33) NVIDIA Stack Overview (00:47:14) TensorFlow Triton Service (00:55:25) Reduced Precision Advantages (01:03:57) Different Deployment Scenarios (01:08:27) Seeking Intuition on Sharding (01:19:28) Announcing Stability AI Partnership (01:32:00) Closing Remarks
In this episode, we explore the cutting-edge world of AI-powered brain imaging with the MindEye2 Project. Discover how researchers are reconstructing images from fMRI data, offering unprecedented insights into the human mind. We discuss the implications for neuroscience, clinical diagnosis, and the future of AI-assisted brain decoding. RECOMMENDED PODCAST: How Do You Use ChatGPT with Dan Shipper. Dan Shipper talks to programmers, writers, founders, academics, tech executives, and others to walk through all of their ChatGPT use cases (including Nathan!). They even use ChatGPT together, live on the show. Listen to How Do You Use ChatGPT? from Dan Shipper and the team at Every, wherever you get your podcasts : https://link.chtbl.com/hdyuchatgpt SPONSORS: Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Plumb is a no-code AI app builder designed for product teams who care about quality and speed. What is taking you weeks to hand-code today can be done confidently in hours. Check out https://bit.ly/PlumbTCR for early access. Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist. CHAPTERS: (00:00) Introduction (07:24) Evolution of Brain Decoding Tech (10:33) From MindEye1 to MindEye2 (14:12) Sponsor: Omneky (14:43) Foundation Models for Enhanced AI (26:49) Future of Image Reconstruction from Brain Data (34:10) Sponsors: Brave / Plumb / Squad (44:23) Evaluating AI-Generated Reconstructions (48:10) Understanding Semantic Info in the Brain (51:47) Potential and Ethics of Brain Data Usage (57:13) Foundation Models in Neuroscience (01:02:46) Future of Brain-Computer Interfaces
In this episode, Linus Lee, AI product leader at Notion, joins us to discuss his groundbreaking projects and unique approach to exploring AI systems. He shares his toolkit and insights on language model capabilities, along with his vision for the future of AI, which is centered on amplifying human intelligence. Linus inspires listeners to engage deeply with AI and to steer its development in ways that enhance human creativity and agency. RECOMMENDED PODCAST: How Do You Use ChatGPT Dan Shipper talks to programmers, writers, founders, academics, tech executives, and others to walk through all of their ChatGPT use cases (including Nathan!). They even use ChatGPT together, live on the show. Listen to How Do You Use ChatGPT? from Dan Shipper and the team at Every, wherever you get your podcasts. https://link.chtbl.com/hdyuchatgpt SPONSORS: Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Plumb is a no-code AI app builder designed for product teams who care about quality and speed. What is taking you weeks to hand-code today can be done confidently in hours. Check out https://bit.ly/PlumbTCR for early access. Head to Squad to access global engineering without the headache and at a fraction of the cost: head to https://choosesquad.com/ and mention “Turpentine” to skip the waitlist. CHAPTERS : (00:00) Introduction (10:16) AI and Creativity (14:37) Sponsor: Omneky (14:57) AI Research Development (20:05) Bridging Modalities (32:38) Sponsor: Brave / Plumb / Squad (35:36) Transformer Models and Techniques (52:32) Personal AI Research Setup (58:55) Leveraging Language Models for Coding (01:02:05) AI Model Development and Notion AI (01:22:05) Future of AI Models and App Development (01:32:51) Emerging Trends in AI
In this podcast, Nathan and Nick dive deep into the data requirements for achieving Artificial General Intelligence. They explore the current paradigms, the role of data in approximating intelligence, and the scaling trends for GPT models. The discussion covers various datasets, from email and Twitter to YouTube and genomic data, as they analyze the feasibility of reaching the target of 100 trillion high-quality tokens. While the bull case suggests an abundance of data, the bear case highlights the limits on high-quality data, prompting a fascinating exploration of what makes data good for AI and the potential for AI to generate its own data. Sponsors Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off https://www.omneky.com/ The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Head to Squad to access global engineering without the headache and at a fraction of the cost: head to http://choosesquad.com/ and mention “Turpentine” to skip the waitlist. Plumb is a no-code AI app builder designed for product teams who care about quality and speed. What is taking you weeks to hand-code today can be done confidently in hours. Check out https://bit.ly/PlumbTCR for early access. Chapters  (00:00) Introduction (05:04) Scaling Hypothesis of Intelligence (07:32) Is There Enough High Quality Data? (10:19) Algorithms Impacting Data Requirements (17:42) Sponsor : Omneky (18:04) Estimating High Quality Token Requirements (24:07) Astronomy and YouTube Data Scale (29:42) Genomics Data (37:58) Sponsors : Brave / Plumb / Squad (41:16) Code Datasets and Synthetic Data (45:48) The Bear Case: Quality and Usability of Data (50:54) Investment Trends and Compute Efficiency (54:19) Training Run (57:21) Synthetic Data Generation and Self-Play
In this episode, we explore the Chinese AI ecosystem with 'L-squared,' an anonymous tech worker based in Beijing. We discuss major players, model quality, public engagement, regulation, and the US 'chip ban.' Discover the similarities and differences between US and Chinese AI landscapes, and gain a nuanced perspective on the current state of AI in China. USEFUL RESOURCES: Testing Chinese models: Yi-34B-Chat (made by Kai-Fu Lee's team 01.AI) can be tried out via Replicate (https://replicate.com/01-ai/yi-34b-chat) or Hugging Face. You can also use the ChatGLM playground (https://open.bigmodel.cn/trialcenter) and Baidu's ERNIE (https://yiyan.baidu.com/) without a Chinese SIM card. Benchmarking models: SuperCLUE is one of the most prominent benchmarks - the latest results are on GitHub (https://github.com/CLUEbenchmark/SuperCLUE) and the paper explaining the methodology is here (https://arxiv.org/abs/2307.15020). Regulation: Explainer (https://carnegieendowment.org/2023/07/10/china-s-ai-regulations-and-how-they-get-made-pub-90117) from Matt Sheehan; piece (https://www.chinatalk.media/p/how-tight-ai-regs-hurt-chinese-firms) on how genAI regs are affecting Chinese companies. US-China competition: Jeff Ding's work (https://www.tandfonline.com/doi/full/10.1080/09692290.2023.2173633) on the diffusion deficit in S&T; Bloomberg piece (https://www.bloomberg.com/graphics/2023-china-huawei-semiconductor/) on Huawei's semiconductor development efforts. Staying up to date: Sign up to alerts from CSET's Scout tool (https://scout.eto.tech/); subscribe to Concordia AI's AI safety (https://aisafetychina.substack.com/) in China newsletter (disclaimer: I used to work at Concordia!) A 2016 profile (https://chinai.substack.com/p/chinai-37-happy-20th-anniversary) on Microsoft Research Asia by Wang Jingjing, covered in Jeff Ding's ChinAI newsletter SPONSORS: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, instead of...does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off http://www.omneky.com/ The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Head to Squad to access global engineering without the headache and at a fraction of the cost: head to choosesquad.com and mention “Turpentine” to skip the waitlist. Plumb is a no-code AI app builder designed for product teams who care about quality and speed. What is taking you weeks to hand-code today can be done confidently in hours. Check out https://bit.ly/PlumbTCR for early access. TIMESTAMPS: (00:00) Introduction (07:24) China's AI Ecosystem (13:40) Public AI Engagement (17:33) Sponsors : OCI / Omneky (18:50) AI Tools Comparison (35:37) Sponsors : Brave / Squad / Plumb (39:14) AI Regulatory Maze (51:02) AI Performance, Censorship (55:28) Chinese AI Regulations (01:04:37) Tech, Research Role (01:12:11) Global AI Ecosystem (01:23:22) Cultural AI Perspectives (01:29:14) AI Safety, Cooperation
In this episode, Nathan sits down with Andrew Lee, founder of Shortwave, an AI-powered email app that describes itself as “the smartest email app on planet earth.” They discuss Shortwave’s RAG stack, how the AI assistant works, the models Shortwave is using, and much more. This is truly a masterclass in RAG app development. Sponsors :  Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Plumb is a no-code AI app builder designed for product teams who care about quality and speed. What is taking you weeks to hand-code today can be done confidently in hours. Check out https://bit.ly/PlumbTCR for early access. Head to Squad to access global engineering without the headache and at a fraction of the cost: head to choosesquad.com and mention “Turpentine” to skip the waitlist. TIMESTAMPS: (00:00) - Intro (01:07) - Shortwave: AI-Powered Email (06:22) - Genesis of Shortwave (15:25) - Sponsors: Oracle / Omneky (16:46) - Data Processing Pipeline (21:57) - Choosing a Vector Database (26:34) - How the AI Assistant Works (36:24) - Sponsors: Brave / Plumb / Squad (40:53) - Fine-Tuning & Hosting Models (45:11) - Email Automation (47:55) - Email Retrieval (51:44) - Optimizing AI Performance (53:20) - Safety & Embedded Ethics (01:04:51) - Strategic Product Launches (01:09:58) - Inbox Management (01:12:24) - The Future of Collaborative AI (01:18:54) - Scaling Personalized Outreach (01:26:04) - Closing Thoughts & What's Next
In this episode, we dive deep into the inner workings of large language models with Professor David Bau and grad students Koyena Pal and Eric Todd from Northeastern University. Koyena shares insights from her Future Lens paper, which shows that even mid-sized language models think multiple tokens ahead. Eric discusses the fascinating concept of Function Vectors - complex patterns of activity spread across transformer layers that enable in-context learning. Professor Bau connects the dots between these projects and the lab's broader interpretability research agenda, identifying key abstractions that link low-level computations to higher-level model behaviors. SPONSORS: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive ODF is where top founders get their start. Apply to join the next cohort and go from idea to conviction-fast. ODF has helped over 1000 companies like Traba, Levels and Finch get their start. Is it your turn? Go to http://beondeck.com/revolution to learn more. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Plumb is a no-code AI app builder designed for product teams who care about quality and speed. What is taking you weeks to hand-code today can be done confidently in hours. Check out https://bit.ly/PlumbTCR for early access. Head to Squad to access global engineering without the headache and at a fraction of the cost: head to choosesquad.com and mention “Turpentine” to skip the waitlist. TIMESTAMPS: (00:00) Intro (04:03) Reverse Engineering AI (10:10) Factual Knowledge Localization (16:34) Sponsors: Oracle | Omneky | On Deck (18:27) Future Lens Paper Intro (23:54) Choosing GPT-J (26:54) Vocabulary Prediction (30:36) Sponsors: Brave | Plumb | Squad (33:13) Fixed Prompt (35:57) Soft Prompt (41:32) Future Lens Results Analysis (51:50) Tooling & Open Source Code (56:07) Larger Models & Mamba Probes (1:04:10) Function Vectors Paper (1:09:39) Extracting & Patching Vectors (1:13:30) Encoding Task Understanding (1:15:36) Expert Models Implications (1:18:09) Conclusion
In this episode, Nathan sits down with Elicit co-founders Andreas Stuhlmüller and Jungwon Byun to discuss their mission to make AI-assisted research more accessible and reliable. Learn about their unique approach to task decomposition, which allows language models to accurately tackle complex research questions. We delve into the company's tech stack, their transition from nonprofit to startup, and their dedication to creating trustworthy AI tools for high-stakes applications. Join us for an exploration of the future of AI in research. The Cognitive Revolution is part of the Turpentine podcast network. Learn more: www.turpentine.co HELPFUL LINKS:  Elicit : https://elicit.com/ Andreas Stuhlmüller : https://twitter.com/stuhlmueller Jungwon Byun : https://twitter.com/jungofthewon SPONSORS: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive ODF is where top founders get their start. Apply to join the next cohort and go from idea to conviction-fast. ODF has helped over 1000 companies like Traba, Levels and Finch get their start. Is it your turn? Go to http://beondeck.com/revolution to learn more. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://bit.ly/BraveTCR Plumb is a no-code AI app builder designed for product teams who care about quality and speed. What is taking you weeks to hand-code today can be done confidently in hours. Check out https://bit.ly/PlumbTCR for early access. Head to Squad to access global engineering without the headache and at a fraction of the cost: head to choosesquad.com and mention “Turpentine” to skip the waitlist. TIMESTAMPS: (00:00:30) Intro (00:05:05) What is Elicit? (00:06:03) Vision for Elicit (00:10:10) Making research transparent (00:11:58) How to use it? (00:15:27) Sponsors: Oracle | On Deck | Omneky (00:18:21) Task Decomposition (00:23:48) Defining the task (00:26:30) Eliciting fine-grained evaluations (00:28:06) Hallucination rates (00:30:22) Models in play (00:31:30) Sponsors: Brave | Plumb | Squad (00:34:26) Shipping a new feature every week (00:36:10) What was not possible a year ago? (00:38:26) Chain of thought (00:43:47) Tactically, how to structure the chain of thought (00:45:21) Data sets and fine-tuning (00:51:23) Scaffolding (00:53:22) Translating structure into more compute (00:54:27) Infrastructure for investigating papers in detail (00:59:50) Emphasis on high-value use cases over speed (01:00:33) Balancing long-term safety and misuse concerns (01:02:36) Monitoring research progress for negative impact (01:06:05) Evolving user base and usage patterns (01:06:52) Biomedicine as a key domain for Elicit (01:08:57) Expanding results and depth of processing (01:11:40) Reorganizing information for better understanding (01:13:12) Habit formation and frequency of use (01:14:43) The concept of an AI bundle subscription (01:18:09) Nonprofit to Commercial Venture (01:20:08) Nonprofit Team and Commercial Mission (01:20:39) Hiring Needs at Elicit
In this second part of a two episode series, Nathan and AI scout Jason Meaux provide a sweeping overview of the first 90 days of Mamba-inspired research. They discusstMamba's application to computer vision, experiments in extending effective context length, the potential problem of internal rotting states, and the use of hybrid SSMs in biology.Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api LINKS: Show Notes and Paper Links: https://docs.google.com/document/d/1NK_a3deVL_aczORmSRw8LyujNPotpO7Kd90sIRj9Qx0/edit?usp=sharing Nathan's original Mamba Deep Dive Spotify: https://open.spotify.com/episode/3b3zeDVU6fE2yV9vdNVLqX?si=dc7a885d601d4a58 Apple: https://podcasts.apple.com/us/podcast/emergency-pod-mamba-memory-and-the-ssm-moment/id1669813431?i=1000639397566 X/SOCIAL: @labenz (Nathan) SPONSORS: ORACLE | OMNEKY | BRAVE | ON DECK | SQUAD Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api ODF is where top founders get their start. Apply to join the next cohort and go from idea to conviction-fast. ODF has helped over 1000 companies like Traba, Levels and Finch get their start. Is it your turn? Go to http://beondeck.com/revolution to learn more. 💥 Access global engineering without the headache and at a fraction of the cost: head to choosesquad.com and mention “Turpentine” to skip the waitlist. TIMESTAMPS: (00:00) - Episode Start (00:01:14) - Nathan and Jason’s Bet (00:04:51) - U-Mamba (00:15:10) - Sponsors: Oracle | Omneky (00:06:08) - Swin U-Mamba (00:18:59) - Vision Mamba (00:24:30 - VMamba (00:27:26) - VM-UNet (00:30:37) - Sponsors: Brave | On Deck (00:35:15) - SegMamba (00:36:59) - Vivim (00:37:31) - Mamba Morph (00:39:01) - Graph Mamba  (00:43:15) - Long Mamba (00:59:54) - Evo and StripedHyena The Cognitive Revolution is produced by Turpentine: a media network covering technology, business, and culture. Producer: Vivian Meng Editor: Graham Bessellieu For sponsor or guest inquiries, email: vivian@turpentine.co
In this first part of a two episode series, Nathan and AI scout Jason Meaux provide a sweeping overview of the first 90 days of Mamba-inspired research. They discuss the mechanistic underpinnings of Mamba architecture, Mamba's context capabilities, multi-modal applications in image segmentation and computer vision tasks, and much more. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api RECOMMENDED PODCAST: Autopilot explores the adoption and rollout of AI in the industries that drive the economy and the dynamic founders bringing rapid change to slow-moving industries. From law, to hardware, to aviation, Will Summerlin interviews founders backed by Benchmark, Greylock, and more to learn how they're automating at the frontiers in entrenched industries. Listen on Spotify: https://open.spotify.com/show/6YQZkKHN7EP2yWedAvSxBC?si=18377c69a2804333 Listen on Apple: https://podcasts.apple.com/ca/podcast/autopilot-with-will-summerlin/id1738163836 LINKS: Show Notes and Paper Links: https://docs.google.com/document/d/1NK_a3deVL_aczORmSRw8LyujNPotpO7Kd90sIRj9Qx0/edit?usp=sharing Nathan's original Mamba Deep Dive Spotify: https://open.spotify.com/episode/3b3zeDVU6fE2yV9vdNVLqX?si=dc7a885d601d4a58 Apple: https://podcasts.apple.com/us/podcast/emergency-pod-mamba-memory-and-the-ssm-moment/id1669813431?i=1000639397566 X/SOCIAL: @labenz (Nathan) SPONSORS: ORACLE | OMNEKY | SQUAD | BRAVE Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com 💥 Access global engineering without the headache and at a fraction of the cost: head to choosesquad.com and mention “Turpentine” to skip the waitlist. The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api ODF is where top founders get their start. Apply to join the next cohort and go from idea to conviction-fast. ODF has helped over 1000 companies like Traba, Levels and Finch get their start. Is it your turn? Go to http://beondeck.com/revolution to learn more.
In this episode, Nathan sits down with Adam Gleave, founder of Far AI, for a masterclass on AI exploitability. They dissect Adam's findings on vulnerabilities in GPT-4's fine-tuning and Assistant PIs, Far AI's work exposing exploitable flaws in "superhuman" Go AIs through innovative adversarial strategies, accidental jailbreaking by naive developers during fine-tuning, and more. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api RECOMMENDED PODCAST: Autopilot explores the adoption and rollout of AI in the industries that drive the economy and the dynamic founders bringing rapid change to slow-moving industries. From law, to hardware, to aviation, Will Summerlin interviews founders backed by Benchmark, Greylock, and more to learn how they're automating at the frontiers in entrenched industries. Listen on Spotify: https://open.spotify.com/show/6YQZkKHN7EP2yWedAvSxBC?si=18377c69a2804333 Listen on Apple: https://podcasts.apple.com/ca/podcast/autopilot-with-will-summerlin/id1738163836LINKS: LINKS: Far AI: https://far.ai/author/adam-gleave/ X/SOCIAL: @labenz (Nathan) @ARGleave (Adam) @FARAIResearch (Far.AI) SPONSORS: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api ODF is where top founders get their start. Apply to join the next cohort and go from idea to conviction-fast. ODF has helped over 1000 companies like Traba, Levels and Finch get their start. Is it your turn? Go to http://beondeck.com/revolution to learn more. 💥 Access global engineering without the headache and at a fraction of the cost: head to choosesquad.com and mention “Turpentine” to skip the waitlist. TIMESTAMPS: (00:00:00) Episode Preview (00:01:25) The alarming reality of AI exploits: from accidental jailbreaking to malicious attacks. (00:16:45) The Assistants API: a new frontier for AI exploitation. (00:41:54) The ethical dilemma of AI security research and disclosure. (00:51:36) Exploring AI vulnerabilities: a deep dive into GPT-4's exploits. (00:51:47) The challenge of AI robustness and the 'Accidental Jailbreaking' phenomenon. (00:52:39) Navigating the Assistants API: security risks and malicious exploits. (00:53:27) The robustness tax: balancing AI safety with performance. (01:07:42) Unveiling flaws in superhuman Go-playing AIs: a gray-box investigation. (01:36:50) Empirical scaling laws for adversarial robustness: a future focus. (01:41:53) Closing remarks and opportunities at FAR AI The Cognitive Revolution is produced by Turpentine: a media network covering technology, business, and culture. Producer: Vivian Meng Editor: Graham Bessellieu For sponsor or guest inquiries, email: vivian@turpentine.co
In this episode, Nathan sits down with Katja Grace, Cofounder and Lead Researcher at AI Impacts. They discuss the survey Katja and team conducted including over 2,700+ AI researchers, the methodology for the research, and the results’ implications for policymakers, the public, and the industry as a whole. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api LINKS: - Thousands of AI Authors on the Future of AI: https://aiimpacts.org/wp-content/uploads/2023/04/Thousands_of_AI_authors_on_the_future_of_AI.pdf -AI Impacts Site: https://aiimpacts.org/about/ -Linus episode: https://www.youtube.com/watch?v=wdmvtVTZDqE&pp=ygUJbGludXMgbGVl X/SOCIAL: @labenz (Nathan) @KatjaGrace (Katja) @AIImpacts SPONSORS: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api ODF is where top founders get their start. Apply to join the next cohort and go from idea to conviction-fast. ODF has helped over 1000 companies like Traba, Levels and Finch get their start. Is it your turn? Go to http://beondeck.com/revolution to learn more. This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at erik@turpentine.co. 💥 Access global engineering without the headache and at a fraction of the cost: head to choosesquad.com and mention “Turpentine” to skip the waitlist. Producer: Vivian Meng Editor: Graham Bessellieu
In this episode, Nathan sits down with Tim Reutemann, author of “Liquid Reign”. They discuss liquid democracy, reshaping political participation using AI and biometrics, and practical advances in technology and their impacts on identity verification, rehabilitation, and gaming. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api LINKS: Liquid Reign Book: https://www.amazon.ca/Liquid-Reign-Tim-Reutemann/dp/1981029176 Tim Reutemann's Medium: https://tim-reutemann.medium.com/ Audrey Tang: https://en.wikipedia.org/wiki/Audrey_Tang X/SOCIAL: @labenz (Nathan) @TimReutemann (Tim) SPONSORS: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api ODF is where top founders get their start. Apply to join the next cohort and go from idea to conviction-fast. ODF has helped over 1000 companies like Traba, Levels and Finch get their start. Is it your turn? Go to http://beondeck.com/revolution to learn more. 💥 Access global engineering without the headache and at a fraction of the cost: head to choosesquad.com and mention “Turpentine” to skip the waitlist. TIMESTAMPS: (00:00:00) - Exploring the power of your vote in a futuristic AI world. (00:01:25) - Imagining a positive future with advanced AI. (00:02:35) - Diving into 'Liquid Reign’: A vision of AI-transformed society. (00:05:58) - The journey of writing 'Liquid Reign’: From thought experiment to novel. (00:09:07) - The mechanics of liquid democracy and AI integration. (00:15:59) - Sponsors: Oracle | Omneky  (00:12:51) - Unpacking the technology stack behind the futuristic society. (00:16:00) - Exploring the progress and challenges in AI and cryptography. (00:25:28) - Switzerland’s unique way of getting citizens involved in democracy (00:28:45) - Sponsors: Brave | On Deck  (00:47:58) - The future of open source and security in an AI-driven world. (00:52:02) - Exploring the depths of cybersecurity and paranoia. (00:52:47) - The future of human-computer interfaces: Chips, VR, and beyond. (00:54:11) - The ethical dilemma of invasive technologies. (00:56:45) - The evolution of VR: From gaming to rehabilitation. (01:30:48) - Navigating the complexities of AI and privacy. (01:37:27) - Envisioning a positive future: The role of AI in society.
In this episode, Nathan sits down with Pablo Arredondo, VP of CoCounsel for Thomson Reuters. They discuss the evolution of legal research, how GPT-4 has changed legal practices, security and privacy in AI driven legal services, and more. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api X/SOCIAL: @labenz (Nathan) @tweetatpablo (Pablo) @casetext  LINKS: Casetext: https://casetext.com/ Cognitive Revolution (new feed): https://cognitiverevolution.ai/ SPONSORS: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api ODF is where top founders get their start. Apply to join the next cohort and go from idea to conviction-fast. ODF has helped over 1000 companies like Traba, Levels and Finch get their start. Is it your turn? Go to http://beondeck.com/revolution to learn more. 💥 Access global engineering without the headache and at a fraction of the cost: head to choosesquad.com and mention “Turpentine” to skip the waitlist. TIMESTAMPS (00:00:00) Episode preview (00:01:42) The evolution of legal research: From books to AI (00:02:19) The game-changing impact of GPT-4 on legal practices (00:04:01) Exploring the future of legal AI with Pablo Arredondo (00:04:34) The birth and evolution of CaseText (00:07:06) Revolutionizing legal research with AI and large language models (00:14:42) The leap to GPT-4: A new era for legal tech (00:16:42) Navigating the challenges and opportunities of AI in law (00:27:41) The continuous evolution of AI in legal tech (00:43:46) The importance of rigorous testing in AI deployment (00:45:19) The importance of testing in legal tech (00:45:46) Merging with Thomson Reuters: A new era of quality control (00:46:49) Harnessing GPT-4 for legal document review (00:48:27) Innovations in legal tech: Beyond GPT-4 (00:49:00) The evolution of legal research and document management (00:49:54) Exploring the potential of AI in legal firms (00:51:37) Security and privacy in AI-driven legal services (00:52:43) The future of vector databases in legal tech (00:54:10) AI-assisted legal assistance: A new frontier (00:58:41) The pricing strategy and market response to AI legal tools (01:10:18) The future of law and AI integration (01:23:18) Reflections on being acquired by Thomson Reuters (01:26:07) Closing thoughts: The impact of LLMs on justice
In this episode, Nathan sits down with Itamar Friedman, CEO of Codium AI, the company on the mission to create the code integrity paradigm. They discuss harnessing LLMs for code integrity, task decomposition, workflow engineering, and much more. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api X/SOCIAL: @labenz (Nathan) @itamar_mar (Itamar) @CodiumAI (Sodium) LINKS: Codium: https://www.codium.ai/ Cognitive Revolution Feed: https://cognitiverevolution.ai/ SPONSORS: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api ODF is where top founders get their start. Apply to join the next cohort and go from idea to conviction-fast. ODF has helped over 1000 companies like Traba, Levels and Finch get their start. Is it your turn? Go to http://beondeck.com/revolution to learn more. TIMESTAMPS: (00:00:00) Episode Preview (00:06:32) The evolution of AI in software development: beyond code generation (00:09:51) The shift towards code integrity and its impact (00:14:23) Unveiling Alpha Codium: A leap in AI-assisted code integrity (00:16:53) The broader impact of AI on software development processes (00:17:11) Sponsor break: Oraclel | Omneky (00:18:52) The future of AI in coding: enhancements, testing, and more (00:24:41) AI's role in enhancing code quality and developer efficiency (00:43:38) Exploring the challenges of large codebases (00:44:03) The impact of LLM context growth on code understanding (00:45:19) Innovative approaches to data retention and context computation (00:46:08) Deep dive into repo analysis and future directions (00:42:31) Personal experiences and the quest for efficient code management (00:48:26) Dynamic graph strategies and future features in IDEs (00:49:10) From code testing to advanced flow engineering: a new paradigm (00:52:37) Unveiling Alpha Codium: A leap in coding challenge solutions (01:07:31) Reflecting on workflows (01:23:30) Final thoughts and recommendations for AI enthusiasts The Cognitive Revolution is produced by Turpentine: a media network covering technology, business, and culture. Producer: Vivian Meng Editor: Graham Bessellieu For sponsor or guest inquiries, email: vivian@turpentine.co
In this episode, Nathan sits down with Will Bryk, CEO of Exa.ai. They discuss how Exa enables complex, research-based searches that differ from traditional keyword-based search, how their AI uses neural and non-neural methods, why they are using their own vector database, and more. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api LINKS: - Exa.ai: https://exa.ai/ X/SOCIAL: @WilliamBryk (William) @labenz (Nathan) @ExaAILabs (Exa) SPONSORS: Oracle Cloud Infrastructure (OCI) is a single platform for your infrastructure, database, application development, and AI needs. OCI has four to eight times the bandwidth of other clouds; offers one consistent price, and nobody does data better than Oracle. If you want to do more and spend less, take a free test drive of OCI at https://oracle.com/cognitive Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api ODF is where top founders get their start. Apply to join the next cohort and go from idea to conviction-fast. ODF has helped over 1000 companies like Traba, Levels and Finch get their start. Is it your turn? Go to http://beondeck.com/revolution to learn more. TIMESTAMPS (00:00:00) - Preview (00:01:52) - Exploring the landscape of information retrieval tools (00:14:19) - Exa: AI librarian for the web (00:15:32) - Sponsors: Oracle | Omneky (00:16:57) - AI Project Ideas (00:22:26) - What does search built for AI mean? (00:25:40) - Ranking with neural and non-neural methods (00:30:50) - Sponsors: Brave | On Deck (00:33:13) - Best practices for Exa prompting (00:34:01) - The power of keyword search (00:37:26) - Breaking down complex queries (00:34:37) - The evolution of search engines (00:39:53) - The business side of Exa (00:40:17) - The challenges of building a web scale index (00:39:53) - The business side of Exa (00:50:59) - Vector DBs (00:58:17) - Wrap This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at erik@turpentine.co.
In this episode, Nathan sits down with Richard Socher, CEO and Founder of You.com, a personalized AI search assistant. They discuss the rise of the AI chatbot paradigm and how that's changed the game for search, You.com's various modes, with particular emphasis on Genius mode and above all Research mode, and much more. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api LINKS: - You.com: https://you.com/ -Richard Socher's site: https://www.socher.org/ SPONSORS: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. X/SOCIAL: @labenz @RichardSocher (Richard) @YouSearchEngine @CogRev_Podcast TIMESTAMPS: (00:00) Preview (01:38) Interview with Richard Socher: AI pioneer (02:26) Exploring the You.com product (02:55) The AI Bundle (05:23) Richard Socher's journey in deep learning (16:43) You.com comparison to competitors (31:16) The future of AI search engines (41:38) The changing landscape of search engines (41:44) The impact of chatbots and AI on search (42:16) How the market will shape up (43:33) The power of open source (01:02:32) The role of AI in advancing science (51:42) The future of AI: philosophical and practical considerations (55:06) The future of AI: risks and regulations (01:11:07) The future of AI: agency and emergence (01:26:57) The future of AI: retrieval, memory, and online learning This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at erik@turpentine.co.
In this episode, Nathan sits down with Robin Hanson, associate professor of economics at George Mason University and researcher at Oxford’s Future of Humanity Institute. They discuss the comparison of human brains to LLMs and legacy software systems, what it would take for AI and automation to significantly impact the economy, our relationships with AI and the moral weight it has, and much more. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api LINKS: Robin’s Book, The Age of Em: https://ageofem.com/ Robin’s essay on Automation: https://www.overcomingbias.com/p/no-recent-automation-revolutionhtml Robin’s Blog: https://www.overcomingbias.com/ AI Scouting Report: https://www.youtube.com/watch?v=0hvtiVQ_LqQ&list=PLVfJCYRuaJIXooK_KWju5djdVmEpH81ee&pp=iAQB Dr. Isaac Kohane Episode: https://www.youtube.com/watch?v=pS5Vye671Xg SPONSORS: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. X/SOCIAL: @labenz @robinhanson (Robin) @CogRev_Podcast TIMESTAMPS (00:00) Preview (07:10) Why our current time is a “dream time” and the move back to a Malthusian world (13:30) What sort of world should we be striving for? (13:40) Sponsor - Brave (17:50) Distinguishing value talk from factual talk (18:00) Comparing and contrasting Ems to LLMs (22:30) The comparison of human brains to legacy software systems (30:52) Sponsor - Netsuite (41:01) AIs in medicine (53:30) A several century innovation pause (55:30) Achieving full human level AI in the next 60-90 years (1:03:55) Chess and routine benchmarks not a good predictor of AI performance in the economy (1:07:44) Reaching and exceeding human-level AI in the next 1000 years (1:11:40) Losing technologies tied to scale economies (1:12:00) Why AI is hard to maintain in the long run (1:12:20) Standard deviation in automation (1:14:05) Computing power grows exponentially but automation grows steadily (1:15:50) AI art generation and deepfakes (01:21:42) The economics of AI-powered coding (1:33:51) Merging LLMs (1:36:02) Rot in software and the human brain (1:40:18) Parallelism in LLMs and brain design (1:41:00]) Moral weight for AIs, enslavement, and cooperation with AI (1:47:10) What would change Robin’s mind about the future (1:49:18) Wrap This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at erik@turpentine.co.
In this conversation, Nathan is joined by Azeem Azhar, founder and writer of the Exponential View. They discuss why startups are likely to drive the true disruption in the industry, what forward thinking leaders are doing today to retrain their teams for AI, why Azeem agrees with Sam Altman’s comments that AGI will likely arrive soon, new governance mechanisms for the AI age, and more. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api LINKS: Exponential View: https://www.exponentialview.co/ Exponential Age, written by Azeem Azhar: https://www.amazon.com/Exponential-Age-Digital-Revolution-Rewire/dp/1635769094 X/SOCIAL: @azeem @labenz (Nathan) @CogRev_Podcast  SPONSORS: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. TIMESTAMPS: (02:34) The Great Embedding: predictions for the future of AI (14:37) - Sponsor: Brave (22:53) The future of AI in medicine (25:57) The role of AI in customer service and data entry (28:05) - Sponsors: Netsuite | Omneky (40:45) The concept of transition and the role of big banks and tech companies (42:13) The adoption of AI in large companies and its impact (44:47) The potential disruption of industries by AI (47:12) The future of AI: Opportunities and challenges (01:18:02) The benefits and challenges of bot-to-bot communication (01:20:54) The future of AI: Opportunities and threats (01:22:53) The role of governance in AI development (01:39:39) The role of trust and responsibility in AI development (01:46:57) The importance of public trust in AI technology (01:51:16) The need for checks and balances in AI development (01:53:42) The role of government and academia in AI development This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at erik@turpentine.co.
In this episode, Zvi Mowshowitz returns to the show to discuss OpenAI’s Sora model, Google’s Gemini announcement, Anthropic’s Sleeper Agents, and other live player analysis. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api Definitely also take a moment to subscribe to Zvi's blog Don't Worry About the Vase  (https://thezvi.wordpress.com/) - Zvi is an information hyperprocessor who synthesizes vast amounts of new and ever-evolving information into extremely clear summaries that help educated people keep up with the latest news. LINKS: -Zvi’s Blog: https://thezvi.substack.com/ - Waymark The Frost Episode: https://www.youtube.com/watch?v=c1pPiGD7cBw -Anthropic Sleeper Agents: https://www.anthropic.com/news/sleeper-agents-training-deceptive-llms-that-persist-through-safety-training SPONSORS: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. X/Social: @TheZvi (Zvi) @labenz (Nathan) @CogRev_Podcast TIMESTAMPS: (00:04:37) - Zvi’s feedback on the type of content the show should create (00:05:33) - Zvi’s experience with Gemini (00:09:42) - Speculating on Google Gemini’s launch timing (00:12:54) - Advantages of Gemini  (00:16:11) - Sponsors: Brave (00:25:00) - Speculating on Gemini 1.5 and market dynamics for foundational models.  (00:28:18) How long context windows change things (00:30:57) - Sponsor: Netsuite | Omneky  (00:41:06) - LLM Leaderboards  (00:43:37) - Physics world modelling in OpenAI Sora (00:57:25) - Object permanence in Sora (01:04:40) - Experiments Zvi would run on Sora  (01:06:21) - Superalignment and Anthropic Sleeper Agent (01:10:47) - When do agents actually start to work?  (01:16:00) - Raising the standard for AI app developers  (01:22:07) - Dangers of open soure development  (01:30:53) - The future of compact models  (01:33:58) - Superalignment  (01:53:00) - Meta (01:54:20) - Mistral’s hold over the regulatory environment  (02:04:16) - The Impact of Chip Bans on AI Development This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at erik@turpentine.co.
Note: This conversation contains themes of suicidal ideation, in the context of academic research. Please watch from (21:41) onwards if you would like to skip past this content. In this conversation, Nathan sits down with Eugenia Kuyda, Replika's Founder and CEO. They discuss recent research published in Nature conducted by Stanford on Replika user interactions, how Replika is providing their users with a relationship they can trust and confide in, what Eugenia has found surprising about the evolution of how people are interacting with their Replikas, and much more. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api LINKS Loneliness and suicide mitigation for students using GPT3-enabled chatbots: https://www.nature.com/articles/s44184-023-00047-6 Eugenia Kuyda Part 1 on The Cognitive Revolution: https://www.youtube.com/watch?v=SFKA7T-v6WE SPONSORS: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. X/Social: @ekuyda (Eugenia) @labenz (Nathan) @CogRev_Podcast  Timestamps: (00:00) Preview and summary (06:41 The evolution of Replika (08:11) Definining the main goal of Replika (09:54) Nature published study by Stanford on Replika and mental health (14:20) Methodology for the research on Replika users (15:19) Sponsor - Brave Search API (19:46) Replika providing people with a relationship they can trust and confide in (23:20) How people are relating and reacting to their AI Replikas (25:49) Stuffed animal analogy (28:20) What people come to Replika for (30:29) Sponsor - Netsuite | Omneky (32:03) How malleable are people’s expectations for their Replika? (36:54) The evolution of how people are interacting with Replika (44:49) Putting Replika on device (46:59) Underappreciated or developed aspects of AI development (56:11) The relationship people have with their Replika is a moat (1:08:46) Building AI to memorialize people after they passed: what are the ethics? This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at erik@turpentine.co.
In this episode, a16z partners Justine Moore and Anish Acharya join Nathan to discuss the AI Abundance Agenda, their latest thesis for consumer AI. They discuss the intersection of weird and working, and their investment pillars in AI for creativity and productivity, companionship, and wellness and growth. Looking for a search API? Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api LINKS: Read a16z’s AI Abundance Agenda here: https://gamma.app/docs/a16z-Consumer-Abundance-Agenda-ieotbnzbxj81biu?mode=doc SUBREDDITS MENTIONED: Justine's Deep Dive on AI Subreddits: https://twitter.com/venturetwins/status/1734614118294868115 r/LocalLLaMA: https://www.reddit.com/r/LocalLLaMA/ r/ComfyUI: https://www.reddit.com/r/comfyui/ r/StableDiffusion: https://www.reddit.com/r/StableDiffusion/ r/aivideo: https://www.reddit.com/r/aivideo/ SPONSORS: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. X/Social: @labenz (Nathan) @venturetwins (Justine) @illscience (Anish) @a16z  TIMESTAMPS: 00:00) Intro and summary (06:29) Introduction to the Abundance Agenda (09:21) AI reducing administrative overhead (09:40) Relationships and companionship (10:30) Wellness and personal growth (11:24 The intersection of weird and working: why weird sometimes works (13:24) How AI helps the pro consumer (15:17) Sponsor | Brave Search API (20:47) Where do Justine and Anish discover new AI products (23:25) The best AI subreddits (27:16) High NPS churn vs Low NPS Churn (28:30) AI Bundle: how it would work (29:34) Sponsor | Netsuite + Omneky (32:01) AI CMO or AI operated back office (33:40) Best AI image to video products (34:53) Why there aren’t currently APIs for AI video products (39:12) AI email composition will be tackled by an incumbent rather than a startup (39:47) The rise of voice-first due to AI (40:40) Startups vs incumbents - 80:20 value capture for startups (41:41) Salesforce vs a startup AI CRM (45:07) Creating artistically opinionated models using fine tuning (47:42) Why isn’t there a push for AI doctors? (51:46) AI mental health apps (55:00) Frameworks for designing non-predatory AI (56:51) Proxy metric for evaluating companion AI products (59:48) Media literacy and intuition for the next generation around AI (1:00:20) Request for startups from Justine and Anish This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at erik@turpentine.co.
In this episode, Dr Michael Levin, Distinguished Professor of Biology at Tufts University, joins Nathan to discuss embodied minds, his research into limb regeneration and collective intelligence, cognitive light cones, and much more. Michael and the Levin Lab work at the intersection of biology, artificial life, bioengineering, synthetic morphology, and cognitive science. LINKS: The Levin Lab and Dr. Michael Levin’s research: https://drmichaellevin.org/resources/ Dr Michael Levin’s blog: https://thoughtforms.life/about/ Tufts University Faculty Profile: https://as.tufts.edu/biology/people/faculty/michael-levin Michael Levin @ Wyss Institute: https://wyss.harvard.edu/team/associate-faculty/michael-levin-ph-d/ Dr. Levin’s Research on Limb Regeneration: https://news.uchicago.edu/how-bioelectricity-could-regrow-limbs-and-organs SPONSORS: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. X/SOCIAL @labenz (Nathan) @drmichaellevin (Michael) @CogRev_Podcast Timestamps: (00:00) Preview (01:07) Intro and summary (05:40) Xenobots, anthrobots and the other creatures created by Mike Levin (09:39) Bioelectric memory rewriting (15:01) Sponsor | BraveSearch API (16:09) The difficulty of conducting simulations, which involve running forward passes to predict and alter electrical patterns (20:30) The concept of backpropagation and mode switching in AI models (23:06) Why humans do not regenerate their limbs (37:10) Sponsor | Netsuite (39:40) Learning from small and biological systems onto the concept of possible emergence (45:16) The criticality of multiple scale questions and would a single scale? (55:49) The concept of the cognitive light cone (59:43) Advice on habits of mind and suggestions for inspiration on the AI side (1:13:36) Mike's suggested directions for the AI developers (1:24:49) Wrap & Sponsor | Omneky This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at erik@turpentine.co.
In this episode, Nathan sits down with Max Bennett, author of the book: A Brief History of Intelligence. They discuss the five major breakthroughs in evolution that resulted in human brains and cognition. They delve deeper into the workings of each breakthrough, the evolution of intelligence, and how AI can benefit from understanding these principles. If you need an ecommerce platform, check out our sponsor Shopify: https://shopify.com/cognitive for a $1/month trial period. We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. LINKS: A Brief History of Intelligence: https://a.co/d/6VPWTf7 SPONSORS: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. X/SOCIAL: @labenz (Nathan) @maxsbennett (Max) @CogRev_Podcast TIMESTAMPS: (00:00) Intro (06:00) Max's background on commercializing AI in technology (09:53) AI has taught us a lot of our intuitions are wrong (11:22) Why we're better off avoiding defining intelligence (14:38) The Five Breakthrough Model - steering, reinforcing, simulating, mentalizing, and speaking (15:43) Sponsor - Brave Search API | Shopify (18:20) The story of the first breakthrough - Steering (21:40) Evolution doesn't have forethought and every generation has to survive (23:05) The study of nematodes - how did this first brain emerge? (27:10) yet in bilaterians, but the idea is you classify things in the world into good and bad. (33:00) Netsuite by Oracle | Omneky (36:16) The story of the second breakthrough - Reinforcing (1:32:44) The story of the fourth breakthrough - Mentalizing (1:45:57) The story of the fourth breakthrough - Speaking (pls listen to the audio book / read the book) (1:46:46) How evolutionary paradigms will shape up in the future (1:55:03) A unified theory of value or moral patienthood that can be applied to the five breakthroughs (1:59:21) Wrap + Sponsor | Omneky This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at erik@turpentine.co.
In today's episode Yohei Nakajima, GP at Untapped Capital and Creator of BabyAGI, returns to the show. Together with Nathan, they watch Yohei’s TEDAI Talk, unpacking themes on collective intelligence, identity, and how AI can help us better understand one another. If you need an ecommerce platform, check out our sponsor Shopify: https://shopify.com/cognitive for a $1/month trial period. We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. -- LINKS: - Yohei's TEDAI Talk: https://www.ai-event.ted.com/panelists/yohei-nakajima - Listen to Yohei Nakajima Part 1 on The Cognitive Revolution here: https://www.cognitiverevolution.ai/ai-agents-vc-insights-on-ai-and-building-in-public-with-yohei-nakajima-creator-of-babyagi/ SPONSORS: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. X/SOCIALS: @labenz (Nathan) @yoheinakajima (Yohei) @CogRev_Podcast TIMESTAMPS: (06:39) Yohei's AI Creation Process (09:50) Differences between models (15:46) Sponsor - Brave Search API | Shopify (20:10) Knowledge Graphs (24:30) Shift to philosophical discussion (27:40) GPT Store (30:28) Sponsor - NetSuite | Omneky (35:40) Eastern Philosophy and Identity (36:22) How different societies will relate to Ai (37:00) Appreciate how much philosophy is embedded into language (39:03) Japan's policy towards AI and individual privacy (40:15) Eastern philosophy view of the brain  (40:51) AI is a tool much like real intelligence (42:20) AI in China (42:46) Collective, extended cognition (44:10) Emergence in ants (44:51) Language model performance in different languages (47:06) Nationalism and AI (48:31) Tokenization, unicode, and cost structure between languages (56:54) Accepting, not understanding (59:24) AI bridging connection This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at erik@turpentine.co.
In this episode, Nathan sits down with Sander Schulhoff, Cofounder and CEO of Learnprompting.org. They discuss the business model, the keys to prompting that every user of language models should know, negative prompting, prompt hacking, and more. If you need an ecommerce platform, check out our sponsor Shopify: https://shopify.com/cognitive for a $1/month trial period. LINKS: - Learnprompting.org: https://learnprompting.org/ - Learnprompting.org Prompt Hacking: https://learnprompting.org/docs/category/-prompt-hacking - Ignore This Title and Hackaprompt: https://arxiv.org/abs/2311.16119 SPONSORS: The Brave search API can be used to assemble a data set to train your AI models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. X/SOCIALS: @labenz (Nathan) @SanderSchulhoff @learnprompting @CogRev_Podcast TIMESTAMPS: (04:50) What is Learnprompting.org (06:30) Learnprompting.org's adoption stats and the transition from open source to a business (10:21) Are we done with prompt engineering or is there more to be discovered? The key 2-3 things every user of GPT should know (19:11) The format trick (21:32) Role casting / persona prompting (24:44) Does the level of vocabulary you bring to a LM impact its performance  (26:10) Contrastive chain of thought (28:30) Language models responding well to negative instructions (32:29) Benchmarking techniques (34:00) Answer engineering (37:29) Debugging a prompt  (41:13) Sander's favourite models today Best practices for image prompting - maybe cut out (48:50) Productivity improvement with language models (51:25) Tips for coding with prompts (56:06) The current state of prompt engineering and how it'll evolve  (58:30) 2024 will be the year of agents and Sander's favourite agents (59:57) How will agents impact the future of prompt engineering  (1:04:10) How to start agent engineering (Adversarial attacks  (1:19:40) Model to model hijacking (1:25:24) Chinese character attack  (1:28:33) Taxonomy of attacks This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at erik@turpentine.co.
In this episode, Nathan sits down with Suhail Doshi, founder of Playground AI. They discuss the current state of AI image generation, how Suhail is building Playground while the technology for vision and image generation is still maturing, thought to image reconstruction, and more. If you need an ecommerce platform, check out our sponsor Shopify: https://shopify.com/cognitive for a $1/month trial period. We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. -- LINKS: - Playground AI: https://playgroundai.com/ SPONSORS: The Brave search API can be used to assemble a data set to train your A I models and help with retrieval augmentation at the time of inference. All while remaining affordable with developer first pricing, integrating the Brave search API into your workflow translates to more ethical data sourcing and more human representative data sets. Try the Brave search API for free for up to 2000 queries per month at https://brave.com/api Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. X/SOCIALS: @labenz (Nathan) @Suhail @CogRev_Podcast TIMESTAMPS: (00:00) Episode Preview (00:44) The current state of AI image generation (08:04) Are we currently at a GPT-2 level for image gen? (15:40) Sponsor - Brave Search API | Shopify (20:46) Shortcomings and use cases for GPT-4V (22:46) Benefits of vision vs language (28:30) Trajectory for what Playground will build next (33:28) Sponsor - NetSuite by Oracle | Omneky (34:48) How will the image generation experience change over time (40:06) Thought to image reconstruction (47:49) What if OpenAI fully focused on image (50:09) Lack of training data in vision and the use of synthetic data (51:30) Multimodal models increasing performance (55:03) Images are information rich but lack the right annotation (57:00) Building Playground while vision technology is maturing (1:03:25) What should the rules for generative AI be? (1:09:19) Parallel to the music industry and streaming for rev share (1:12:21) What are the minimum standards that AI application developers should be expected to uphold? (1:16:48) Wrap This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at erik@turpentine.co.
In this episode, Nathan sits down with tech lawyer Cecilia Zeniti, Founder & CEO of GC AI, the AI for in-house counsel. They discuss the origins of IP law in the US Constitution to promote creativity, the "fair use doctrine" and how OpenAI could argue ChatGPT is transformative, Google's patenting strategy around the transformer, and much more. If you need an ecommerce platform, check out our sponsor Shopify: https://shopify.com/cognitive for a $1/month trial period. LINKS: GC AI: https://getgc.ai/ Cecilia's Twitter/X: https://twitter.com/CeciliaZin SPONSORS: Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. X/SOCIALS: @labenz (Nathan) @CeciliaZin (Cecilia) @CogRev_Podcast TIMESTAMPS: (00:04:30) - Introduction to Intellectual Property law (00:07:30) - Overview of main types of intellectual property - patents, trademarks, copyrights (00:10:30) - Could Google have patented the transformer? Google’s patent strategy (00:16:30) - Claim construction and its parallel to LLMs (00:17:17) - Sponsor: Shopify (00:18:46) - Practical impact of open source on ability to enforce IP rights (00:21:47) - Litigation, internal data privacy, and communication (00:24:30) - Copyright law and fair use doctrine for transformative works (00:30:22) - Sponsor: Netsuite | Omneky (00:31:42) - Big tech company lawsuits when money starts shifting between incumbents and newcomers (00:34:10) - When judges like a technology… (00:34:57) - Scraping and LinkedIn’s suit (00:38:50) - NYTimes vs OpenAI (00:40:00) - Copyright, creators, and music industry licensing (00:42:35) - Transformative nature of work and “fair use” (00:50:29) - Limits on getting injunctions and ongoing royalties from courts (00:56:39) - Legalities of other modalities, like DALL-E images of copyrighted IP (01:01:00) - OpenAI’s opt-out for licensing on the text modality (01:03:58) - OpenAI’s weak to strong generalization (01:07:00) - Pharmaceuticals and software, AI doctors, public good balancing (01:10:40) - Why licensed professionals aren’t pushing back against AI (01:15:36) - Duty to use tools for efficiency to a client (01:17:04) - Impact of open source and ability to find someone to sue (01:20:30) - Forward-looking thoughts on what IP laws should be for AI (01:27:38) - Overview of Cecilia's company GC AI for lawyers This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at erik@turpentine.co.
In this episode, Nathan sits down with Div Garg, founder of Multion, to discuss the current state and future outlook of AI agents. They discuss benchmarking real-world tasks, the promise and perils of consumer AI adoption, predictions that 2024 may be a breakout year for personal bots, and more. If you need an ecommerce platform, check out our sponsor Shopify: https://shopify.com/cognitive for a $1/month trial period. We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. -- LINKS: MultiOn: https://www.multion.ai/ Part 1 with Div Garg: https://www.youtube.com/watch?v=PR2Mdlx5eik SPONSORS: Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. X/SOCIALS: @labenz (Nathan) @divgarg9 @MultiON_AI (MultiOn) @CogRev_Podcast TIMESTAMPS: (00:00) - Episode Preview (00:06:06) - Current state of AI agents - still early with chat abilities, but logical reasoning lacking (00:12:32) - Estimated timeline for usable everyday AI agents - focused on adoption and reliability (00:17:41) - Architectures beyond language models - action transformers and process optimization (00:22:00) - Context limits of current AI models - efficient context compression is key (00:25:00 - Managing memory and knowledge retrieval in agents (00:29:40) - MultiOn's own model creation (00:30:16) - Sponsors: Netsuite | Omneky (00:49:00) - Maturing agent capabilities beyond language with planning systems (00:32:00) - Benchmarking agent capabilities on real-world website tasks (00:59:30) - Inspiration from computer OS thread scheduling and coordination (01:02:30) - Expanding agents to mobile for voice commands and authentication (01:06:47) - AI agents complementing vs substituting human roles (01:09:00) - Removing repetitive "digital chores" to change job landscapes (01:11:36) - Sourcing high-quality demonstrator data at scale (01:13:00) - Privacy protections when collecting user data This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at erik@turpentine.co.
In this episode, Nathan sits down with Juan Sequeda, Principal Scientist and Head of AI Lab at data.world. They discuss how knowledge graphs can be your organization's "brain" for AI, integrating structured and unstructured data, benchmarking enterprise AI systems, and more. If you need an ecommerce platform, check out our sponsor Shopify: https://shopify.com/cognitive for a $1/month trial period. We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. --- LINKS: Data.world: https://data.world/ SPONSORS: Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. X/SOCIALS: @labenz (Nathan) @juansequeda (Juan) @datadotworld (data.world) @CogRev_Podcast TIMESTAMPS: (00:00:00) - Introduction to Juan Sequeda and data.world (00:01:11) - Discussion on data and generative ai (00:06:15) - Data.world's origins as an open data catalog platform ("Github for data") (00:09:35) - Using knowledge graphs and semantics to integrate and query data (00:12:52) - Main use cases for data catalogs: search/discovery, governance, data operations (00:15:00) - The process of building knowledge graphs automatically from data (00:24:29) - AI for unlocking and capturing tribal business knowledge (00:34:24) - Understanding the data landscape in enterprises (00:38:32) - The emergence of knowledge engineers and data product managers (00:40:44) - The consumer experience in data.world (00:45:36) - The importance of context in data analysis (00:46:58) - The role of AI in improving data analysis (00:48:08) - The importance of accuracy and explainability in data analysis (00:50:08) - Question cataloging in data analysis (00:51:44) - The future potential of "chat with your data" interfaces (01:18:02) - Finetuning with data vs metadata (01:29:24) - Future of enterprise data teams This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at erik@turpentine.co.
In this episode, Nathan sits down with Gabe Gomes, Assistant Professor at Carnegie Mellon University, and researcher behind Coscientist: the first non-organic, intelligent being to design, plan, and execute a chemistry experiment. They discuss how Coscientist allows scientists to use natural language to control remote experiments on Emerald Cloud Lab, how it will democratize scientific knowledge, and accelerate the pace of research. If you need an ecommerce platform, check out our sponsor Shopify: https://shopify.com/cognitive for a $1/month trial period. We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. LINKS: Autonomous Chemical Research with Large Language Models: https://www.nature.com/articles/s41586-023-06792-0 --- SPONSORS: Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. X/SOCIALS: @labenz (Nathan) @gabepgomes (Gabe) @CogRev_Podcast TIMESTAMPS: (00:00:00) - Episode Intro (00:05:00) - Introduction Gabe Gomes, his research (00:15:02) - Emerald Cloud Labs for remote chemical experimentation (00:15:18) - Sponsor: Shopify (00:22:40) - How AI is addressing the pain point of chemistry research (00:29:12) - Sponsors: Netsuite | Omneky (00:31:00) - Democratizing science and access to chemistry techniques (00:38:00) - Modular CoScientist architecture (00:46:00) - The power of CoScientist to address more than just chemistry (01:17:00) - The explosion of the context window (01:30:00) - AI Safety (01:45:00) - How is Copilot already helping expedite chemistry and scientific research? This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at erik@turpentine.co.
In this episode, Nathan sits down with Dan O’Connell, Chief Strategy Officer at Dialpad. They discuss building their own language models using 5 billion minutes of business calls, custom speech recognition models for every customer, and the challenges of bringing AI into business. If you need an ecommerce platform, check out our sponsor Shopify: https://shopify.com/cognitive for a $1/month trial period. We're sharing a few of Nathan's favorite AI scouting episodes from other shows. Today, Shane Legg, Cofounder at Deepmind and its current Chief AGI Scientist, shares his insights with Dwarkesh Patel on AGI's timeline, the new architectures needed for AGI, and why multimodality will be the next big landmark. If you need an ecommerce platform, check out our sponsor Shopify: https://shopify.com/cognitive for a $1/month trial period. We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. --- SPONSORS: Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. X/SOCIAL: @labenz (Nathan) @dialdoc (Dan) @dialpad @CogRev_Podcast (Cognitive Revolution) TIMESTAMPS: (00:00) - Introduction and Welcome (06:50) - Interview with Dan O'Connell, Chief AI and Strategy Officer at Dialpad (07:13) - The Functionality and Utility of Dialpad (17:20) - The Development of Dialpad's Large Language Model Trained on 5Billion Minutes of Calls 19:56 The Future of AI in Business (22:21) - Sponsor Break: Shopify (23:56) - The Challenges and Opportunities of AI Development (31:17 ) - Prioritizing latency, capacity, and cost when evaluating AI (39:41) - Most Loved AI Features in Dialpad (42:01) - The Role of AI in Quality Assurance (43:10) - The Future of Transcription Accuracy (44:06) - The Importance of Speech Recognition in Business (46:59) - Personalizing AI for Better Business Interactions (47:01) - The Role of AI in Content Generation (52:47) - The Challenges and Opportunities of AI in Sales and Support This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at erik@turpentine.co.
We're sharing a few of Nathan's favorite AI scouting episodes from other shows. Today, Shane Legg, Cofounder at Deepmind and its current Chief AGI Scientist, shares his insights with Dwarkesh Patel on AGI's timeline, the new architectures needed for AGI, and why multimodality will be the next big landmark. If you need an ecommerce platform, check out our sponsor Shopify: https://shopify.com/cognitive for a $1/month trial period. You can subscribe to The Dwarkesh Podcast here: https://www.youtube.com/@DwarkeshPatel We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. --- SPONSORS: Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. X/SOCIAL: @labenz (Nathan) @dwarkesh_sp (Dwarkesh) @shanelegg (Shane) @CogRev_Podcast (Cognitive Revolution) TIMESTAMPS: (00:00:00) - Episode Preview with Nathan’s Intro (00:02:45) - Conversation with Dwarkesh and Shane begins (00:14:26) - Do we need new architectures? (00:17:31) - Sponsors: Shopify  (00:19:40) - Is search needed for creativity? (00:31:46) - Impact of Deepmind on safety vs capabilities (00:32:48) - Sponsors: Netsuite | Omneky (00:37:10) - Timelines (00:45:18) - Multimodality This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at erik@turpentine.co.
We're sharing a few of Nathan's favorite AI scouting episodes from other shows. Today: Nita Farahani shares her insights with 80,000 Hours' Luisa Rodriguez on the current state of neurotechnology and its potential impacts on various fields, including work, healthcare, privacy, and even human cognition. The discussion includes Farahani's assessment of devices like SmartCap and Neuralink, the concept of cognitive liberty, the risks of the technology, and the need for proper regulation and ethical considerations. If you need an ecommerce platform, check out our sponsor Shopify: https://shopify.com/cognitive for a $1/month trial period. Nita Farahany is a professor of law and philosophy at Duke Law School and discusses the applications of cutting-edge neurotechnology. You can subscribe to The 80,000 Hours Podcast here: https://80000hours.org/podcast/ --- SPONSORS: Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. X/SOCIAL: @labenz (Nathan) @8000hours (The 8000 Hours podcast) @CogRev_Podcast (Cognitive Revolution) TIMESTAMPS: (00:00) Nathan intro's this episode with Nita Farahany (03:26) The Future of Neurotechnology: From Neuralink to Meta (05:40) The Potential of Brain-Computer Interfaces in Military Applications (11:29) The Role of Neurotechnology in National Security (15:20) SPONSORS: SHOPIFY | NETSUITE (18:14) The Potential of Brain-Computer Interfaces in Communication and Data Transfer (21:19) The Future of Super Soldiers and Brain-Controlled Drones (32:20) SPONSORS: OMNEKY (41:05) The Controversial Realm of Neurotechnology Weapons (45:16) Ideal International Agreements for Weapon Regulation (47:01) The Threat of Hacking in Neurotechnology (50:36) Brain Signatures for Identification (01:11:28) The Future of Neurotechnology in the Workplace (01:24:59) The Intrusion of Brain Decoding into Personal Relationships (01:30:00) Regulating Brain Decoding: A Call for a Change in Worldview (01:38:03) The Impact of Neurotechnology on Identity and Self-Perception (01:41:47) The Future of Cognitive Enhancement and Transhumanism (01:46:21) The Role of Neurotechnology in Addressing Neurological Diseases (01:51:04) The Dark Side of Neurotechnology: Hacking and Manipulation (01:54:50) The Importance of Cognitive Liberty in Neurotechnology (01:55:15) The Future of Neurotechnology: Best and Worst Case Scenarios This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at erik@turpentine.co.
For the end of the year, we're going to repost a few of Nathan's favorite AI scouting episodes from other shows. Today: Samuel Hammond joins the Future of Life Institute podcast to discuss how AGI will transform economies, governments, institutions, and other power structures. If you need an ecommerce platform, check out our sponsor Shopify: https://shopify.com/cognitive for a $1/month trial period. Samuel Hammond is a Canadian-born, DC-based senior economist for the Foundation for American Innovation, a think tank focused on bridging the cultures of Silicon Valley and DC. This conversation is super wide ranging, covering the most likely default path to AGI, the economic and institutional transformations that AI will beget, the critical distinction between thinking about AI in isolation versus as part of a dynamic system, the proposal for a Manhattan or Apollo like megaproject for AI safety, and lots more. You can subscribe to Future of Life Institute here: https://futureoflife.org/project/future-of-life-institute-podcast/ You can read Samuel Hammond's blog at https://www.secondbest.ca --- We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. --- SPONSORS: Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off www.omneky.com NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. TIMESTAMPS: (00:00) Intro: End of year and bonus episodes (04:24) Discussion on AI Timelines (14:08) Insights from Information Theory (15:11) Sponsors: Shopify | MasterClass (32:12) AI Progress and Hard Steps in Evolution (34:21) Sponsors: NetSuite | Omneky (39:12) Government Preparedness for Advanced AI (46:16) The Internet's Role in Mass Mobilization and Erosion of Trust (01:05:47) The Role of AI in Monitoring and Surveillance (01:27:18) The Potential Dangers of Open-Sourcing AI (01:36:24) The Influence of AI on Society and Privacy (01:42:21) The Future of Government Services in a Techno-Feudalist Society (01:53:58) The Future of AI in Robotics (02:15:25) The Role of AI in the Future of Financial Markets This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at erik@turpentine.co.
In today's conversation, Nathan joins Rob Wiblin, host of The 80,000 Hours Podcast to discuss why we need more AI scouts, OpenAI's safety record, and redteaming frontier models. If you need an ecommerce platform, check out our sponsor Shopify: https://shopify.com/cognitive for a $1/month trial period. We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. SPONSORS: Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. X/SOCIAL: @labenz (Nathan) @robertwiblin (Robert) @CogRev_Podcast LINKS: 80,000 Hours Episode Show Notes: https://80000hours.org/podcast/episodes/nathan-labenz-openai-red-team-safety/ TIMESTAMPS: (00:00:00) - Episode Preview (00:05:12) - Rob’s intro (00:10:50) - Interview begins (00:15:50) - Intro toThe Cognitive Revolution excerpt (00:19:13) - Excerpt from The Cognitive Revolution: Nathan’s narrative (01:22:10) - Why it’s hard to imagine a much better game board (01:28:14) - What OpenAI has been doing right (01:40:12) - Arms racing and China (01:46:10) - OpenAI’s single-minded focus on AGI (01:56:55) - Transparency about capabilities (02:05:56) - Benefits of releasing models (02:17:14) - Was it ok to release GPT-4? (02:35:31) - Why no statement from the OpenAI board (02:55:59) - Ezra Klein on the OpenAI story (03:16:59) - The upside of AI merits taking some risk (03:31:44) - Meta and open source (03:42:26) - Nathan’s journey into the AI world (03:48:18) - Rob’s outro
In this episode, Nathan does an emergency pod deep dive into Mamba, a new state space model architecture. If you need an ecommerce platform, check out our sponsor Shopify: https://shopify.com/cognitive for a $1/month trial period. We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. SPONSORS: Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. X/SOCIAL: @labenz (Nathan) @CogRev_Podcast (Cognitive Revolution) TIMESTAMPS: (00:00:00) - Episode Preview (00:03:15) - Inventing something better than the transformer (00:05:17) - Examination of human cognition (00:15:44) - Sponsor: Shopify (00:27:00) - Weaknesses of the transformer (00:30:16) - Sponsor: Netsuite | Omneky (00:33:40) - Giving AI memory (00:39:32) - State Space Model Revolution (00:55:00) - SRAM and High Bandwidth Memory (01:36:16) - Block State and Hyena models (02:04:00) - Advancing AI safety and interpretability This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at erik@turpentine.co.
In this video, Nathan chats to Dan Shipper, CEO and Co-founder of Every, for the series "How I Use Chat-GPT". They discuss Nathan's prompting techniques for creative and cognitive labour, and using GPT in copilot instead of delegation mode. If you need an ecommerce platform, check out our sponsor Shopify: https://shopify.com/cognitive for a $1/month trial period. Watch the rest of the series, "How I Use ChatGPT", here: https://www.youtube.com/@EveryInc We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. SPONSORS: Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. X/SOCIAL: @labenz (Nathan) @danshipper (Dan) @CogRev_Podcast (Cognitive Revolution) @Every (Every) TIMESTAMPS: (00:00) - Episode Preview (00:03:57) - Copilot vs delegation mode (00:11:06) - ChatGPT for coding (00:14:29) - Building a prompt coach (00:28:22) - Best practices for using Chat-GPT (00:43:55) - The “dance” between you and AI (00:50:16) - Using GPT as a thought partner (00:52:07) - Using GPT for diagrams (01:03:18) - Using Perplexity instead of a search engine (01:12:00) - What's ahead for AI This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at erik@turpentine.co.
In this episode, Marius Hobbhahn, CEO of Apollo Research, sits down with Nathan Labenz to discuss Apollo’s research in AI deception, interpretability, and affordances. If you need an ecommerce platform, check out our sponsor Shopify: https://shopify.com/cognitive for a $1/month trial period. We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. SPONSORS: Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. X/SOCIAL: @labenz (Nathan) @MariusHobbhahn (Marius) @eriktorenberg (Erik) @CogRev_Podcast TIMESTAMPS: (00:00:00) - Episode Preview (00:05:40) - Understanding the Role of Apollo Research  (00:08:02) - The Evolution of AI Safety (00:11:30) - Apollo’s Framework (00:15:10) - Sponsors: Shopify  (00:16:49) - Understanding AI Affordances and Resulting Interactions in the World (00:31:00) - Sponsors: Omneky (00:39:00) - Interpretability and deceptive alignment  (00:45:55) - Why might deception arise in the first place? (00:47:46) - Understanding deceptive alignment  (00:57:49) - New Architectures (01:02:23) - Interpretability at deployment phase (01:03:35) - Deception in AI | A Case Study (01:09:03) - Deceptive AI Stock Trader (01:18:51) - Impact of discouragement on unethical AI behaviour (01:19:45) - Giving the AI a Reasoning Scratchpad and Impact on Deception (01:21:06) - Double-edged sword of removing the scratchpad (01:23:00) - Analyzing impact of model size on insider training  (01:28:00) - Challenges and necessity of 3rd Party Auditing (01:31:00) - Role of government in regulation  (01:52:17) - How can individuals get involved in red teaming? This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at erik@turpentine.co.
Balaji Srinivasan, investor, former CTO at Coinbase and GP at a16z, and writer of The Network State, joins Nathan to discuss polytheistic AI and AI gods, human-AI symbiosis, how AI will be controlled, and much more. If you need an ecommerce platform, check out our sponsor Shopify: https://shopify.com/cognitive for a $1/month trial period. We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. SPONSORS: Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. X/SOCIAL: @labenz (Nathan) @balajis (Balaji) @eriktorenberg (Erik) @CogRev_Podcast TIMESTAMPS: (00:00) - Episode Preview (00:06:07) - Evolution of AI Systems (00:09:39) - Challenges of AI Robustness (00:29:54) - Intersection of AI and Politics (00:52:14) - Regulation (00:52:44) - Slippery slope of precedent setting (00:54:00) - Role of AI in political chaos (00:54:41) - Emergence of decentralized AI (01:05:39) - AI's future as amplified intelligence (01:1300) - Polytheistic model of AI (01:32:00) - Role of AI in Habitat Degradation (01:33:32) - AI's ability to do differential diagnosis (01:34:04) - ABC of economic apocalypse: AI, Bitcoin, China (01:36:00) - Evolution of AI in chess and medicine (01:38:22) - Difference between AI existential threat and economic disruption (01:40:19) - Impact of cryptography on public infrastructure (02:07:40) - Role of tribalism in AI This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at erik@turpentine.co.
In this episode, Nathan sits down with Alan Cowen, CEO and Chief Scientist at Hume AI, an emotional intelligence startup working on creating emotionally aware AI. If you need an ecommerce platform, check out our sponsor Shopify: https://shopify.com/cognitive for a $1/month trial period. We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. SPONSORS: Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. X/SOCIAL @labenz (Nathan) @AlanCowen (Alan) @eriktorenberg (Erik) @CogRev_Podcast LINKS: Hume: https://hume.ai/ TIMESTAMPS: (00:00) - Episode Preview (00:04:52) - How do you define happiness? How can AI make people happy? (00:08:40) - The striking experience of trying the Hume demo (00:09:16) - Building multimodal models using facial expressions, vocal signals, speech patterns (00:12:27) - How Hume’s models have an advantage of LLMs when it comes to interpreting emotions (00:13:23) - Assembling diverse datasets of emotional judgments via surveys (00:15:27) - Sponsors: Shopify (00:22:00) - Across populations, what is common or different in people’s judgement of facial expressions (00:26:00) - Interrater reliability for training data (00:30:48) - Sponsors: Omneky (00:33:20) - The unique labelling of “awe” across different cultures (00:36:23) - Customizing models for cultural emotional expression norms (00:41:13) - How they determined the set of emotions recognized by the model (00:42:50) - Schadenfreude as a unique example of semantic space research (00:49:00) - Custom models (00:52:42) - Using Hume in B2B contexts (00:59:49) - The cost comparison of having a human analyze emotions vs AI This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at erik@turpentine.co.
In this episode, Nathan sits down with Nora Ammann, cofounder and CEO of PIBBSS (Principles of Intelligent Behavior in Biological and Social Systems), a research initiative focused on the principles of intelligent behavior in biological and social systems. If you need an ecommerce platform, check out our sponsor Shopify: https://shopify.com/cognitive for a $1/month trial period. We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. SPONSORS: Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. X/SOCIAL @labenz (Nathan) @AmmannNora (Nora) @eriktorenberg (Erik) @CogRev_Podcast TIMESTAMPS: (00:00:00) - Introduction to Nora Amman and PIBS (00:03:25) - Nathan's view that society is not ready for rapid AI development (00:05:55) - Nora's framing of AI safety, alignment, and risks (00:09:31) - The problem of epistemic access to future AI systems (00:12:36) - Categorizing different research approaches to AI safety (00:15:46) - Seeking epistemic robustness through plural perspectives (00:19:00) - Expecting AI systems to continue getting more powerful and different (00:21:13) - Nora's "third way" research approach using biological and social systems (00:25:00) - Defining intelligence broadly across systems that transform inputs to outputs (00:27:29) - Avoiding analogies and anthropomorphism when studying AI systems (00:30:23) - Using multiple perspectives and assumptions to triangulate understanding (00:35:13) - Translating concepts between domains more multifaceted than just "borrowing" (00:38:15) - Learning from interdisciplinary practices like bioengineering (00:42:05) - Key questions about the nature of intelligence and agency (00:46:38) - Understanding hierarchical levels of agentic behavior (00:49:32) - Aligning goals between individuals and organizations (00:53:27) - Assessing the validity of assumptions and analogies about AI (00:58:57) - Informing AI interpretability and evaluation with theory (01:02:12) - Modeling interactions between AI systems (01:04:56) - Using ecology as a framework for AI interactions (01:07:46) - Developing a computational ecology theory (01:11:45) - Learning from historical examples of societal transformations (01:16:59) - Unprecedented speed and autonomy of AI development (01:19:00) - PIBS programs for connecting researchers across domains (01:23:39) - Seeking researchers to tie theory to concrete AI applications (01:26:45) - Need for productive disagreement on AI risks and solutions This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at erik@turpentine.co.
In this episode, Nathan chats with Josh Albrecht, CTO of Imbue. They discuss how to create agents for reasoning, reliability, and robustness. If you need an ecommerce platform, check out our sponsor Shopify: https://shopify.com/cognitive for a $1/month trial period.  We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. SPONSORS:  Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. X/SOCIAL @labenz (Nathan) @eriktorenberg (Erik) @CogRev_Podcast TIMESTAMPS: (00:00:00) – Episode Preview (00:07:14) – What does it mean to be a research company? (00:10:25) – How is the reasoning landscape these days and how might it evolve? (00:11:03) – Data quality is highly important (00:21:15) – What’s the difference between good features and a good world model? (00:27:31) – The impact of new modalities on reasoning (00:29:15) – How much can reasoning and knowledge be separated? (00:45:13) – Imbue demo and are they building their own LLMs or using others? (00:49:37) – Does Imbue have a deal with Nvidia? (00:57:48) – Carbs framework (01:12:57) – Imbue’s involvement with policy and and AI safety (01:16:23) – Takeaways from AI Safety Summit and Biden’s Order This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at erik@turpentine.co.
In this episode, Nathan chats with Guillermo Rauch, CEO of Vercel, to discuss how AI might shape the future of code, software 2.0, and the open source question in AI. If you need an ecommerce platform, check out our sponsor Shopify: https://shopify.com/cognitive for a $1/month trial period. SPONSORS: Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive With the onset of AI, it’s time to upgrade to the next generation of the cloud: Oracle Cloud Infrastructure. OCI is a single platform for your infrastructure, database, application development, and AI needs. Train ML models on the cloud’s highest performing NVIDIA GPU clusters. Do more and spend less like Uber, 8x8, and Databricks Mosaic, take a FREE test drive of OCI at https://oracle.com/cognitive NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. X/SOCIAL @labenz (Nathan) @rauchg (Guillermo) @CogRev_Podcast TIMESTAMPS (00:00:00) - Introductory comments (00:03:43) - Rauch's background in open source software like Mootools and Next.js (00:04:27) - Overview of Vercel and the front-end cloud concept (00:06:15) - Productivity gains from Vercel's front-end infrastructure (00:14:50) - Sponsors: Shopify | Omneky (00:21:00) - Rauch getting inspired by GitHub Copilot code auto-completion (00:24:00) - Launching Vercel's own AI product vZero: production-ready UI code from natural language prompts (00:29:17) - Sponsors: Oracle | Netsuite (00:30:00) - Transition to discussing the future of software development (00:34:12) - vZero surpassing Rauch's own hand-coded website on accessibility (00:51:00) - Discussion about focusing on the full stack beyond just the AI model (00:54:00) - Concept of Software 2.0 using data and AI instead of classical code (00:56:00) - Maintaining software 1.0 while aggressively expanding into 2.0 paradigm (00:56:12) - Philosophical support for open source and skepticism about risks (00:57:12) - How open source software tends to quickly improve over time (00:57:47) - Prediction that AI may "ossify" existing software 1.0 technologies (01:01:12) - AI enabling more grassroots innovation like Mark Zuckerberg originally did (01:07:00) - Concerns about regulatory suppression of open source AI progress (01:03:00) - Unpredictability of new risks that could emerge like impersonation (01:11:00) - Rejecting AI doom narratives but staying vigilant on capabilities (01:12:00) - Concluding thoughts on embracing AI progress with appropriate caution This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at erik@turpentine.co.
Nathan shares his perspective on Sam Altman’s firing from OpenAI, after being a part of the red team for GPT-4 and seeing how the board handled safety concerns. If you need an ecommerce platform, check out our sponsor Shopify: https://shopify.com/cognitive for a $1/month trial period.  This is a developing story. This podcast was recorded on 11/21 at 12pm PST. SPONSORS:  Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries. From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive With the onset of AI, it’s time to upgrade to the next generation of the cloud: Oracle Cloud Infrastructure. OCI is a single platform for your infrastructure, database, application development, and AI needs. Train ML models on the cloud’s highest performing NVIDIA GPU clusters. Do more and spend less like Uber, 8x8, and Databricks Mosaic, take a FREE test drive of OCI at https://oracle.com/cognitive NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. X/SOCIAL @labenz (Nathan) @eriktorenberg (Erik) @CogRev_Podcast TIMESTAMPS: 00:00:00) - Preview (00:03:00) - Getting early access to test GPT-4 (00:08:03) - Concerns over OpenAI's slow start on safety after testing GPT-4 (00:15:38) - Sponsors: Shopify | Omneky (00:17:34) - GPT-4's lack of safety measures and willingness to provide harmful information (00:18:20) - GPT-4 suggesting assassination to slow AI progress (00:23:00) - The failure of GPT-4's "safety edition" to properly constrain unsafe behavior (00:29:00) - Sponsors: Netsuite | Oracle (00:29:39) - Discussing concerns over GPT-4 capabilities with AI experts and leaders (00:33:00) - An OpenAI board member not having tried GPT-4 despite its importance (00:36:00) - Getting removed from the GPT-4 testing program by OpenAI (00:44:00) - OpenAI subsequently showing more seriousness on safety after the GPT-4 experience (00:54:00) - An example safety issue in GPT-4 that still persists (01:00:00) - Speculation on what may have triggered the OpenAI board's removal of Sam Altman as CEO (01:06:00) - Altman's "quaint" remark and acknowledgement of GPT-5 training (01:21:57) - The absence of explanation from the board (01:23:56) - How Microsoft will emerge (01:32:36) - Should OpenAI be open source? (01:42:00) - Innane regulation of AI  This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at erik@turpentine.co. Producer: Vivian Meng Executive Producers: Natalie Toren, and Erik Torenberg Editor: Graham Bessellieu For inquiries about guests or sponsoring the podcast, please email vivian@turpentine.co
In this episode, Nathan and Erik discuss research out of Google Deepmind suggesting LLMs, Hemant Teneja’s responsible VC commitments, and why now is not the time for an ideological war on AI regulation. If you need an ecommerce platform, check out our sponsor Shopify: https://shopify.com/cognitive for a $1/month trial period.  RECOMMENDED PODCAST: Every week investor and writer of the popular newsletter The Diff, Byrne Hobart, and co-host Erik Torenberg discuss today’s major inflection points in technology, business, and markets – and help listeners build a diversified portfolio of trends and ideas for the future. Subscribe to “The Riff” with Byrne Hobart and Erik Torenberg: https://link.chtbl.com/theriff SPONSORS:  Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. X/SOCIAL @labenz (Nathan) @eriktorenberg (Erik) @CogRev_Podcast TIMESTAMPS: (00:00:00) - Opening discussion of recent viral tweet claiming LLMs can't generalize (00:03:27) - Waymo Safety Research  (00:10:12) - Response to Google Deepmind’s research claiming LLMs can’t generalize (00:15:08) - Sponsors: Shopify | Omneky  (00:21:38) - Reproduction of the DeepMind research showing noise allows generalization (00:26:02) - Helen of Transforrmers  (00:30:15) - Sponsors: Oracle | Netsuite (00:32:36) - Continuation of Google Deepmind discussion (00:42:47) - “The AI Executive Order will only continue to look more foolish from here”  (00:44:09) - The AI Scout mindset (00:45:22) - Few humans can extrapolate beyond their training data (00:48:45) - When does GPT-4 deceive its user?  (00:49:58) - Voluntary Responsible AI Commitments from VCs  (00:54:00) - Analysis of the commitments as basic common sense practices (00:56:30) - No need for an ideological war  (00:57:00) - Discussion of critical reactions framing the commitments as capitulation (01:00:00) - Concerns about the voluntary commitments enabling harmful regulation (01:03:00) - Rebuttal that self-regulation can avoid heavy handed regulation  (01:08:00) - Self driving cars: the invisible lives you can save (01:11:00) - Mysticism when it comes to AI (01:12:03) - Suggestion that product liability law could address concerns (01:15:00) - Challenge to defend rejecting product liability for AI systems This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at erik@turpentine.co.
In this episode, Nathan interviews Alex Watson, founder and CPO of Gretel AI, about the company's work in synthetic data. They discuss why we need synthetic data, Gretel’s new pre trained tabular LLM that creates synthetic data on a zero shot basis, privacy techniques to prevent LLM memorization, and more. If you need an ecommerce platform, check out our sponsor Shopify: https://shopify.com/cognitive for a $1/month trial period. We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. SPONSORS: Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive ORACLE: With the onset of AI, it’s time to upgrade to the next generation of the cloud: Oracle Cloud Infrastructure. OCI is a single platform for your infrastructure, database, application development, and AI needs. Train ML models on the cloud’s highest performing NVIDIA GPU clusters. Do more and spend less like Uber, 8x8, and Databricks Mosaic, take a FREE test drive of OCI at oracle.com/cognitive NETSUITE: NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. OMNEKY: Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. X/SOCIAL: @labenz (Nathan) @AlexWatson405 (Alex) @Gretel_AI @CogRev_Podcast TIMESTAMPS: (00:00:00) - Intro (00:03:02) - Origins of the company name Gretel AI and initial vision around enabling data sharing while protecting privacy (00:05:16) - Alex's background in data privacy and compliance from his previous startup Harvest AI, acquired by AWS (00:07:24) - Using synthetic data to create additional examples and improve detection of rare disease (00:12:50) - Why use synthetic data? (00:17:02) - Sponsors: Shopify | Omneky (00:19:00) - Training models to recreate real-world data distributions and using validators to detect unrealistic outputs (00:24:40) - Pre-training the Gretel tabular LLM on diverse internet data sets (00:30:40) - Sponsors: Oracle | Netsuite (00:34:00) - Using an agent planning architecture (00:39:41) - Example use case of adapting models with synthetic data samples for long-tail cases (00:43:00) - Using reinforcement learning to intentionally generate more diverse and representative synthetic data (00:51:16) - The potential of efficient, lightweight models compared to massive LLMs like GPT-4 (00:56:00) - Analogizing model specialization to specialized parts of the brain  (01:06:04) - Using differential privacy techniques to prevent memorization and exposure of private data (01:14:37) - Adding noise during training to blur memorization (01:18:42) - Optimism that synthetic data quality issues reflect details not fully understood yet vs inherent problems
We're joined by John Hayes, CEO and Cofounder of Ghost, a self-driving car startup using multimodal LLMs to solve the autonomous driving problem, that OpenAI just invested $5 million into. If you need an ERP platform, check out our sponsor NetSuite: http://netsuite.com/cognitive. We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. SPONSORS: Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive With the onset of AI, it’s time to upgrade to the next generation of the cloud: Oracle Cloud Infrastructure. OCI is a single platform for your infrastructure, database, application development, and AI needs. Train ML models on the cloud’s highest performing NVIDIA GPU clusters. Do more and spend less like Uber, 8x8, and Databricks Mosaic, take a FREE test drive of OCI at oracle.com/cognitive NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. X/SOCIAL: @labenz (Nathan) @ghosthayes (John) @GhostAutonomy @CogRev_Podcast TIMESTAMPS: 00:00:00) - Introduction to John Hayes and Ghost Autonomy's partnership with OpenAI (00:04:30) - The journey to founding Ghost, and how multimodal LLMs will change self-driving cars (00:05:03) - John's background founding Pure Storage and moving into autonomy (00:13:24) - Overview of different self-driving technology stacks (Lidar vs cameras) (00:14:03) - Sponsors: Shopify | Omneky (00:25:39) - Different approaches to how we know self-driving cars work well enough for public deployment (00:32:21) - Sponsors: Netsuite | Oracle (00:34:24) - Current state of robotaxis and China (00:39:47) - Where Ghost fits into the autonomous driving landscape and their tech stack (00:50:51) - Affordable radar systems (00:51:54) - Ghost’s approach to interpretability (00:53:27) - Using LLMs for driving (00:54:59) - Partnership with OpenAI and how Ghost’s unique LLM solution to the self-driving problem (00:57:40) - GPS’ unreliability which can be solved by multimodal approach (01:02:31) - Hallucination is the best part of LLMs (01:04:09) - Using maps as extended memory and storage for driving data (01:09:20) - Ghost business model and the user experience (01:16:37) - OpenAI as currently the only provider of advanced multimodal models (01:24:17) - How self-driving cars should address fear and standing up for the technology (01:29:30) - AI: China and the US, and why China is being pushed towards self-driving (01:31:39) - Regulators in the US are responsive to consumers (01:32:26) - VC subsidization of self-driving (01:33:25) - John’s widest angle outlook on the AI revolution
We’re deep diving into OpenAI DevDay with Logan Kilpatrick, Dev Relations Lead at OpenAI. If you need an ERP platform, check out our sponsor NetSuite: http://netsuite.com/cognitive. We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. SPONSORS: SHOPIFY: https://shopify.com/cognitive for a $1/month trial period Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. X/SOCIAL: @labenz (Nathan) @OfficialLoganK (Logan) @CogRev_Podcast TIMESTAMPS: (00:00:00) - Episode Preview (00:02:08) - How many startups did OpenAI kill? (00:05:50) - Current employee count at OpenAI (00:06:59) - OpenAI's mission being focused on developing safe AGI to benefit humanity (00:07:10) - How the GPT Store relates to AGI and progressing agent development (00:08:22) - OpenAI's strategy to release AI iteratively so society can adapt (00:10:50) - Safety considerations around the OpenAI Assistant release (00:11:30) - Capability overhangs and is the internet ready for agents? (00:14:13) - Why certain agent capabilities like planning aren't enabled yet by OpenAI (00:15:28) - Sponsors: Shopify | Omneky (00:17:34) - GPT-4-1106 Preview designation (00:21:50) - 16k fine-tuning for 3.5 Turbo (00:25:13) - GPT-4 Finetuning and how to join the experiment (00:27:53) - Custom models: $2-3 million pricing to build a defensible business (00:29:48) - Bringing costs down to bring custom models to more people (00:30:19) - Sponsors: Oracle | Netsuite (00:33:53) - Copyright shield (00:35:42) - OpenAI doesn’t train on data you send to the API (00:36:37) - New modalities and low res GPT vision (00:37:26) - GPT Vision Assessment for Aesthetics (00:42:30) - WhisperLarge v3 (00:44:15) - Text-to-speech API: the voice strategy and AI safety (00:51:45) - Log probabilities coming soon (00:53:45) - The evolution of plugins to GPTs: the challenges with plugins (00:55:33) - GPT Instructions, expanded knowledge, and actions (01:00:18) - How is auth handled with GPTs (01:01:04) - Hybrid auth (01:02:50) - GPT Assistant API Billing (01:07:58) - AI Safety (01:10:28) - OpenAI Jailbreaks and Bug Bounties (01:11:57) - The OpenAI roadmap for a year from now The Cognitive Revolution is brought to you by the Turpentine Media network. Producer: Vivian Meng Executive Producers: Amelia Salyers, and Erik Torenberg Editor: Graham Bessellieu For inquiries about guests or sponsoring the podcast, please email vivian@turpentine.co
In this episode, Flo Crivello, founder of Lindy AI, joins Nathan to chat about Biden’s executive order, and the state of AI safety. They discuss Flo’s thoughts on the executive order, building AGI kill switches, self driving cars, and more. If you need an ERP platform, check out our sponsor NetSuite: http://netsuite.com/cognitive. SPONSORS: Netsuite | Omneky Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. RECOMMENDED PODCAST:  Every week investor and writer of the popular newsletter The Diff, Byrne Hobart, and co-host Erik Torenberg discuss today’s major inflection points in technology, business, and markets – and help listeners build a diversified portfolio of trends and ideas for the future. Subscribe to “The Riff” with Byrne Hobart and Erik Torenberg: https://link.chtbl.com/theriff TIMESTAMPS: (00:00) Episode Preview (00:06:42) The natural order of technological progress (00:07:00) Self driving cars (00:10:57) Where is Flo accelerationist? (00:12:34) Artificial intelligence as a new form of life (00:17:08) - Sponsors: Oracle | Omneky (00:18:05) Silicon-based intelligence vs carbon-based intelligence (00:24:36) Executive Order (00:29:32) How would a GPU kill switch work? (00:31:24) “Let’s not regulate model development, but applications” (00:32:08) - Sponsor: Netsuite (00:36:00) GPT-4 is the most critical component for AGI (00:38:00) AGI in 2-8 years (00:39:26) Eureka moment from a general system (00:48:00) AI research with China (00:52:00) Does AI have subjective experience? The Mu response This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at erik@turpentine.co. Producer: Vivian Meng Executive Producers: Amelia Salyers, and Erik Torenberg Editor: Graham Bessellieu
Mark Humphries is a Professor of History at Wilfrid Laurier University, where he has published widely on various aspects of Canadian history. We invited Mark to do an episode after he reached out to tell us that hearing about how Nathan fine-tuned GPT-3.5 on GPT-4 reasoning helped him get over some hurdles in his own archival research. In addition, he chats about all the things that he'd tried that hadn't worked, and in the process proved himself to be one of the world's leading adopters of AI technology in the field of history. If you need an ERP platform, check out our sponsor NetSuite: http://netsuite.com/cognitive. SPONSORS: NetSuite | Omneky NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. TIMESTAMPS: (00:00:00) - Episode Preview (00:03:00) - The state of AI in history before recent advances like GPT-3 (00:06:00) - Mark's background and how he first got interested in AI (00:09:00) - Using AI to process and search through vast amounts of archival material (00:12:00) - The challenges of digitizing and searching handwritten historical documents (00:15:00) - The massive scale of undiscovered archival material that could be processed by AI (00:18:00) - How AI can help historians process more archival material than ever before (00:20:11) - Sponsors: Netsuite | Omneky (00:21:00) - Limitations on using commercial APIs for private archival documents (00:24:00) - The cost of processing archival documents compared to hiring human transcribers (00:27:00) - Comparing GPT's ability to transcribe historical handwriting vs more recent scripts (00:33:00) - Tracing individuals through complex fur trade records using AI (00:36:00) - Mark's approach to fine-tuning models for specific historical tasks (00:39:00) - Challenges teaching AI models the nuances of historical writing (00:42:00) - Privacy issues limiting the use of commercial APIs on restricted archival material (00:45:00) - The gap between people's expectations of AI and what it can really do right now (00:51:00) - Adapting assignments and student expectations to AI's current capabilities (00:52:28) - Using chain of thought prompting to teach models precise historical tasks (00:52:46) - Getting high accuracy on keyword tagging of archival documents using fine-tuning (00:57:00) - Mark has crossed the threshold from promise to accelerating archival research (01:00:00) - How to frame classification tasks to get the most value from AI models (01:03:00) - Teaching AI models to pronounce tricky historical names and terms (01:06:19) - Mark's experience using AI in the classroom over two semesters (01:09:00) - Assignments that are better suited to the current strengths and weaknesses of AI (01:11:45) - AI progress in education is lagging due to lack of institutional adoption (01:12:00) - The trajectory of AI capabilities and the need for humans to exceed the model baseline (01:27:49) - Lessons from history on economic transitions and the social contract This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at erik@turpentine.co.
In this episode, Yohei Nakajima, creator of BabyAGI and GP at Untapped Capital, chats with Nathan about the opportunity for AI to strengthen human understanding, AI agents, and his insights on investing in AI projects. If you need an ERP platform, check out our sponsor NetSuite: http://netsuite.com/cognitive. We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. SPONSORS: Shopify | NetSuite | Omneky Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. TIMESTAMPS: (00:10:59) - A large part of AI is trying to map human cognitive processes onto our software stack (00:11:14) - Yohei’s TED AI talk: the opportunity for AI to strengthen human understanding (00:13:29) - Yohei's journey to build AI projects and building in public  (00:14:04) - Yohei's lifelong interest in building tools and automating workflows for efficiency (00:16:29) - Sponsors: Netsuite | Omneky  (00:22:05) - Building projects as a fun and exploratory practice  (00:23:53) - Single use software (00:24:18) - Yohei’s home assessment price contesting project  (00:24:58) - The origins of BabyAGI as an autonomous startup founder prototype (00:27:44) - Create as many paper clips as possible  (00:30:10) - Thoughts on going all in on a project and turning it into a company vs pursuing it on the side  (00:33:00) - Forking different versions of Baby AGI based on animal names (00:34:24) - Yohei’s learnings about agents after iterating on six versions of Baby AGI  (00:36:24) - Yohei’s thoughts on generalist agents (00:37:28) - Replit (00:40:54) - Begin exploring AI automation with tasks you wish you had time for, not critical workflows (00:42:32) - Automating outbound sales and recruiting workflows with AI (00:46:19) - Where should people start learning about AI agents? (00:48:23) - Will agents come online with GPT-4V? (00:52:40) - The unique moment where both executives and engineers both want to implement AI (00:54:59) - AI layers: hardware, software, tooling  (00:57:20) - Taxonomy of AI business models  (01:10:47) - Designing AI to provide value for senior citizens (01:15:14) - The responsibility to nudge people positively with influential AI assistants (01:19:24) - Advice on when and how startups should build in public (01:22:24) - Perspective on existential risk from AI vs. its potential benefits (01:15:30) - Responsibility to handle AI-human emotional connections well  (01:19:24) - Advice on when and how startups should build in public (01:22:24) - Perspective on existential risk from AI vs. its potential benefits
Anton Troynikov, cofounder of Chroma, joins Nathan Labenz to discuss the importance of keeping the retrieval-augmented generation (RAG) loop in house, what it means for Chroma to be in “wartime” mode right now, and how much of the data going into Chroma has never been in a database before. If you need an ERP platform, check out our sponsor NetSuite: http://netsuite.com/cognitive. SPONSORS: NetSuite | Omneky NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. LINKS: Part 1 with Anton: https://youtu.be/ogy37CdIljg X/SOCIAL: @labenz (Nathan) @atroyn (Anton) @eriktorenberg (Erik) @CogRev_Podcast TIMESTAMPS: (00:00:00) - Introduction by Nathan, setting up the conversation with Anton (00:02:16) - Anton articulates Chroma's mission to build a horizontally scalable system (00:03:06) - Rise in popularity of retrieval-augmented generation (RAG) (00:06:03) - Chroma's focus on delivering a horizontally scalable cloud service for vector search and storage (00:08:07) - Nathan describes his experience building a RAG application for a client profiling use case (00:10:27) - Anton advises measuring retrieval quality and maximizing relevant information returned (00:15:05) - Sponsors: Netsuite | Omneky (00:17:02) - Popular use of open source vs. proprietary embedding models like Anthropic's Ada (00:19:30) - The importance of keeping the RAG loop in house and not relying solely on external APIs (00:27:41) - The huge amount of unstructured data that can now be processed by AI (00:30:40) - Providing a unified interface to structured and unstructured data (00:33:15) - Much of the data going into Chroma has never been in a database before (00:38:47) - Categories of organizations adapting to AI: legacy, AI-native, and AI-first (00:40:55) - Where Chroma is seeing most of its growth right now (00:46:20) - Interpretability work like Anthropic's circuit evaluation (00:52:23) - Anton believes new tooling can make latent spaces accessible without AI expertise (01:06:08) - Scaling constraints between search indexes vs. application databases (01:09:10) - Potential for time as a dimension in embedding spaces (01:13:46) - Likelihood of missing results due to representational issues vs. approximate nearest neighbor (01:15:22) - Automatically handling small data sets without needing elaborate indexing (01:17:20) - Anton's perspective on whether OpenAI will build its own database (01:19:43) - Partnering with OpenAI and other labs to increase use of their models (01:21:19) - Anton's experiments probing GPT's reasoning abilities with Game of Life (01:25:41) - Closing thoughts on the conversation This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at erik@turpentine.co.
Trey Kollmer returns to discuss the latest AI research revelations with Nathan Labenz. They explore how new techniques will shave 10% off global compute needs, how analogical prompting beats few-shot prompting, and how compressive historical records can increase LLM memory and retention abilities. If you need an ERP platform, check out our sponsor NetSuite: http://netsuite.com/cognitive. SPONSORS: Shopify | NetSuite | Omneky Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. RECOMMENDED PODCAST:  Every week investor and writer of the popular newsletter The Diff, Byrne Hobart, and co-host Erik Torenberg discuss today’s major inflection points in technology, business, and markets – and help listeners build a diversified portfolio of trends and ideas for the future. Subscribe to “The Riff” with Byrne Hobart and Erik Torenberg: https://link.chtbl.com/theriff TIMESTAMPS: (00:00:00) - Episode Preview (00:01:11) - Paper: Think Before You Speak (00:03:13) - Multimodal models for combining vision and language (00:04:19) - Backspace Paper (00:06:25) - Chain of thought prompting for step-by-step reasoning (00:09:14) - Backspacing in language models to correct mistakes (00:12:05) - Attention sinks for expanding context length (0012:41) - Paper: Large Language Models as Analogical Reasoners (00:15:24) - Pause tokens for language models to "think" (00:18:23) - Analogical prompting to recall relevant examples (00:20:52) - Long context windows for language models (00:23:20) - Markdown works best for OpenAI (00:24:23) - Ring attention to break memory constraints (00:26:15) - Paper: StreamingLLMs (00:27:46) - Potential for superhuman performance with longer contexts (00:31:01) - Dynamic context window adjustment at runtime (00:33:53) - Retention and memory capabilities for transformers (00:37:12) - Planning algorithms combined with memory and scale (00:39:49) - Paper: Ring Attention (00:42:35) - Executive assistant prompting and critique (00:45:23) - Self-RAG for language models to find own examples (00:48:02) - Timelines and predictions for future capabilities (00:50:37) - Applications like analyzing long texts and scripts (00:53:15) - Local versus global attention in transformers (00:55:59) - Architectural changes versus just training adjustments (00:58:41) - Pre-training strategies like random start points This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at erik@turpentine.co.
Trey Kollmer joins Nathan Labenz for a roundup of the latest AI research! They discuss Microsoft’s Self-Taught Optimizer (STOP) research and Google’s FreshLLMs, how H100 chips will supercharge development of programs with GPT-4 level compute, LLM representation of space and time, and more! If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. SPONSORS: Shopify | NetSuite | Omneky Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. TIMESTAMPS: (00:00:00) – Introduction (00:00:56) – Update to WGA Strike (00:03:00) – Trey Kollmer's background (00:06:00) – Scaling compute for AI training experiments with GPT-4 as reference point (00:09:00) – Inflection's plan to acquire 22,000 H100s to reach GPT-4 scale compute in 5 days (00:12:00) – Addressing knowledge cutoff in LLMs using search engines (00:15:00) – Inserting structured search results into prompts with metadata (00:16:07) – Sponsors: Netsuite | Omneky (00:18:00) – Comparing approach to Perplexity system (00:18:08) — Fresh LLMs (00:21:00) – Microsoft’s Self-taught Optimizer (STOP): Recursive self-improvement framework (00:24:00) – STOP framework works with GPT-4 but not GPT-3.5 (00:27:00) – STOP removed sandbox flag in some cases (00:30:00) – LLMs represent space and time with probe models (00:33:00) – Visualizations show emergence of spatial maps (00:33:14) — OpenAI rumours (00:36:00) – Techniques like linear probes and holdout studies (00:39:00) – DNNs extrapolate predictably by falling back to ignorance (00:42:00) – Testing different architectures, loss functions, distribution shifts (00:45:00) – Design systems to be conservative out of distribution (00:48:00) – Potential for recursive architecture search (00:50:21) — LLMs represent Space and Time (00:51:00) – Vision API enabling more capable web agents (00:54:00) – Discussion of research insights (00:57:00) – Thoughts on stochastic parrots debate (01:11:25) — Deep Neural Networks Tend to Extrapolate Predictably X/Social @labenz (Nathan) @treyko (Trey) @CogRev_Podcast This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at erik@turpentine.co.
Nathan Labenz synthesizes recent research in mechanistic interpretability and AI safety, how top players in the space like Anthropic and OpenAI are addressing them, and jailbreaks like the Calvin and Hobbes one you may have seen online. Nathan's aim is to impart the equivalent of a high school AP course understanding to listeners in 90 minutes. If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive Questions or topics you want us to review for future episodes? Email TCR@turpentine.co SPONSORS: Shopify | NetSuite | Omneky Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. RECOMMENDED PODCAST: The HR industry is at a crossroads. What will it take to construct the next generation of incredible businesses – and where can people leaders have the most business impact? Hosts Nolan Church and Kelli Dragovich have been through it all, the highs and the lows – IPOs, layoffs, executive turnover, board meetings, culture changes, and more. With a lineup of industry vets and experts, Nolan and Kelli break down the nitty-gritty details, trade offs, and dynamics of constructing high performing companies. Through unfiltered conversations that can only happen between seasoned practitioners, Kelli and Nolan dive deep into the kind of leadership-level strategy that often happens behind closed doors. Check out the first episode with the architect of Netflix’s culture deck Patty McCord. https://link.chtbl.com/hrheretics LINKS: Scouting Report Part 1 - Fundamentals : https://www.youtube.com/watch?v=0hvtiVQ_LqQ Scouting Report Part 2 - Impact, Fallout, and Outlook: https://www.youtube.com/watch?v=QJi0UJ_DV3E Universal Jailbreaks with Zico Kolter, Andy Zou, Asher Trockman: https://www.youtube.com/watch?v=BwltbhR0JgU&feature=youtu.be TIMESTAMPS: (00:00) Episode Preview (02:26) AI Engineer Survey (03:53) P(Doom) (00:07:52) Representation engineering (00:09:20) Using contrasting prompts to understand model’s inner representations (00:15:16) Sponsors: Netsuite | Omneky (00:22:00) Controlling AI systems and detecting jailbreaks (00:28:53) LLM performance and refusal rates varying by language (00:33:13) Towards monosemanticity: decomposing language models with dictionary learning (00:54:12) Implications of the aforementioned paper This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at erik@turpentine.co.
In this episode, Nathan is joined by James Yu, Founder of Sudowrite, an AI writing tool.They discuss how James started Sudowrite after using GPT-3 for his own fiction writing, how Sudowrite is able to be a supportive writing partner, and Yu's experience developing its tech stack and working through the backlash he's received. f you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive Subscribe to the show Substack to join future conversations and submit questions to upcoming guests! https://cognitiverevolution.substack.com/ We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. SPONSORS: Shopify | NetSuite | Omneky Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. TIMESTAMPS: (00:00:00) - Episode Preview (00:04:28)– How James started using GPT-3 for fiction writing in early beta (00:08:47) - Using few-shot learning to get good results from early GPT-3 (00:10:25) – Focusing messaging on being a supportive AI writing partner (00:12:08) – Helping fiction writers feel less lonely through pseudo-conversations with AI (00:16:01) - Sponsors: Netsuite | Omneky (00:17:22) - Evolving from paragraph-level assistance to full story understanding (00:20:19) - Building the product for centaurs: half Human, half AI (00:32:15) - Using multiple models together to "kitbash" the best outputs (00:39:21) - Iterating on prompts over time to get a customized "garden" (00:45:18) - Keeping temperature high for creative writing, but avoiding cliches (00:54:21) - Separate paths for professional writers vs casual creators (00:57:30) – The continued role of human-centric art and culture (01:00:10) - The potential for automation to replace repetitive jobs (01:07:48) - Yu’s experience launching an AI writing tool and the backlash he received (01:16:24). - Advice for future AI product launches to avoid or minimize backlash (01:18:25) - Focusing on delivering value to customers during controversy (01:28:44) - The idea of an "AI bundle" to reduce churn and customer acquisition costs (01:42:06) - Recommendations for underrated AI apps - Claude, Pika, Midjourney The Cognitive Revolution is brought to you by the Turpentine Media network. Producer: Vivian Meng Executive Producers: Amelia Salyers, and Erik Torenberg Editor: Graham Bessellieu For inquiries about guests or sponsoring the podcast, please email vivian@turpentine.co
In this episode, Nathan sits down with Swyx of Latent Space to chat about AI engineers and tools to check out, competitive dynamics between OpenAI, other foundation model providers, and developers, and if Swyx would wear an AI Horcrux. We also learn that Nathan lived in the same dorm as Mark Zuckerberg back in his college days (and was a late adopter to Facebook…). If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive Subscribe to the show Substack to join future conversations and submit questions to upcoming guests! https://cognitiverevolution.substack.com/ We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. SPONSORS: Shopify | NetSuite | Omneky Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. TIMESTAMPS: (00:00) Episode Preview (00:00:49) AI Nathan’s intro (00:03:14) What is an AI engineer? (00:05:56) What backgrounds do AI engineers typically have? (00:15:51) Sponsors: Netsuite | Omneky (00:17:13) Swyx’s Discord AI project (00:20:41) Key tools for AI engineers (00:23:42) HumanLoop, Guardrails, Langchain (00:27:01) Criteria for identifying capable AI engineers when hiring (00:30:59) Skepticism around AI being a fad and doubts about contributing to AI (00:34:03) AI Engineer Conference speaker lineup (00:41:14) AI agents and two years to AGI (00:46:04) Expectations and disagreement around what AI agent capabilities will work soon (00:50:12) Swyx’s OpenAI thesis (00:53:03) AI safety considerations and the role of AI engineers (00:56:24) Disagreement on whether AI will soon be able to generate code pull requests (01:01:07) AI helping non-technical people to code (01:01:49) Multi-modal Chat-GPT and the future implications (01:03:33) Nathan living in the same dorm as Mark Zuckerberg (01:04:44) Competitive dynamics between OpenAI and other AI model developers (01:05:39) Play.ht vs ElevenLabs (01:09:20) The tension between platforms and developers building on top of them (01:11:40) The best thing startups can do to compete with foundation model providers (01:16:26) User identity/authentication services like Login with OpenAI (01:19:20) Google vs the other live players (01:20:46) AI Horcruxes / Pendants (01:22:05) The concept of an AI app bundle for consumers and developers
In this episode, Aravind Srinivas of Perplexity AI returns to the show. They discuss Perplexity’s growth to millions of queries per day, CEO Aravind’s favourite Perplexity use cases, and how Perplexity ships fast in a competitive landscape against Google and major AI live players creating their own search engines. If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. SPONSORS: Shopify | NetSuite | Omneky Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. X: @labenz (Nathan) @AravSrinivas (Aravind) @eriktorenberg (Erik) @cogrev_podcast  LINKS: - Perplexity AI: https://www.perplexity.ai/ - Part 1 with Aravind: https://www.youtube.com/watch?v=YSYQZZu4MEM TIMESTAMPS: (00:00:00) - Episode Preview (00:01:12) - Introducing Aravind Srinivas and Perplexity AI (00:05:05) - Perplexity's growth to millions of queries per day (00:06:21) - Perplexity's retention and market share vs. ChatGPT (00:08:32) - Improving reliability, speed, accuracy, and new features (00:10:33) - Getting to daily usage from weekly usage (00:13:21) - Aravind's favorite Perplexity use cases (00:18:34) - Issues with lack of sufficient web coverage for hard queries (00:18:38) - Sponsors: Netsuite | Omneky (00:23:13) - Building their own search index and models for self-sufficiency (00:26:29) - Using their own index vs real-time web queries (00:28:43) - Integrating default search and Copilot companion experiences (00:31:49) - Training their own models as the only viable long-term option (00:36:56) - The web becoming more like an API accessed via AI assistants (00:41:23) - Not trying to copy Google's business model (00:44:36) - Spending more on compute than people to get scale efficiencies (00:49:35) - Replacing all parts of the stack with their own proprietary versions (00:53:59) - Shipping fast out of necessity in a competitive war zone (00:58:00) - AI assistants becoming a significant part of human digital activity The Cognitive Revolution is brought to you by the Turpentine Media network.  Producer: Vivian Meng Executive Producers: Amelia Salyers, and Erik Torenberg Editor: Graham Bessellieu For inquiries about guests or sponsoring the podcast, please email vivian@turpentine.co
Zvi Mowshowitz, the writer behind Don't Worry About the Vase, returns to catch up with Nathan on everything OpenAI, Amazon-Anthropic collab, and Google Deepmind. They also discuss Perplexity, deepfakes, and software bundling vs the Roman Empire. If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive Definitely also take a moment to subscribe to Zvi's blog Don't Worry About the Vase  (https://thezvi.wordpress.com/) - Zvi is an information hyperprocessor who synthesizes vast amounts of new and ever-evolving information into extremely clear summaries that help educated people keep up with the latest news.  We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. SPONSORS: Shopify | NetSuite | Omneky Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. TIMESTAMPS: 00:00:00 - Episode Preview (00:02:42) - Nathan's experience using Code Interpreter for a React app 00:06:09 - Zvi's perspective on Code Interpreter and other new Anthropic products (00:10:47) - Nathan's approach of "coding by analogy" using Code Interpreter (00:15:42) - Sponsors: Netsuite | Omneky (00:17:00 )- Performance degradation issues with large context windows (00:22:50) - The disconnect between Anthropic's value and what users are willing to pay (00:31:56) - Predicting Gemini's capabilities relative to GPT-4 00:30:13 - Rating Code Interpreter's capabilities (00:37:53) - Using Perplexity vs. Anthropic products for search (00:44:11) - Potential for a bundled subscription for multiple AI services (00:47:39) - Challenges of getting competitors to agree to bundling (00:54:05) - Concerns over information pollution from synthetic content (00:56:36) - Filtering adversarial vs. unintentional bogus information (01:02:20) - Dangers of info pollution visible in Archive dataset (01:11:15) - Kevin Fisher’s AI Souls demo with emotional voices (01:12:15) - Difficulty of detecting AI voices/images for a general audience (01:14:32) - Being optimistic about defending against deepfakes (01:21:12) - The reversal curse in language models (01:46:12) - Implications of Amazon investing in Anthropic (01:49:20) - Non-standard terms likely affected the Anthropic valuation (01:51:13) - Survey of the AI Safety landscape
Nathan and Erik chat OpenAI GPT-3.5 fine tuning updates, using GPT 4 outputs to fine-tune 3.5, when to accelerate, and AI bundles. If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. SPONSORS: Shopify | NetSuite | Omneky Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. TIMESTAMPS: (00:00) - Intro and GPT-3.5 fine tuning update (05:50) - Using GPT-4 to generate training data for GPT-3.5  (09:54) - Potential for training models on synthetic/cleaned data  (10:24) - Using chain of thought prompts to improve model performance  (15:02) - Sponsors: Netsuite | Omneky (19:39) - Accelerating applications vs new AI models  (20:40) - What to accelerate vs what to slow down (26:07) - AI as a co-pilot vs fully automating tasks  (30:12) - When to delegate to AI (36:40)- Displacement of human roles by AI systems (40:39) - Does training on synthetic data solve a problem? (45:10) - The idea of an AI bundle/subscription  (50:28) - Bundling in other industries like cable and SaaS (54:27) - Churn and retention challenges for AI apps  (01:02:54) - Low retention for easy-to-use AI apps (01:03:57) - Incentives for AI companies to join a bundle (01:04:39) - Potential for collaboration between AI companies  (01:12:01) - Leading AI firms creating separate bundles (01:16:43) - Outro
In this episode, Nathan sits down with three researchers at Carnegie Mellon studying adversarial attacks and mimetic initialization: Zico Kolter, Andy Zou, and Asher Trockman. They discuss: the motivation behind researching universal adversarial attacks on language models, how the attacks work, and the short term harms and long term risks of these jailbreaks. If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. TIMESTAMPS: [00:00:00] - Introducing the podcast and guests Zico Kolter, Andy Zou, and Asher Trockman [00:06:32] - Discussing the motivation and high-level strategy for the universal adversarial attack on language models [00:09:33] - Explaining how the attacks work by adding nonsense tokens to maximize target sequence probability [00:11:06] - Comparing to prior adversarial attacks in vision models [00:13:47] - Details on the attack optimization process and discrete token search [00:17:09] - The empirical notion of "mode switching" in the language models [00:21:18] - Technical details on gradient computation across multiple models and prompts [00:23:46] - Operating in one-hot vector space rather than continuous embeddings [00:25:50] - Evaluating candidate substitutions across all positions to find the best update [00:28:05] - Running the attack optimization for hundreds of steps across multiple GPUs [00:39:14] - The difficulty of understanding the loss landscape and internal model workings [00:43:55] - The flexibility afforded by separating the loss and optimization approach [00:48:16] - The challenges of creating inherently robust models via adversarial training [00:52:34] - Potential approaches to defense through filtering or inherent model robustness [00:55:51] - Transferability results to commercial models like GPT-4 and Claude [00:59:25] - Hypotheses on why the attacks transfer across different model architectures [01:04:36] - The mix of human-interpretable and nonsense features in effective attacks [01:08:29] - The appearance of intuitive manual jailbreak triggers in some attacks [01:15:33] - Short-term harms of attacks vs long-term risks [01:18:37] - Influencing those with incomplete understanding of LLMs to appreciate differences from human reasoning [01:24:16] - Mitigating risks by training on filtered datasets vs broad web data [01:2916] - Curriculum learning as a strategy for both capability and safety [01:30:35] - Influencing developers building autonomous systems with LLMs [01:33:19] - Alienness of LLM failure modes compared to human reasoning [01:35:45] - Getting inspiration from biological visual system structure [01:40:35] - Initialization as an alternative to pretraining for small datasets [01:51:41] - Encoding useful structures like grammars in initialization without training [02:12:10] - Most ideas don't progress to research projects [02:13:02] - Pursuing ideas based on interest and feasibility [02:15:14] - Fun of exploring uncharted territory in ML research SPONSORS: NetSuite | Omneky NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. Music Credit: Stableaudio.com
In this episode, Nathan sits down with Adam Wenchel, CEO of Arthur.ai. Adam founded the AI security company back in 2019, before GPT-2 existed. In this episode, Adam shares his unique perspective on the AI security landscape, drawing from years building commercial AI systems. They discuss the attacks Adam set out to defend against, the changing priorities of executives in the rush to adopt LLMs, and the LLM-specific techniques Adam has developed. If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. TIMESTAMPS: (00:00:00) Episode Preview (00:03:45) Adam's background in AI and starting Arthur AI in 2019 (00:05:52) The release of ChatGPT as a watershed moment for generative AI (00:07:09) Differences between traditional cybersecurity and AI security (00:09:51) Early examples of AI security issues like boundary detection attacks in fraud systems (00:12:39) - Mitigating risks of AI systems through observability and robust training (00:14:40) - Financial services governance of AI models and its challenges today (00:15:12) Sponsors: Netsuite | Omneky (00:21:18) - Motivations for governance like staying compliant with regulations (00:21:40) - The mix of incentives shaping earlier AI governance, like explainability (00:28:14) - Using LMs to evaluate the security of other LMs (00:30:03) - Dynamics between training and evaluating future LMs (00:38:10) - The state of reasoning capabilities in large LMs (00:44:35) - Corporate urgency around adopting generative AI technologies (00:46:51) - Common enterprise use cases for generative AI and security concerns (00:50:45) - Techniques for reducing hallucinations in retrieval augmented LMs (00:53:15) - Benchmarking LMs on specific organizational tasks versus generic benchmarks (00:56:30) - Metrics beyond accuracy like concision and hedging (01:01:20) - Automatically detecting anomalies and hallucinations (01:09:20) - Relationships between Arthur AI and foundation model providers (01:11:52) - Where Cohere shines: multilingualism and not hedging (01:13:43) - Anticipating future watershed moments and steady progress (01:19:03) - Whether we can ever fully solve AI alignment and safety LINKS: Arthur.ai: https://www.arthur.ai/ X/Social: @apwenchel (Adam) @itsArthurAI (Arthur.ai) @labenz (Nathan) @eriktorenberg @CogRev_Podcast SPONSORS: Shopify | NetSuite | Omneky Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. Music Credit: Stableaudio.com
In this episode, Nathan sits down with Stephen Parker and Josh Rubin of Waymark, and creators of The Frost, an AI-powered 12 minute short film. In this episode, we get a behind the scenes look at their creative process, the prompting and creative techniques they used to generate and animate the DALL-E results, and an overview of the current state of AI art. If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. TIMESTAMPS (00:00) Episode Preview (00:01:00) Nathan’s introduction for Stephen Parker and Josh Rubin (00:05:01) - The Frost is a 12-minute short film created using DALL-E 2 images. (00:07:06) - The Frost started as an experiment to see if a narrative film could be created completely from AI imagery. (00:10:38) - Parker started generating images with DALL-E 2 when he got access to the early preview. (00:12:26) - Prompt technique to get consistent images by providing context about a hypothetical film. (00:15:57) Sponsors: Netsuite | Omneky (00:19:37) - Compositional continuity, like shot-reverse shot, was hard to achieve through prompting. (00:22:13)- Rubin would request specific shots and the team would prompt DALL-E 2 to create them (00:32:25) - Getting consistent facial features for characters was very difficult. (00:39:03) - The storytelling helped cover inconsistencies that viewers might not notice. (00:40:15) - Working with the images DALL-E provides (00:44:53) Inpainting and compositing to refine DALL-E Images (00:50:43) - The AI art is limited by what exists in the training data. (01:02:05)- Animating the human characters was challenging because of missing or incorrect appendages. (01:07:36) - The team had to find creative ways to convey emotion through the limited animation. 01:02:24 - Animating subtle human movement and emotion is still very difficult. (01:06:35) - A romantic comedy would be much harder to produce with current AI capabilities. (01:12:17) - For Frost 2 they are using text-to-video models like RunwayML. (01:15:43) - AI voicing advancements applied to filmmaking (01:19:27) - The future of AI in Hollywood and filmmaking: quality narratives still require human vision SPONSORS: Shopify | NetSuite | Omneky Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. Music Credit: GoogleLM
In this episode, Trey Kollmer, WGA Writer and Co-Executive of the show Ghosts, returns to the show to discuss updates to the Hollywood Strikes, including news on SAG-AFTRA and WGA. Trey and Nathan chat why actors are joining the strikes, how AI will change acting as a profession, Trey’s views on reasoning and how he’s experimenting with GPT-4, and much, much more. We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. TIMESTAMPS: (00:04:01) Hollywood and AI: updates on SAG-AFTRA and the WGA (00:15:20) Sponsors: NetSuite | Omneky (00:18:56) Studio approach to copyright and compensation with generative AI (00:22:17) Hollywood receptiveness to using AI and protections guild members are asking for (00:24:56) Models implementing gradient descent in the weights (00:29:14) How Nathan uses models to write for the podcast (00:34:15) Generating and mining jokes in the writer’s room (00:40:18) Untraining models (00:44:20) AI writing tools and writer perception of them (00:46:34) Context length and pooling layers (00:51:11) Microsoft China (01:00:02) Actors’ strike (01:05:45) Using 1 million DALL-E images to create an AI short film (01:09:11) Deepfakes (01:12:51) The future where anyone can be a reasonable synthetic actor (01:17:33) Trey’s take on reasoning and why Hollywood should be more open to AI (01:25:49) A monk’s experience with Chat-GPT (01:28:56) Outdatedness of stochastic parrot notion; reasoning and synthesis (01:36:14) Model vs human susceptibility to adversarial attacks because of human robustness (01:47:30) Performance jumping with abstraction (01:49:22) Language model self-delegation (01:51:04) NVIDIA’s margins compared to TSMC and ASML (02:07:35) Adding an AI layer and competing with incumbents (02:13:10) Rewind AI (02:19:27) Big tech vs old school studios (02:14:52) Dramatic ironies from the picketing lines (02:21:38) AI development moments that feel like a movie (02:26:34) CEO of Inflection’s views on misuse being a greater threat than the AI itself SPONSORS: Shopify | NetSuite | Omneky Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. Music Credit: GoogleLM
In this episode, Nathan sits down with three members of the a16z x Convex AI Town project: Yoko Li (Partner, a16z), Martin Casado (GP, a16z), and James Cowling (CTO, Convex). AI Town is a virtual town where AI agents live, interact, and socialize. They discuss how AI Town originated from Yoko’s companion app project, unpredictability as a feature in LLMs and interacting with models like they are lifeforms, and why they chose Javascript and Convex to build AI Town. If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. 📣 CALL FOR FEEDBACK: To borrow from a meme… we're in the podcast arena trying stuff. Some will work. Some won't. But we're always learning. http://bit.ly/TCRFeedback Fill out the above form to let us know how we can continue delivering great content to you or sending the feedback on your mind to tcr@turpentine.co.  TIMESTAMPS: (00:00:00) - Episode Preview: Intro to AI Town and the idea of AI as companions (00:05:29) - Overview of AI Town and the simulation framework based on the Stanford Generative Agents paper (00:08:24) - Yoko explains how the idea for AI Town originated from the companion app project (00:12:31) - The simplicity and elegance of the AI Town codebase (00:15:47) - Sponsors: Netsuite | Omneky (00:18:25) - How Convex built a server-side game engine for AI Town  (00:23:39 )- James emphasizes the power of functional programming paradigms like Convex for building AI apps (00:25:02) - Using simple JavaScript so anyone could understand and extend AI Town (00:30:23) - How AI coding assistants were used in building AI Town  (00:31:22) - No open source code for the Stanford paper when they started (00:33:25) - The interplay between programmer and AI model (00:38:01)- Martin draws a distinction between using formal languages vs. natural language (00:43:21) The balance between formal language and unpredictable behaviours in LLMs (00:48:27) Are we living in a simulation? (00:50:38) Advice for other developers in AI (00:54:29) AI Town is a community project to be extended on SPONSORS: Shopify | NetSuite | Omneky Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. Music Credit: GoogleLM
In this episode, Nathan sits down with Daniel Kang, Assistant Professor of Computer Science at the University of Illinois. Kang has done pioneering work bringing zero knowledge cryptographic proofs to AI. In this episode, they chat about the cryptographic theory behind Daniel's work, how cryptography allows us to balance the tradeoff between privacy and authenticity, and how cryptography usage is needed in a world where LLMs are increasingly embedded into our daily lives. If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. CALL FOR FEEDBACK: To borrow from a meme… we're in the podcast arena trying stuff. Some will work. Some won't. But we're always learning. http://bit.ly/TCRFeedback Fill out the above form to let us know how we can continue delivering great content to you or sending the feedback on your mind to tcr@turpentine.co.  TIMESTAMPS: (00:00) Episode Preview (00:01:04) Nathan's Introduction (00:07:06) Motivation for bringing zero-knowledge proofs to AI (00:10:27) Verifying model execution without revealing model details (00:12:42) Verifying medical AI services haven't been tampered with (00:15:09) Sponsors: Netsuite | Omneky (00:18:54) Cryptographic hashes for commitments (00:22:42) Assumptions underlying cryptographic hashes  (00:25:20) Adding entropy through salting  (00:26:24) Z case snarks and the proving process  (00:31:00) Using lookup tables for nonlinearities (00:33:35) Floating point vs fixed point calculations  (00:34:08) Quantizing models for efficiency (00:35:55) Using polynomials to represent arbitrary computations (00:37:26) What are finite fields?  (00:41:23) Toxic waste for cryptographic secrecy (00:45:51) Computational costs (00:47:39) The experience of using a cryptography application to verify model output   (00:49:05) Verification key doesn't reveal model weights (00:56:36) What using crypto infrastructure in AI enables and challenges to its implementation  (01:01:26) Potential for 10-100x cost reductions (01:04:51) Authenticating images with attested cameras (01:11:56) How cryptography in AI could impact daily life (01:14:25) On-device credential verification (01:15:50) Potential for regulation of hardware authentication (01:18:52) Upcoming work to reduce proof costs LINKS: Daniel's website SPONSORS: Shopify | NetSuite | Omneky Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. Music Credit: GoogleLM
In this episode, Nathan and Erik sit down to analyze Hugging Face in light of its recent $235M Series D round. They analyze Hugging Face’s community and defensibility through the lens of other community businesses like ProductHunt and Yelp, assess its ability to fulfill its $4.5 billion valuation, and assess competitors and other notable companies in the space like Replit, Character, and Runway. If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. TIMESTAMPS: (00:00:57) Episode Preview (00:01:52) Nathan’s Introduction (00:04:57) Overview of Hugging Face and recent fundraising announcement (00:08:13) Hugging Face’s product line (00:16:47) Sponsors: Netsuite | Omneky (00:18:36) Community driven businesses and HuggingFace’s moat (00:23:23) Discovery and inference (00:28:04) Hugging Face’s ideological nature (00:31:31) Curation is key (00:33:46) Keeping content fresh when AI moves so fast (00:35:44) If Hugging Face is a $50 billion company one day, what would it look like? (00:48:08) Hugging Face vs Replit (00:57:19) Contrasting Hugging Face with other companies like Character and Runway LINKS MENTIONED: Hugging Face's LLM leaderboard X/TWITTER: @labenz (Nathan) @eriktorenberg @CogRev_Podcast SPONSORS: Shopify | NetSuite | Omneky Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. Music Credit: GoogleLM
In this episode, Nathan sits down with Paige Bailey, Lead Product Manager of Generative Models at Google Deepmind. In this conversation, they discuss what it's like to be a PM for an LLM as opposed to an app, defining ideal LLM behaviour, and reasoning - how do you distinguish real abilities vs pattern matching? If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. TIMESTAMPS: (00:00) Episode Preview (00:01:15) Introducing Paige Bailey (00:04:21) Paige’s background at Google Brain and the Deepmind merger (00:07:00) PM for a LLM vs being a PM for an app (00:11:21) The development timeline and compute budget of PaLM-2 (00:14:30) Paige’s role in the PaLM 2 project (00:15:30) Sponsors: Netsuite | Omneky (00:17:26) Defining desired capabilities for PaLM-2 (00:19:17) The amount of work that went into elevating PaLM 2 from PaLM 1 (00:20:28) Has Google lost its ability to ship? (00:24:240) Paige's "eureka" moment seeing GitHub Copilot capabilities (00:27:47) Competing PaLM 2 with other models (00:32:20) Grokking and the predictability of emergent capabilities (00:37:30) Citizen scientists and the multilingual capabilities of PaLM 2 (00:39:29) Distinguishing real reasoning vs pattern matching (00:45:51) Products using PaLM-2 that people should try (00:50:35) Most exciting AI projects that you can try out (00:52:29) Curriculum learning and successor to the transformer LINKS: PaLM 2 Duet AI for developers Avenging Polayni’s Revenge X/TWITTER: @DynamicWebPaige (Paige) @labenz (Nathan) @eriktorenberg @CogRev_Podcast SPONSORS: Shopify | NetSuite | Omneky Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. Music Credit: GoogleLM
Join Nathan Labenz and Erik Torenberg as they analyze the latest developments from OpenAI on GPT 3.5, compare GPT to other live player models like Llama2, and discuss the state of AI in coding, education, and healthcare. If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. RECOMMENDED PODCAST: The HR industry is at a crossroads. What will it take to construct the next generation of incredible businesses – and where can people leaders have the most business impact? Hosts Nolan Church and Kelli Dragovich have been through it all, the highs and the lows – IPOs, layoffs, executive turnover, board meetings, culture changes, and more. With a lineup of industry vets and experts, Nolan and Kelli break down the nitty-gritty details, trade offs, and dynamics of constructing high performing companies. Through unfiltered conversations that can only happen between seasoned practitioners, Kelli and Nolan dive deep into the kind of leadership-level strategy that often happens behind closed doors. Check out the first episode with the architect of Netflix’s culture deck Patty McCord. https://link.chtbl.com/hrheretics TIMESTAMPS: (00:00) Episode Preview (00:01:00) GPT 3.5 Turbo (00:06:36) Llama 2 vs GPT (00:11:24) How much inference is needed to double compute costs? (00:13:40) OpenAI’s moat (00:14:41) OpenAI’s privacy consideration for data (00:16:06) Sponsor: Netsuite | Omneky (00:17:46) Encouraging the usage of instructions during fine-tuning (00:19:19) Live player consideration of AI safety (00:22:35) Da Vinci: new completions fine tuneable model (00:24:59) Chat-GPT usage in decline (00:30:03) Getting on demand tutoring on ML papers (00:31:00) Code, education, and healthcare (00:31:42) AI applications in coding (00:38:12) AI revolution n education (00:42:35) AI revolution in healthcare (00:52:17) Call for feedback LINKS: Replit episode with Tyler Angert Replit episode with VP of AI, Michele Catasta AI Revolution in Education with Khan Academy's Director of Engineering, Shawn Jansepar Google's Multimodal Med-PaLM with Vivek Natarajan and Tao Tu X: @labenz (Nathan) @eriktorenberg (Erik) @cogrev_podcast SPONSORS: Shopify | NetSuite | Omneky Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off.
In this episode, Nathan sits down with Vivek Natarajan and Tao Tu of Google’s Med-PaLM, diving into how they used one of the world’s largest medical datasets ever compiled to develop Med-PaLM M, an AI agent specialized in medical tasks. In this episode, they discuss: Med-PaLM M's “clinically superhuman” abilities and limitations, the rigorous testing and validation that went into the model, and their vision for AI to take over repetitive clerical tasks and allow doctors to focus on patients. We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. TIMESTAMPS: (00:00) Episode Preview (00:00:56) Introducing Vivek Natarajan and Tao Tu (00:04:18) The story of Google’s Medical AI research progress (00:07:11) Multi-modal Med-PaLM (00:10:32) Genomic data - how do you represent it? (00:11:13) Google’s Deep Variant (00:14:44) The successes and failures behind the incredible pace of progress (00:15:02) Sponsors: Netsuite | Omneky (00:21:54) Google’s research culture and assembling an interdisciplinary team (00:31:36) Google’s Pathways (00:33:40) Med-PaLM M's architecture (00:37:28) Working with 3 different model sizes and what you learn (00:46:56) Data and compute required for Med-PaLM M (00:49:38) Med-PaLM M's cycle time (00:54:56) Is a bridge or adapter structure worth implementing? (01:00:09) Can we create an AI doctor? (01:02:39) Emergent capabilities like identifying tuberculosis (01:09:37) Reactions to these emergent capabilities (01:11:13) Moving towards clinical trials and real-world testing (01:13:01) Regulatory and safety considerations (01:15:03) AI safety in the healthcare domain (01:17:00) Potential to transform healthcare access worldwide LINKS: Med-PaLM: https://sites.research.google/med-palm/ Med-PaLM M paper: https://arxiv.org/abs/2307.14334 Our earlier conversation with Vivek Natarajan on Med-PaLM: https://www.youtube.com/watch?v=nPBd7i5tnEE X/TWITTER: @vivnat (Vivek) @taotu831 (Tao) @labenz (Nathan) @eriktorenberg @CogRev_Podcast SPONSORS: NetSuite | Omneky Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off.
In this episode, Nathan sits down with Jon Noronha, co-founder of Gamma. Gamma is a new medium for presenting ideas, allowing you to focus on your ideas and receive beautiful, engaging content without the formatting work. In this episode, Jon and Nathan discuss the journey of building Gamma, how to coax AI to do things well, and the opportunity for AI A/B testing. If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. TIMESTAMPS: (00:00:00) - Preview (00:01:23) - Nathan introduces Jon Noronha (00:06:36) - Intro - Jon Noronha introduces himself and Gamma (00:09:36) - Gamma's origin story: building the "anti-PowerPoint" pre-GPT-3 (00:13:15) - From using AI for onboarding to generating near-complete presentations. (00:15:11) - Sponsors: Netsuite | Omneky (00:18:01) - If Notion and Canva had a baby (00:23:35) - Searching for the right structure for AI, landing on HTML (00:28:16) - Degrees of freedom - developing a constrained vocabulary of semantic blocks (00:29:30) - Choice of model(s) – weighing cost, speed, and quality tradeoffs (00:35:18) - Editing UI - getting AI to edit slides per user command (00:38:04) - UI for gathering training data - following Midjourney's example (00:40:00) AI A/B Testing: a big opportunity space (00:43:22) - Image generation models - Baseten and Gamma's deployment of it (00:45:37) - Pacing feature development - Trying to stay ahead of innovations like 3D, video, voice etc. (00:47:45) Image generation for slidedecks and AI involvement (00:50:29) Gamma's main building priorities and AI generated websites (00:52:34) - Competing with giants like Microsoft and Google (00:55:04) - Enterprise AI shipping challenges - Startups pioneer new patterns; giants will eventually follow. (00:57:45) - Simplifying complexity - will models smooth over the complexity of bloated product suites? (00:59:22) - Conclusion and final thoughts X/TWITTER: @thatsjonsense (Jon) @labenz (Nathan) @eriktorenberg @CogRev_Podcast LINKS: Gamma: https://gamma.app/ SPONSORS: Shopify |NetSuite | Omneky Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off.
In this episode, Nathan sits down with Shawn Jansepar, Director of Engineering at Khan Academy, to discuss their GPT-4 powered Socratic tutor, Khanmigo. In this conversation, Shawn and Nathan chat about Khan Academy’s collaboration with OpenAI and how they helped fine-tune GPT-4, how Khan Academy leveraged GPT-4 to build Khanmigo, and the impact of providing access to an AI tutor to any student. If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. TIMESTAMPS: (00:00) Episode Preview: Education 10 years from now (04:42) Khan Academy’s early access partnership with OpenAI (06:31) Khanmigo: journey from Chrome extension to AI tutor (11:36) GPT-4’s ability to be Socratic vs 3.5 (15:05) Sponsors: Netsuite | Omneky (16:40) Integrating Khan Academy’s Pedagogy into AI (20:06) The future of education 10 years from now  (22:37) Khan Academy’s models (27:20) Demo-driven development process (31:16) Sculpting the behaviour of a Socratic tutor model  (35:59) Khan Academy’s contribution to GPT-4’s fine-tuning and RLHF (38:41) Being data-informed vs data-driven as a practice  (42:10) Incurring tech debt to get ahead of the curve (45:28) The boundary for what an AI can/can’t t tutor  (49:30) Identifying when the user is confused and avoiding AI hallucinations (53:54) Khanmigo’s development patterns  (59:11) Making Khanmigo jailbreak resistant  (01:01:50) Delivering personalized education with AI  (01:04:08) How Shawn and his team are thinking about AI education (01:05:33) Khanmigo’s future multimodal interactivity (01:08:42) Evaluating Khanmigo’s efficacy for student learning  (01:11:41) How widely is Khanmigo deployed today and what is the future for universal public access? (01:05:11) Distribution through teachers and districts (01:16:30) What are the reactions from teachers and education institutions to AI? (01:18:15) Khanmigo’s pricing model (01:19:03) The future roadmap for Khanmigo (01:20:45) How will the AI tutor change the world at large? LINKS: Khanmigo: khan.co/khanmigo23 Benjamin Bloom’s 2-Sigma Problem: https://web.mit.edu/5.95/www/readings/bloom-two-sigma.pdf X/TWITTER: @shawnjan8 (Shawn) @labenz (Nathan) @eriktorenberg @CogRev_Podcast SPONSORS: Shopify | NetSuite | Omneky Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off.
Join Nathan Labenz and Erik Torenberg as they analyze the last month in AI advancements. Nathan takes us through the meaningful updates to his Scouting Report (released last month, linked below), discusses highlights from recent episodes of The Cognitive Revolution, and gives us a sneak peek at upcoming interviews with Google researchers. If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. TIMESTAMPS: (01:00) How does the AI Scouting Report hold up a few weeks later? (03:29) Zvi’s feedback on Nathan’s Tale of the Cognitive Tape (10:25) The universal LLM jailbreak and adversarial examples (12:53) Human performance is much more variable than AI performance (14:45) Sponsors: NetSuite | Omneky (16:09) Nathan’s AI Task Automation: What are good targets for tasks that can be automated for average businesses?  (20:05) Is GPT-4 getting worse or better? (22:00) Getting explicit about what good looks like (24:00) Prompting best practices are very accessible (26:35) Ghostwriting - and the art of the hook (28:05) Live Players: Which companies have say so over how the future goes? (31:10) Upcoming guests from Google AI (35:40) Possible post-transformer architectures LINKS: SCOUTING REPORT Part 1: https://youtu.be/0hvtiVQ_LqQ SCOUTING REPORT Part 2: https://youtu.be/ovm4MbQ4G9E SCOUTING REPORT Part 3: https://youtu.be/QJi0UJ_DV3E 3 Blue 1 Brown on YouTube: https://www.youtube.com/@3blue1brown Tale of the Cognitive Tape in Part 1 of the Scouting Report: https://www.youtube.com/watch?v=0hvtiVQ_LqQ&t=3043s Analyzing the Frontier with Zvi Mowshowitz: https://www.youtube.com/watch?v=SM4q-QAsoU8&t=1s Tyler Cowen’s Interview with Jonathan Swift: https://conversationswithtyler.com/episodes/jonathan-gpt-swift/ X: @labenz (Nathan) @eriktorenberg (Erik) @cogrev_podcast SPONSORS: Shopify | NetSuite | Omneky Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you're looking for an ERP platform ✅ head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist.  Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off.
In this episode, Nathan sits down with Replit’s VP of AI, Michele Catasta. Replit is building what CEO Amjad Masad calls "the perfect substrate for AGI." In this discussion, Michele and Nathan discuss Replit's state of AI development report, advantages when it comes to AI development, and the company's custom models. If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. TIMESTAMPS: (00:00) Episode Preview (00:00:57) Introduction (04:44) What is artificial developer intelligence? (15:05) Sponsors: Netsuite | Omneky (16:58) Michele's background at Google & decision to join Replit (19:16) Startups vs incumbents (24:42) Whether Replit identifies as an e/acc company (26:37) Staying apolitical on AI while being responsible (30:36) The rise of LangChain and polarized reactions (35:14) Estimates on developer productivity gains from AI assistance (2x-10x) (38:35) Democratizing software development through easy customization (44:02) AI generating disposable single-use software (51:33) Optimism about humanity's ability to handle transformative AI (55:01) The need for nuanced AI safety discussions (56:14) Replit's data advantage from user code execution (01:04:31) Replit's approach to training custom AI models (01:08:51) The value of both open source and commercial models (01:13:18) Michele’s highlights from being a Google researcher (01:15:47) World knowledge needs in AI development (01:20:37) Replit’s approach to AI safety (01:24:28) The advantage of having a commercial model (01:25:54) The costs of serving AI features to millions of users (01:28:49) Modeling cost per user with AI workloads (01:30:50) Pushing AI inference to the edge (01:32:18) Ghostwriter integrating more deeply into Replit's IDE (01:33:37) Replit as a potential "substrate for AGI" LINKS: https://replit.com/ Replit's State of AI Development Report: https://blog.replit.com/ai-on-replit X: @pirroh (Michele) @labenz (Nathan) @eriktorenberg (Erik) @cogrev_podcast SPONSORS: Shopify | NetSuite | Omneky - Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive - NetSuite has 25 years of providing financial software for all your business needs. More than 36,000 businesses have already upgraded to NetSuite by Oracle, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you’re looking for an ERP platform, head to NetSuite: http://netsuite.com/cognitive and download your own customized KPI checklist. - Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. MUSIC CREDIT: MusicLM
In this episode, Nathan sits down with Tyler Angert, Product Designer at Replit, to discuss the future of software development. Replit is building what CEO Amjad Masad calls "the perfect substrate for AGI." In this discussion, Tyler and Nathan discuss how Replit is leveraging AI to enhance its current product, bot-bot interactions, the design and ethical considerations around AI agents, and more. If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. TIMESTAMPS: (00:00) Episode Preview (01:10) Nathan’s Intro (09:24) Tyler's role at Replit (11:37) Replit as the "perfect substrate for AGI" (14:55) Sponsor: Netsuite | Omneky (15:45) Defining AGI (19:26) How AI agents might interact with Replit (23:20) Replit's "virtual developer" product (31:11) Current state of Replit's AI features like Ghostwriter (41:48) Measuring productivity boost from AI coding tools (45:29) Potential for massive developer productivity gains from AI (48:34) Technical gaps still remaining to achieve advanced AI agents (51:45) Core AI breakthroughs have already occurred (57:35) Timeline for functional AI agents interacting online (01:01:20) Safety considerations for powerful AI agents on Replit (01:08:47) Ethical considerations around AI and consciousness (01:20:36) What constitutes consciousness in an AI system (01:26:30) Should AI systems have rights and protections? (01:30:32) Being polite to AI systems (01:31:59) Advice for beginners looking to leverage AI (01:36:58) Using AI with a Neuralink brain implant (01:43:02) Hopes and fears about AI's impact on society LINKS: https://replit.com/ X: @tylerangert (Tyler) @labenz (Nathan) @eriktorenberg (Erik) @cogrev_podcast SPONSORS: Shopify | NetSuite | Omneky  Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive -NetSuite provides financial software for all your business needs. More than thirty-six thousand companies have already upgraded to NetSuite, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you’re looking for an ERP platform: NetSuite (http://netsuite.com/cognitive) and defer payments of a FULL NetSuite implementation for six months.  -Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that actually work customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. MUSIC CREDIT: MusicLM  This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at erik@turpentine.co.
This isn't news, it's analysis! Nathan Labenz sits down for an with Zvi Mowshowitz, the writer behind Don't Worry About the Vase to talk about the major players in AI over the last few months. In this extended conversation, Nathan and Zvi debate if AI has attained the intelligence of a well-read college graduate (per OpenAI's Jan Leike), a live player analysis (who to count/ who not to count), and the role of independent red teaming organizations. If you're looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive Definitely also take a moment to subscribe to Zvi's blog Don't Worry About the Vase (https://thezvi.wordpress.com/) - Zvi is an information hyperprocessor who synthesizes vast amounts of new and ever-evolving information into extremely clear summaries that help educated people keep up with the latest news. Highly recommend. We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. TIMESTAMPS: (00:00) Episode preview (03:15) Is AI as intelligent as a college grad? (07:45) Memories and context processing (15:45) Sponsor: NetSuite | Omneky (17:13) Is AI as intelligent as a college grad? cont'd (20:47) Strengths and weaknesses of AI vs human (31:05) OpenAI Superalignment (37:23) The relationship between OpenAI and Anthropic (44:31) Anthropic's security recommendations and adversarial attacks (50:50) Is OpenAI using a constitutional AI approach?  (01:01:26) Context and stochastic parrots (01:10) Is more context better? (01:15:29) Should Nathan work at Anthropic? (01:21:35) Google DeepMind's RT-2 (01:27:47) Multi-modal Med-PaLM (01:31:50) Speculating about Gato (01:35:10) Skepticism about Med-PaLM usage in radiology (01:41:37) Llama 2 - what is going on at Meta?? (01:51:14) Llama 2 vs other models (01:55:29) Who are the live players? (02:01:38) China's AI developments (02:02:41) Character AI and Inflection (02:05:26) Replit as the perfect substrate for AGI (02:10) AI girlfriends (02:18:53) AI safety: The White House (02:25:43) Bottlenecks to progress (02:35:27) Can new players influence AI policy? (02:39:00) Liabilities (02:47:54) Independent red teaming organizations (02:57:18) Mechanistic interpretability X: @labenz (Nathan) @thezvi (Zvi) @eriktorenberg (Erik) @cogrev_podcast  SPONSORS: Shopify | NetSuite | Omneky Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive -NetSuite provides financial software for all your business needs. More than thirty-six thousand companies have already upgraded to NetSuite, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you’re looking for an ERP platform: NetSuite (http://netsuite.com/cognitive) and defer payments of a FULL NetSuite implementation for six months. -Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that *actually work* customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. MUSIC CREDIT: MusicLM
Arthur Conmy sits down with Nathan Labenz for an accessible deep dive into the state of interpretability research online today. They discuss how pioneering researchers have painstakingly worked to isolate the sub-circuits within transformers that are responsible for different aspects of AI capabilities. Arthur also introduces us to a new ACDC approach that he and his co-authors have taken to automating some of the most time-consuming parts of this work. If you’re looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. RECOMMENDED PODCAST: The HR industry is at a crossroads. What will it take to construct the next generation of incredible businesses – and where can people leaders have the most business impact? Hosts Nolan Church and Kelli Dragovich have been through it all, the highs and the lows – IPOs, layoffs, executive turnover, board meetings, culture changes, and more. With a lineup of industry vets and experts, Nolan and Kelli break down the nitty-gritty details, trade offs, and dynamics of constructing high performing companies. Through unfiltered conversations that can only happen between seasoned practitioners, Kelli and Nolan dive deep into the kind of leadership-level strategy that often happens behind closed doors. Check out the first episode with the architect of Netflix’s culture deck Patty McCord. https://link.chtbl.com/hrheretics The Cognitive Revolution is a part of the Turpentine podcast network. Learn more: Turpentine.co TIMESTAMPS: (00:00) Episode Preview (04:40) What attracted Arthur to mechanistic interpretability? (07:49) LLM information processing: General Understanding vs Stochastic Parrot Paradigm (14:00) ACDC paper: https://arxiv.org/abs/2304.14997  (14:45) Sponsors: NetSuite | Omneky (24:30) Putting together data sets  (32:39) How to intervene in LLMs network activity (36:00) Defining metrics to evaluate the production of correct completions (44:20) The future of the mechanistic interpretability research  (50:00) Extracting upstream activations in the ACDC project and evaluating impact on downstream components. (56:00) Anthropic research findings  (01:08:00) 3-Step process of the ACDC approach (01:22:00) Setting a threshold and validation (01:27:00) Goal of the approach (01:32:00) Compute requirements Correction: at (01:33:00), Arthur meant to say = "quadratic in nodes" (01:35:30) Scaling laws for mechanistic interpretability (01:40:00) Accessibility of this research for casual enthusiasts (01:46:00) Emergence discourse (01:56:00) Path to AI safety LINKS: https://arthurconmy.github.io/ https://arxiv.org/abs/2304.14997  X: @labenz (Nathan) @arthurconmy (Arthur) @cogrev_podcast SPONSORS: NetSuite | Omneky -NetSuite provides financial software for all your business needs. More than thirty-six thousand companies have already upgraded to NetSuite, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you’re looking for an ERP platform: NetSuite (http://netsuite.com/cognitive) and defer payments of a FULL NetSuite implementation for six months. -Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that *actually work* customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off. This show is produced by Turpentine: a network of podcasts, newsletters, and more, covering technology, business, and culture — all from the perspective of industry insiders and experts. We’re launching new shows every week, and we’re looking for industry-leading sponsors — if you think that might be you and your company, email us at erik@turpentine.co.
Nathan Labenz sits down with Dr. Ronen Dar, CTO and co-founder of Run:ai, an Israel-based company that helps enterprises train and deploy AI models by optimizing GPU usage. The discussion covers how chip makers can meet the soaring demands, geopolitical fears, to the best practices companies can secure compute capacity. If you’re looking for an ERP platform, check out our sponsor, NetSuite: http://netsuite.com/cognitive We're hiring across the board at Turpentine and for Erik's personal team on other projects he's incubating. He's hiring a Chief of Staff, EA, Head of Special Projects, Investment Associate, and more. For a list of JDs, check out: eriktorenberg.com. RECOMMENDED PODCAST: The HR industry is at a crossroads. What will it take to construct the next generation of incredible businesses – and where can people leaders have the most business impact? Hosts Nolan Church and Kelli Dragovich have been through it all, the highs and the lows – IPOs, layoffs, executive turnover, board meetings, culture changes, and more. With a lineup of industry vets and experts, Nolan and Kelli break down the nitty-gritty details, trade offs, and dynamics of constructing high performing companies. Through unfiltered conversations that can only happen between seasoned practitioners, Kelli and Nolan dive deep into the kind of leadership-level strategy that often happens behind closed doors. Check out the first episode with the architect of Netflix’s culture deck Patty McCord. https://link.chtbl.com/hrheretics RECOMMENDATION: The AI Scouting Report Playlist Parts 1-3: https://www.youtube.com/watch?v=0hvtiVQ_LqQ&list=PLVfJCYRuaJIXooK_KWju5djdVmEpH81ee TIMESTAMPS: (00:00) Episode Preview (00:51) Introduction to Dr. Ronen Dar (03:30) Run:ai's technology and what differentiates it from other solutions (06:00) Today's market compared to when Dr. Ronen started five years ago (13:40)Run:ai on market competitors like mosaicML (14:55) Sponsors: NetSuite | Omneky (22:00) The process and best practices by which companies secure compute capacity (25:00) Dr. Ronen explains the GPU shortage (31:50) GPU solutions (36:00) Relative pricing across major providers (41:00) What other chip makers are going to be relevant? (49:00) Global outlook for chip production (52:45) Worldview around the US-China AI race (58:00) Can controls on hardware actually control access to AI? LINKS: https://www.run.ai/ SOCIAL MEDIA: @labenz (Nathan) @ronen_dar @runailabs (Run:ai) @cogrev_podcast SPONSORS: Shopify | NetSuite | Omneky Shopify is the global commerce platform that helps you sell at every stage of your business. Shopify powers 10% of ALL eCommerce in the US. And Shopify's the global force behind Allbirds, Rothy's, and Brooklinen, and 1,000,000s of other entrepreneurs across 175 countries.From their all-in-one e-commerce platform, to their in-person POS system – wherever and whatever you're selling, Shopify's got you covered. With free Shopify Magic, sell more with less effort by whipping up captivating content that converts – from blog posts to product descriptions using AI. Sign up for $1/month trial period: https://shopify.com/cognitive -NetSuite provides financial software for all your business needs. More than thirty-six thousand companies have already upgraded to NetSuite, gaining visibility and control over their financials, inventory, HR, eCommerce, and more. If you’re looking for an ERP platform -> NetSuite: http://netsuite.com/cognitive and defer payments of a FULL NetSuite implementation for six months. -Omneky is an omnichannel creative generation platform that lets you launch hundreds of thousands of ad iterations that *actually work* customized across all platforms, with a click of a button. Omneky combines generative AI and real-time advertising data. Mention "Cog Rev" for 10% off.