“The separation principle: where beliefs and desires come from?” by Fernando Rosas
“The separation principle: where beliefs and desires come from?” by Fernando Rosas  
Podcast: LessWrong (30+ Karma)
Published On: Mon Aug 31 2026
Description: TLDR: Psychology, economics, and other disciplines describe agents as systems driven by beliefs and desires. This post argues that the belief-desire view can be derived from classic theorems from optimal control and reinforcement learning. This suggests seeing beliefs and desires as properties of optimal policies rather than as assumptions from folk psychology. Introduction One way to think about agents is as "systems that act for reasons". This compact statement can be interpreted as encapsulating two key implications: The notion of action assumes a boundary between agent and environment, so that the former can act on the latter.The term reason captures two kinds of internal activity: motivations associated with how to achieve specific goals or outcomes, and beliefs regarding what the agent infers to be the current state of affairs. In other words, an agent is a well-differentiated system that acts based on beliefs and desires. This view is compatible with perspectives that have been developed by various disciplines: Behavioural science, which sees agency as goal-directed behaviour.Economics, which treats agency as the ability to select policies to achieve an objective.Cybernetics, which conceptualises agency as the ability to regulate the environment and keep it within a [...] ---Outline:(00:35) Introduction(02:28) What is a separation principle?(05:17) The inference-control separation principle(05:40) Separation principle in optimal control theory(09:20) Separation principle in reinforcement learning(13:47) Interim summary(14:34) Implications(14:56) Beliefs and desires as properties of solutions(18:08) Agents as cognitive light-cones(19:01) The separation principle is normative, not descriptive(22:00) Coda The original text contained 17 footnotes which were omitted from this narration. --- First published: August 31st, 2026 Source: https://www.lesswrong.com/posts/awMDNhoL6J97s6wFJ/the-separation-principle-where-beliefs-and-desires-come-from --- Narrated by TYPE III AUDIO. ---Images from the article:Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.