“GPT-6 Astra can do a lot of multi-hop reasoning without chain of thought” by RohanS
“GPT-6 Astra can do a lot of multi-hop reasoning without chain of thought” by RohanS  
Podcast: LessWrong (30+ Karma)
Published On: Wed Sep 09 2026
Description: This is a link post for https://rohansubramani.github.io/astra-no-cot. I recommend reading there for the best experience because it's easier to engage with this post when you can read the correct reasoning and answers to the multi-hop questions. I didn't want to include those here in order to avoid LLMs being trained on them. Some parts of the post also respond to users hovering over bars in graphs, which isn't supported in LessWrong (as far as I know). TLDR GPT-6 Astra is much better than GPT-5.6 Sol at solving multihop reasoning questions without using chain of thought. The table below shows some examples I find particularly instructive. Sol is bad at all the selected problems; Astra is good at some, ok at others, and bad at others, so the table gives some flavor of the limits of Astra's no-CoT serial reasoning ability. I'm pretty sure Astra actually isn't doing any chain of thought because it sometimes gets the hardest of these questions wrong, the API says reasoning_tokens=0, and there's no reasoning in the output. It's possible Astra can correctly answer some of these questions without internally doing every step in the chain of reasoning, but for most of them, I think [...] ---Outline:(00:35) TLDR(02:45) Some of my favorite examples(03:09) Background context(04:34) What should we make of this?(06:36) Results graphs The original text contained 1 footnote which was omitted from this narration. --- First published: September 8th, 2026 Source: https://www.lesswrong.com/posts/FsCkkoGsNmPzFKRhg/gpt-6-astra-can-do-a-lot-of-multi-hop-reasoning-without --- Narrated by TYPE III AUDIO. ---Images from the article:Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.