Reasoning Models From Scratch: Code Setup
A little video that
- explains the relationship between conventional LLMs and reasoning models (and agents),
- philosophizes about “from scratch” approaches,
- and explains how to install the Python and PyTorch requirements with
uv.
The video is here: Build A Reasoning Model From Scratch #1: Motivation & Code Setup.
Source: website version of my Substack note.
Read Next
OpenAI Astra and Looped Transformers
A short note on OpenAI Astra, recurrent depth, looped transformers, Nanbeige 4.2, and the Mixture-of-Recursions paper.
Two Live Book Club Q&As on September 3
Two free live book club Q&A sessions on September 3 about Build a Reasoning Model From Scratch and related reader questions.
GLM-5.3-Flash Architecture Notes
Architecture note on GLM-5.3-Flash, formerly Ox Alpha, covering its KDA and MLA/DSA hybrid attention, sparse MoE backbone, and four-stream mHC residual pat