Posts
Process notes, explanations, and the occasional finished thing.
2026
- What Residual Streams Look LikeA Transformer as a Dynamical System, Part 2: Observing GPT-2 Internal States
- This site exists nowWhat this is, what it is not, and the one rule for what goes on it.
- Residual Stream as a Dynamical System StateA Transformer as a Dynamical System, Part 1: Reading Elhage et al. (2021) as a state equation