2026-04-15
Attention Through the Lens of Numerical Linear Algebra
From the database analogy to randomised approximation — a mathematical reading of the attention mechanism and the numerical methods that now sit underneath every modern Transformer.
Writing about interests; Computer Science, Philosophy, Physics, Mathematics and AI.
From the database analogy to randomised approximation — a mathematical reading of the attention mechanism and the numerical methods that now sit underneath every modern Transformer.
An exploration of how artificial intelligence and infrastructure operations are converging, covering MLOps, AIOps, LLMs as infrastructure, and the evolving role of platform engineers
There is no better way to understand a machine learning algorithm than to build it yourself, with nothing between you and the mathematics. Toolboxes are convenient — and I use them in production — but …