4 pages

Deep Learning

Apr 29, 20269 min read

Adaptive Filters and Stochastic Gradient Descent: One Update Rule, Two Vocabularies

Modern AI is often framed as a clean break from classical engineering. For anyone who has worked in adaptive signal processing, that framing is misleading. The mathematical spine …

Apr 14, 20265 min read

I Spent Years on Adaptive Filters. I Was Already Training Neural Networks.

I spent years implementing LMS-based equalizers and echo cancellers in telecommunications. Only later did I fully appreciate what I had been doing mathematically: the same family …

Mar 20, 20263 min read

The AI Hierarchy — From Broad to Specific

The AI Hierarchy — From Broad to Specific Part 1 of 4 in the Generative AI Foundations series Let’s start with the thing that trips up more people than it should: the …

Mar 07, 20268 min read

Stochastic, Entropy & AI: From Thermodynamics to Information Theory to Modern Machine Learning

I was listening to a podcast the other day about AI and the mathematics behind it — especially stochastic processes, entropy, and probability — and it immediately drew me in. With …