2 pages

Gradient-Descent

Apr 29, 20269 min read

Adaptive Filters and Stochastic Gradient Descent: One Update Rule, Two Vocabularies

Modern AI is often framed as a clean break from classical engineering. For anyone who has worked in adaptive signal processing, that framing is misleading. The mathematical spine …

Apr 14, 20265 min read

I Spent Years on Adaptive Filters. I Was Already Training Neural Networks.

I spent years implementing LMS-based equalizers and echo cancellers in telecommunications. Only later did I fully appreciate what I had been doing mathematically: the same family …