3 pages

Signal-Processing

Apr 29, 20269 min read

Adaptive Filters and Stochastic Gradient Descent: One Update Rule, Two Vocabularies

Modern AI is often framed as a clean break from classical engineering. For anyone who has worked in adaptive signal processing, that framing is misleading. The mathematical spine …

Apr 26, 20266 min read

Deriving MMSE: what the Wiener filter actually minimizes

The Wiener filter has a clean claim: among all linear filters operating on wide-sense stationary input, it produces the minimum mean-square estimation error. That claim has a …

Apr 14, 20265 min read

I Spent Years on Adaptive Filters. I Was Already Training Neural Networks.

I spent years implementing LMS-based equalizers and echo cancellers in telecommunications. Only later did I fully appreciate what I had been doing mathematically: the same family …