3 pages

Probability

Stochastic processes, probability distributions, and probabilistic modeling

Markov Decision Processes: The Mathematical Foundation of Reinforcement Learning

The Markov Decision Process (MDP) is the standard formal object for sequential decision-making under uncertainty. It separates problem definition — states, actions, how the world evolves, what you …

I Spent Years on Adaptive Filters. I Was Already Training Neural Networks.

I spent years implementing LMS-based equalizers and echo cancellers in telecommunications. Only later did I fully appreciate what I had been doing mathematically: the same family of update rules that …

Stochastic, Entropy & AI: From Thermodynamics to Information Theory to Modern Machine Learning

I was listening to a podcast the other day about AI and the mathematics behind it — especially stochastic processes, entropy, and probability — and it immediately drew me in. With a background in …