I learned very early the difference between knowing the name of something and knowing something.

Richard Feynman

Introduction to Markov Decision Process

10 March 2024

I provide a brief introduction to MDPs.

Attention in the age of ADHD

29 Feburary 2024

I explain what is attention and self-attention in short.

Upper Confidence Bound

25 Feburary 2024

I derive the Hoeffding's Bound and analyze the UCB1 algorithm.

Epsilon-Greedy Strategy

25 Feburary 2024

I explain Exploration-Exploitation trade-off and Epsilon-Greedy Strategy.