The Multi-Armed Bandit Problem and Its Solutions — Blankdot