This course covers the computational principles and techniques that are used to solve sequential decision-making problems from a Computer Science perspective. The focus of this class is on formulating sequential decision-making problems as well as on the fundamental algorithms, mathematical models, and programming techniques used to solve them. Topics include: Multi-armed bandit problems, adversarial decision-making, Monte-Carlo tree search, and reinforcement learning.