2020 IEEE INFORMATION THEORY WORKSHOP

IEEE ITW 2020

You should be logged in to see the presentation

IEEE ITW 2020

ITW2020 - Plenary Talk #5

Information-directed Exploration in Bandits and Reinforcement Learning

  Andreas Krause

 15 April, 2021
 09:00 - 10:00 CEST

Information-directed Exploration in Bandits and Reinforcement Learning

  • ABSTRACT

The exploration-exploitation dilemma is a central challenge when making decisions under uncertainty. Most common approaches explore by favouring actions with uncertain outcomes. However, aleatoric uncertainty in the outcomes is different from epistemic uncertainty in the estimation task, thus the resulting observations may not necessarily be informative. In this talk, I will present approaches towards efficient information-directed exploration in stochastic multi-armed bandits, Bayesian optimization, reinforcement learning and a rich family of sequential decision problems called partial monitoring. These approaches use information measures for guiding exploration, and their submodularity allows to establish sublinear regret even in non-parametric settings. I will present the theoretical background, as well as empirical demonstrations on deep reinforcement learning tasks.

  • PRESENTER

Andreas Krause

  • SHARE