English
Related papers

Related papers: Improved Algorithm for Adversarial Linear Mixture …

200 papers

This work studies the problem of learning episodic Markov Decision Processes with known transition and bandit feedback. We develop the first algorithm with a ``best-of-both-worlds'' guarantee: it achieves $\mathcal{O}(log T)$ regret when…

Machine Learning · Computer Science 2020-11-03 Tiancheng Jin , Haipeng Luo

We propose a black-box reduction that turns a certain reinforcement learning algorithm with optimal regret in a (near-)stationary environment into another algorithm with optimal dynamic regret in a non-stationary environment, importantly…

Machine Learning · Computer Science 2021-09-07 Chen-Yu Wei , Haipeng Luo

Episodic reinforcement learning and contextual bandits are two widely studied sequential decision-making problems. Episodic reinforcement learning generalizes contextual bandits and is often perceived to be more difficult due to long…

Machine Learning · Computer Science 2021-07-01 Zihan Zhang , Xiangyang Ji , Simon S. Du

We give novel algorithms for multi-task and lifelong linear bandits with shared representation. Specifically, we consider the setting where we play $M$ linear bandits with dimension $d$, each for $T$ rounds, and these $M$ bandit tasks share…

Machine Learning · Computer Science 2022-03-30 Jiaqi Yang , Qi Lei , Jason D. Lee , Simon S. Du

In order to make good decision under uncertainty an agent must learn from observations. To do so, two of the most common frameworks are Contextual Bandits and Markov Decision Processes (MDPs). In this paper, we study whether there exist…

Machine Learning · Computer Science 2019-11-05 Andrea Zanette , Emma Brunskill

We consider the best-of-both-worlds problem for learning an episodic Markov Decision Process through $T$ episodes, with the goal of achieving $\widetilde{\mathcal{O}}(\sqrt{T})$ regret when the losses are adversarial and simultaneously…

Machine Learning · Computer Science 2021-10-19 Tiancheng Jin , Longbo Huang , Haipeng Luo

This paper studies semiparametric contextual bandits, a generalization of the linear stochastic bandit problem where the reward for an action is modeled as a linear function of known action features confounded by an non-linear…

Machine Learning · Statistics 2018-07-17 Akshay Krishnamurthy , Zhiwei Steven Wu , Vasilis Syrgkanis

Policy optimization is a widely-used method in reinforcement learning. Due to its local-search nature, however, theoretical guarantees on global optimality often rely on extra assumptions on the Markov Decision Processes (MDPs) that bypass…

Machine Learning · Computer Science 2021-07-20 Haipeng Luo , Chen-Yu Wei , Chung-Wei Lee

We study lifelong learning in linear bandits, where a learner interacts with a sequence of linear bandit tasks whose parameters lie in an $m$-dimensional subspace of $\mathbb{R}^d$, thereby sharing a low-rank representation. Current…

Machine Learning · Computer Science 2025-01-24 Thang Duong , Zhi Wang , Chicheng Zhang

We consider online learning for episodic stochastically constrained Markov decision processes (CMDPs), which plays a central role in ensuring the safety of reinforcement learning. Here the loss function can vary arbitrarily across the…

Machine Learning · Computer Science 2021-10-19 Shuang Qiu , Xiaohan Wei , Zhuoran Yang , Jieping Ye , Zhaoran Wang

We study episodic reinforcement learning with fixed reward and transition functions, but with episode-dependent admissible action sets that are observed at the start of each episode. Performance is measured by cumulative regret against the…

Machine Learning · Computer Science 2026-05-18 Zijun Chen , Zihan Zhang

This paper studies privacy-preserving exploration in Markov Decision Processes (MDPs) with linear representation. We first consider the setting of linear-mixture MDPs (Ayoub et al., 2020) (a.k.a.\ model-based setting) and provide an unified…

Machine Learning · Computer Science 2021-12-08 Paul Luyo , Evrard Garcelon , Alessandro Lazaric , Matteo Pirotta

This paper presents a new algorithm for online linear regression whose efficiency guarantees satisfy the requirements of the KWIK (Knows What It Knows) framework. The algorithm improves on the complexity bounds of the current…

Machine Learning · Computer Science 2012-05-14 Thomas J. Walsh , Istvan Szita , Carlos Diuk , Michael L. Littman

We consider the adversarial linear contextual bandit setting, which allows for the loss functions associated with each of $K$ arms to change over time without restriction. Assuming the $d$-dimensional contexts are drawn from a fixed known…

Machine Learning · Computer Science 2023-05-25 Julia Olkhovskaya , Jack Mayo , Tim van Erven , Gergely Neu , Chen-Yu Wei

Many real-world applications, such as those in medical domains, recommendation systems, etc, can be formulated as large state space reinforcement learning problems with only a small budget of the number of policy changes, i.e., low…

Machine Learning · Computer Science 2021-01-05 Minbo Gao , Tianle Xie , Simon S. Du , Lin F. Yang

While numerous works have focused on devising efficient algorithms for reinforcement learning (RL) with uniformly bounded rewards, it remains an open question whether sample or time-efficient algorithms for RL with large state-action space…

Machine Learning · Computer Science 2024-03-08 Jiayi Huang , Han Zhong , Liwei Wang , Lin F. Yang

We study model-based reinforcement learning with non-linear function approximation where the transition function of the underlying Markov decision process (MDP) is given by a multinomial logistic (MNL) model. We develop a provably efficient…

Machine Learning · Computer Science 2024-10-15 Jaehyun Park , Junyeop Kwon , Dabeen Lee

We study reward-free reinforcement learning (RL) with linear function approximation, where the agent works in two phases: (1) in the exploration phase, the agent interacts with the environment but cannot access the reward; and (2) in the…

Machine Learning · Computer Science 2024-02-15 Junkai Zhang , Weitong Zhang , Quanquan Gu

This paper explores a new form of the linear bandit problem in which the algorithm receives the usual stochastic rewards as well as stochastic feedback about which features are relevant to the rewards, the latter feedback being the novel…

Machine Learning · Computer Science 2019-03-13 Urvashi Oswal , Aniruddha Bhargava , Robert Nowak

We consider the adversarial linear contextual bandit problem, where the loss vectors are selected fully adversarially and the per-round action set (i.e. the context) is drawn from a fixed distribution. Existing methods for this problem…

Machine Learning · Computer Science 2023-09-06 Haolin Liu , Chen-Yu Wei , Julian Zimmert