English
Related papers

Related papers: Frequentist Regret Bounds for Randomized Least-Squ…

200 papers

We present an algorithm based on the \emph{Optimism in the Face of Uncertainty} (OFU) principle which is able to learn Reinforcement Learning (RL) modeled by Markov decision process (MDP) with finite state-action space efficiently. By…

Machine Learning · Computer Science 2020-01-01 Zihan Zhang , Xiangyang Ji

We study the infinite-horizon average-reward reinforcement learning (RL) for continuous space Lipschitz MDPs in which an agent can play policies from a given set $\Phi$. The proposed algorithms efficiently explore the policy space by…

Machine Learning · Computer Science 2025-11-18 Avik Kar , Rahul Singh

While quantum reinforcement learning (RL) has attracted a surge of attention recently, its theoretical understanding is limited. In particular, it remains elusive how to design provably efficient quantum RL algorithms that can address the…

Quantum Physics · Physics 2024-06-14 Han Zhong , Jiachen Hu , Yecheng Xue , Tongyang Li , Liwei Wang

In this paper, we study risk-sensitive Reinforcement Learning (RL), focusing on the objective of Conditional Value at Risk (CVaR) with risk tolerance $\tau$. Starting with multi-arm bandits (MABs), we show the minimax CVaR regret rate is…

Machine Learning · Computer Science 2023-05-26 Kaiwen Wang , Nathan Kallus , Wen Sun

We study reinforcement learning (RL) for a class of continuous-time linear-quadratic (LQ) control problems for diffusions, where states are scalar-valued and running control rewards are absent but volatilities of the state processes depend…

Machine Learning · Computer Science 2025-07-25 Yilie Huang , Yanwei Jia , Xun Yu Zhou

This paper proposes a computationally tractable algorithm for learning infinite-horizon average-reward linear Markov decision processes (MDPs) and linear mixture MDPs under the Bellman optimality condition. While guaranteeing computational…

Machine Learning · Computer Science 2024-09-25 Woojin Chae , Dabeen Lee

In this paper, we study the episodic reinforcement learning (RL) problem modeled by finite-horizon Markov Decision Processes (MDPs) with constraint on the number of batches. The multi-batch reinforcement learning framework, where the agent…

Machine Learning · Computer Science 2022-10-18 Zihan Zhang , Yuhang Jiang , Yuan Zhou , Xiangyang Ji

We study an algorithm-independent, worst-case lower bound for the Gaussian process (GP) bandit problem in the frequentist setting, where the reward function is fixed and has a bounded norm in the known reproducing kernel Hilbert space…

Machine Learning · Computer Science 2026-02-23 Shogo Iwazaki

For the problem of task-agnostic reinforcement learning (RL), an agent first collects samples from an unknown environment without the supervision of reward signals, then is revealed with a reward and is asked to compute a corresponding…

Machine Learning · Computer Science 2022-03-16 Jingfeng Wu , Vladimir Braverman , Lin F. Yang

To tackle long planning horizon problems in reinforcement learning with general function approximation, we propose the first algorithm, termed as UCRL-WVTR, that achieves both \emph{horizon-free} and \emph{instance-dependent}, since it…

Machine Learning · Computer Science 2023-12-08 Jiayi Huang , Han Zhong , Liwei Wang , Lin F. Yang

A recent line of works showed regret bounds in reinforcement learning (RL) can be (nearly) independent of planning horizon, a.k.a.~the horizon-free bounds. However, these regret bounds only apply to settings where a polynomial dependency on…

Machine Learning · Computer Science 2024-03-19 Zihan Zhang , Jason D. Lee , Yuxin Chen , Simon S. Du

We study the constant regret guarantees in reinforcement learning (RL). Our objective is to design an algorithm that incurs only finite regret over infinite episodes with high probability. We introduce an algorithm, Cert-LSVI-UCB, for…

Machine Learning · Computer Science 2024-12-13 Weitong Zhang , Zhiyuan Fan , Jiafan He , Quanquan Gu

In average reward Markov decision processes, state-of-the-art algorithms for regret minimization follow a well-established framework: They are model-based, optimistic and episodic. First, they maintain a confidence region from which…

Machine Learning · Computer Science 2025-12-01 Victor Boone , Bruno Gaujal

We study time-inhomogeneous episodic reinforcement learning (RL) under general function approximation and sparse rewards. We design a new algorithm, Variance-weighted Optimistic $Q$-Learning (VO$Q$L), based on $Q$-learning and bound its…

Machine Learning · Computer Science 2022-12-13 Alekh Agarwal , Yujia Jin , Tong Zhang

We study regret minimization for infinite-horizon average-reward Markov Decision Processes (MDPs) under cost constraints. We start by designing a policy optimization algorithm with carefully designed action-value estimator and bonus term,…

Machine Learning · Computer Science 2022-02-02 Liyu Chen , Rahul Jain , Haipeng Luo

The problem of reinforcement learning in an unknown and discrete Markov Decision Process (MDP) under the average-reward criterion is considered, when the learner interacts with the system in a single stream of observations, starting from an…

Machine Learning · Statistics 2018-03-06 Mohammad Sadegh Talebi , Odalric-Ambrym Maillard

In this paper, we study reinforcement learning in Markov Decision Processes with Probabilistic Reward Machines (PRMs), a form of non-Markovian reward commonly found in robotics tasks. We design an algorithm for PRMs that achieves a regret…

Machine Learning · Statistics 2024-08-21 Xiaofeng Lin , Xuezhou Zhang

Thompson sampling (TS) is one of the most popular exploration techniques in reinforcement learning (RL). However, most TS algorithms with theoretical guarantees are difficult to implement and not generalizable to Deep RL. While the emerging…

Machine Learning · Computer Science 2024-06-19 Haque Ishfaq , Yixin Tan , Yu Yang , Qingfeng Lan , Jianfeng Lu , A. Rupam Mahmood , Doina Precup , Pan Xu

We develop several new algorithms for learning Markov Decision Processes in an infinite-horizon average-reward setting with linear function approximation. Using the optimism principle and assuming that the MDP has a linear structure, we…

Machine Learning · Computer Science 2021-04-27 Chen-Yu Wei , Mehdi Jafarnia-Jahromi , Haipeng Luo , Rahul Jain

This paper studies the stochastic linear bandit problem, where a decision-maker chooses actions from possibly time-dependent sets of vectors in $\mathbb{R}^d$ and receives noisy rewards. The objective is to minimize regret, the difference…

Machine Learning · Computer Science 2023-04-24 Nima Hamidi , Mohsen Bayati