English
Related papers

Related papers: Provably Efficient Reinforcement Learning with Agg…

200 papers

Due to the drastic gap in complexity between sequential and batch statistical learning, recent work has studied a smoothed sequential learning setting, where Nature is constrained to select contexts with density bounded by 1/{\sigma} with…

Machine Learning · Statistics 2022-05-27 Adam Block , Max Simchowitz

The proximal policy optimization (PPO) algorithm stands as one of the most prosperous methods in the field of reinforcement learning (RL). Despite its success, the theoretical understanding of PPO remains deficient. Specifically, it is…

Machine Learning · Computer Science 2023-06-09 Han Zhong , Tong Zhang

Designing learning agents that explore efficiently in a complex environment has been widely recognized as a fundamental challenge in reinforcement learning. While a number of works have demonstrated the effectiveness of techniques based on…

Machine Learning · Computer Science 2025-06-17 Yan Chen , Qinxun Bai , Yiteng Zhang , Shi Dong , Maria Dimakopoulou , Qi Sun , Zhengyuan Zhou

We study online learning in unknown Markov games, a problem that arises in episodic multi-agent reinforcement learning where the actions of the opponents are unobservable. We show that in this challenging setting, achieving sublinear regret…

Machine Learning · Computer Science 2021-02-09 Yi Tian , Yuanhao Wang , Tiancheng Yu , Suvrit Sra

For the problem of task-agnostic reinforcement learning (RL), an agent first collects samples from an unknown environment without the supervision of reward signals, then is revealed with a reward and is asked to compute a corresponding…

Machine Learning · Computer Science 2022-03-16 Jingfeng Wu , Vladimir Braverman , Lin F. Yang

The most relevant problems in discounted reinforcement learning involve estimating the mean of a function under the stationary distribution of a Markov reward process, such as the expected return in policy evaluation, or the policy gradient…

Machine Learning · Computer Science 2023-04-17 Alberto Maria Metelli , Mirco Mutti , Marcello Restelli

We study reinforcement learning in an infinite-horizon average-reward setting with linear function approximation, where the transition probability function of the underlying Markov Decision Process (MDP) admits a linear form over a feature…

Machine Learning · Computer Science 2022-05-11 Yue Wu , Dongruo Zhou , Quanquan Gu

We propose UCBMQ, Upper Confidence Bound Momentum Q-learning, a new algorithm for reinforcement learning in tabular and possibly stage-dependent, episodic Markov decision process. UCBMQ is based on Q-learning where we add a momentum term…

Machine Learning · Statistics 2022-03-21 Pierre Menard , Omar Darwiche Domingues , Xuedong Shang , Michal Valko

We present an efficient algorithm for model-free episodic reinforcement learning on large (potentially continuous) state-action spaces. Our algorithm is based on a novel $Q$-learning policy with adaptive data-driven discretization. The…

Machine Learning · Computer Science 2019-12-20 Sean R. Sinclair , Siddhartha Banerjee , Christina Lee Yu

We consider the exploration-exploitation dilemma in finite-horizon reinforcement learning problems whose state-action space is endowed with a metric. We introduce Kernel-UCBVI, a model-based optimistic algorithm that leverages the…

Machine Learning · Computer Science 2022-03-25 Omar Darwiche Domingues , Pierre Ménard , Matteo Pirotta , Emilie Kaufmann , Michal Valko

Value function approximation is important in modern reinforcement learning (RL) problems especially when the state space is (infinitely) large. Despite the importance and wide applicability of value function approximation, its theoretical…

Machine Learning · Computer Science 2023-02-24 Hanlin Zhu , Ruosong Wang , Jason D. Lee

We study model-based reinforcement learning with non-linear function approximation where the transition function of the underlying Markov decision process (MDP) is given by a multinomial logistic (MNL) model. We develop a provably efficient…

Machine Learning · Computer Science 2024-10-15 Jaehyun Park , Junyeop Kwon , Dabeen Lee

We study reinforcement learning with linear function approximation, unknown transition, and adversarial losses in the bandit feedback setting. Specifically, we focus on linear mixture MDPs whose transition kernel is a linear mixture model.…

Machine Learning · Computer Science 2024-03-08 Long-Fei Li , Peng Zhao , Zhi-Hua Zhou

We study the role of the representation of state-action value functions in regret minimization in finite-horizon Markov Decision Processes (MDPs) with linear structure. We first derive a necessary condition on the representation, called…

Machine Learning · Computer Science 2021-10-29 Matteo Papini , Andrea Tirinzoni , Aldo Pacchiano , Marcello Restelli , Alessandro Lazaric , Matteo Pirotta

The standard assumption in reinforcement learning (RL) is that agents observe feedback for their actions immediately. However, in practice feedback is often observed in delay. This paper studies online learning in episodic Markov decision…

Machine Learning · Computer Science 2023-01-24 Tiancheng Jin , Tal Lancewicki , Haipeng Luo , Yishay Mansour , Aviv Rosenberg

We study risk-sensitive reinforcement learning (RL) based on an entropic risk measure in episodic non-stationary Markov decision processes (MDPs). Both the reward functions and the state transition kernels are unknown and allowed to vary…

Machine Learning · Computer Science 2022-11-22 Yuhao Ding , Ming Jin , Javad Lavaei

Distributional reinforcement learning improves performance by capturing environmental stochasticity, but a comprehensive theoretical understanding of its effectiveness remains elusive. In addition, the intractable element of the infinite…

Machine Learning · Computer Science 2025-05-14 Taehyun Cho , Seungyub Han , Seokhun Ju , Dohyeong Kim , Kyungjae Lee , Jungwoo Lee

Reinforcement learning generalizes multi-armed bandit problems with additional difficulties of a longer planning horizon and unknown transition kernel. We explore a black-box reduction from discounted infinite-horizon tabular reinforcement…

Machine Learning · Computer Science 2024-03-12 Ian A. Kash , Lev Reyzin , Zishun Yu

We study a novel variant of online finite-horizon Markov Decision Processes with adversarially changing loss functions and initially unknown dynamics. In each episode, the learner suffers the loss accumulated along the trajectory realized…

Machine Learning · Computer Science 2021-02-02 Alon Cohen , Haim Kaplan , Tomer Koren , Yishay Mansour

We present the first gap-dependent analysis of regret and communication cost for on-policy federated $Q$-Learning in tabular episodic finite-horizon Markov decision processes (MDPs). Existing FRL methods focus on worst-case scenarios,…

Machine Learning · Statistics 2025-09-19 Haochen Zhang , Zhong Zheng , Lingzhou Xue