中文
相关论文

相关论文: A Kernel-Based Approach to Non-Stationary Reinforc…

200 篇论文

We consider online learning for episodic stochastically constrained Markov decision processes (CMDPs), which plays a central role in ensuring the safety of reinforcement learning. Here the loss function can vary arbitrarily across the…

机器学习 · 计算机科学 2021-10-19 Shuang Qiu , Xiaohan Wei , Zhuoran Yang , Jieping Ye , Zhaoran Wang

Model-free reinforcement learning is known to be memory and computation efficient and more amendable to large scale problems. In this paper, two model-free algorithms are introduced for learning infinite-horizon average-reward Markov…

机器学习 · 计算机科学 2020-02-26 Chen-Yu Wei , Mehdi Jafarnia-Jahromi , Haipeng Luo , Hiteshi Sharma , Rahul Jain

Continuous-time reinforcement learning (CTRL) provides a natural framework for sequential decision-making in dynamic environments where interactions evolve continuously over time. While CTRL has shown growing empirical success, its ability…

机器学习 · 计算机科学 2025-12-04 Runze Zhao , Yue Yu , Ruhan Wang , Chunfeng Huang , Dongruo Zhou

We propose a new, nonparametric approach to estimating the value function in reinforcement learning. This approach makes use of a recently developed representation of conditional distributions as functions in a reproducing kernel Hilbert…

机器学习 · 计算机科学 2012-10-19 Steffen Grünewälder , Luca Baldassarre , Massimiliano Pontil , Arthur Gretton , Guy Lever

Dynamic mechanism design studies how mechanism designers should allocate resources among agents in a time-varying environment. We consider the problem where the agents interact with the mechanism designer according to an unknown Markov…

机器学习 · 计算机科学 2024-12-19 Shuang Qiu , Boxiang Lyu , Qinglin Meng , Zhaoran Wang , Zhuoran Yang , Michael I. Jordan

We study reinforcement learning with multinomial logistic (MNL) function approximation where the underlying transition probability kernel of the Markov decision processes (MDPs) is parametrized by an unknown transition core with features of…

机器学习 · 统计学 2024-11-01 Wooseong Cho , Taehyun Hwang , Joongkyu Lee , Min-hwan Oh

This dissertation makes three main contributions. First, We identify a new connection between policy gradient and dynamic programming in MMDPs and propose the Coordinate Ascent Dynamic Programming (CADP) algorithm to compute a Markov policy…

机器学习 · 计算机科学 2025-10-21 Xihong Su

We study model-free reinforcement learning (RL) in non-stationary finite-horizon episodic Markov decision processes (MDPs) without prior knowledge of the non-stationarity. We focus on the piecewise stationary (PS) setting, where both…

机器学习 · 计算机科学 2026-05-13 Argyrios Gerogiannis , Yu-Han Huang , Venugopal V. Veeravalli

Standard reinforcement learning (RL) assumes that an agent can observe a reward for each state-action pair. However, in practical applications, it is often difficult and costly to collect a reward for each state-action pair. While there…

机器学习 · 计算机科学 2025-06-18 Yihan Du , Anna Winnicki , Gal Dalal , Shie Mannor , R. Srikant

Quantum machine learning is a growing research field that aims to perform machine learning tasks assisted by a quantum computer. Kernel-based quantum machine learning models are paradigmatic examples where the kernel involves quantum…

量子物理 · 物理学 2023-02-06 Diego Tancara , Hossein T. Dinani , Ariel Norambuena , Felipe F. Fanchini , Raúl Coto

Deep Reinforcement Learning has demonstrated the potential of neural networks tuned with gradient descent for solving complex tasks in well-delimited environments. However, these neural systems are slow learners producing specialized agents…

机器学习 · 计算机科学 2022-10-13 Mathieu Chalvidal , Thomas Serre , Rufin VanRullen

We present a model-free reinforcement learning algorithm to find an optimal policy for a finite-horizon Markov decision process while guaranteeing a desired lower bound on the probability of satisfying a signal temporal logic (STL)…

系统与控制 · 电气工程与系统科学 2021-09-29 Krishna C. Kalagarla , Rahul Jain , Pierluigi Nuzzo

Reinforcement learning algorithms are usually stated without theoretical guarantees regarding their performance. Recently, Jin, Yang, Wang, and Jordan (COLT 2020) showed a polynomial-time reinforcement learning algorithm (namely, LSVI-UCB)…

机器学习 · 计算机科学 2024-11-19 Philips George John , Arnab Bhattacharyya , Silviu Maniu , Dimitrios Myrisiotis , Zhenan Wu

In this paper, a review of model-free reinforcement learning for learning of dynamical systems in uncertain environments has discussed. For this purpose, the Markov Decision Process (MDP) will be reviewed. Furthermore, some learning…

机器学习 · 计算机科学 2019-05-21 Mehran Attar , Mohammadreza Dabirian

We consider a reinforcement learning setting introduced in (Maillard et al., NIPS 2011) where the learner does not have explicit access to the states of the underlying Markov decision process (MDP). Instead, she has access to several models…

机器学习 · 计算机科学 2014-09-16 Ronald Ortner , Odalric-Ambrym Maillard , Daniil Ryabko

We study regret minimization for reinforcement learning (RL) in Latent Markov Decision Processes (LMDPs) with context in hindsight. We design a novel model-based algorithmic framework which can be instantiated with both a model-optimistic…

机器学习 · 计算机科学 2023-05-23 Runlong Zhou , Ruosong Wang , Simon S. Du

This paper delves into the problem of safe reinforcement learning (RL) in a partially observable environment with the aim of achieving safe-reachability objectives. In traditional partially observable Markov decision processes (POMDP),…

机器学习 · 计算机科学 2023-12-04 Xiaoyuan Cheng , Boli Chen , Liz Varga , Yukun Hu

Achieving the no-regret property for Reinforcement Learning (RL) problems in continuous state and action-space environments is one of the major open problems in the field. Existing solutions either work under very specific assumptions or…

机器学习 · 计算机科学 2024-11-01 Davide Maran , Alberto Maria Metelli , Matteo Papini , Marcello Restelli

We consider Markov Decision Processes (MDPs) where the rewards are unknown and may change in an adversarial manner. We provide an algorithm that achieves state-of-the-art regret bound of $O( \sqrt{\tau (\ln|S|+\ln|A|)T}\ln(T))$, where $S$…

机器学习 · 计算机科学 2019-05-28 Adrian Rivera Cardoso , He Wang , Huan Xu

We study a Markov matching market involving a planner and a set of strategic agents on the two sides of the market. At each step, the agents are presented with a dynamical context, where the contexts determine the utilities. The planner…

机器学习 · 计算机科学 2022-03-09 Yifei Min , Tianhao Wang , Ruitu Xu , Zhaoran Wang , Michael I. Jordan , Zhuoran Yang