中文
相关论文

相关论文: Data-Efficient Reinforcement Learning in Continuou…

200 篇论文

General purpose intelligent learning agents cycle through (complex,non-MDP) sequences of observations, actions, and rewards. On the other hand, reinforcement learning is well-developed for small finite state Markov Decision Processes…

人工智能 · 计算机科学 2009-12-30 Marcus Hutter

Non-stationary environments are challenging for reinforcement learning algorithms. If the state transition and/or reward functions change based on latent factors, the agent is effectively tasked with optimizing a behavior that maximizes…

机器学习 · 计算机科学 2021-05-21 Lucas N. Alegre , Ana L. C. Bazzan , Bruno C. da Silva

A Markov Decision Process (MDP) is a popular model for reinforcement learning. However, its commonly used assumption of stationary dynamics and rewards is too stringent and fails to hold in adversarial, nonstationary, or multi-agent…

机器学习 · 计算机科学 2019-08-22 Tiancheng Yu , Suvrit Sra

Reinforcement learning is a powerful paradigm for learning optimal policies from experimental data. However, to find optimal policies, most reinforcement learning algorithms explore all possible actions, which may be harmful for real-world…

机器学习 · 统计学 2017-11-15 Felix Berkenkamp , Matteo Turchetta , Angela P. Schoellig , Andreas Krause

This paper delves into the problem of safe reinforcement learning (RL) in a partially observable environment with the aim of achieving safe-reachability objectives. In traditional partially observable Markov decision processes (POMDP),…

机器学习 · 计算机科学 2023-12-04 Xiaoyuan Cheng , Boli Chen , Liz Varga , Yukun Hu

Humans achieve efficient learning by relying on prior knowledge about the structure of naturally occurring tasks. There is considerable interest in designing reinforcement learning (RL) algorithms with similar properties. This includes…

机器学习 · 计算机科学 2019-10-23 Jan Humplik , Alexandre Galashov , Leonard Hasenclever , Pedro A. Ortega , Yee Whye Teh , Nicolas Heess

Reinforcement learning in non-stationary environments is challenging due to abrupt and unpredictable changes in dynamics, often causing traditional algorithms to fail to converge. However, in many real-world cases, non-stationarity has some…

机器学习 · 计算机科学 2025-03-25 Mohsen Amiri , Sindri Magnússon

In this paper, we consider reinforcement learning of Markov Decision Processes (MDP) with peak constraints, where an agent chooses a policy to optimize an objective and at the same time satisfy additional constraints. The agent has to take…

最优化与控制 · 数学 2019-12-09 Ather Gattami

The problem of sample complexity of online reinforcement learning is often studied in the literature without taking into account any partial knowledge about the system dynamics that could potentially accelerate the learning process. In this…

机器学习 · 计算机科学 2024-06-04 Meshal Alharbi , Mardavij Roozbehani , Munther Dahleh

This paper presents the first ever approach for solving \emph{continuous-observation} Decentralized Partially Observable Markov Decision Processes (Dec-POMDPs) and their semi-Markovian counterparts, Dec-POSMDPs. This contribution is…

多智能体系统 · 计算机科学 2017-03-17 Shayegan Omidshafiei , Christopher Amato , Miao Liu , Michael Everett , Jonathan P. How , John Vian

Offline reinforcement learning (RL) aims to find optimal policies in dynamic environments in order to maximize the expected total rewards by leveraging pre-collected data. Learning from heterogeneous data is one of the fundamental…

机器学习 · 统计学 2026-03-10 Rui Miao , Babak Shahbaba , Annie Qu

Reinforcement learning (RL) in Markov decision processes (MDPs) with large state spaces is a challenging problem. The performance of standard RL algorithms degrades drastically with the dimensionality of state space. However, in practice,…

人工智能 · 计算机科学 2018-06-21 Kamyar Azizzadenesheli , Alessandro Lazaric , Animashree Anandkumar

One of the significant challenges in reinforcement learning (RL) when dealing with noise is estimating latent states from observations. Causality provides rigorous theoretical support for ensuring that the underlying states can be uniquely…

On-policy reinforcement learning methods, like Trust Region Policy Optimization (TRPO) and Proximal Policy Optimization (PPO), often demand extensive data per update, leading to sample inefficiency. This paper introduces Reflective Policy…

机器学习 · 计算机科学 2024-06-07 Yaozhong Gan , Renye Yan , Zhe Wu , Junliang Xing

We consider un-discounted reinforcement learning (RL) in Markov decision processes (MDPs) under drifting non-stationarity, i.e., both the reward and state transition distributions are allowed to evolve over time, as long as their respective…

机器学习 · 计算机科学 2020-06-26 Wang Chi Cheung , David Simchi-Levi , Ruihao Zhu

The field of quickest change detection (QCD) focuses on the design and analysis of online algorithms that estimate the time at which a significant event occurs. In this paper, design and analysis are cast in a Bayesian framework, where QCD…

最优化与控制 · 数学 2025-12-30 Austin Cooper , Sean Meyn

We propose a new reinforcement learning algorithm derived from a regularized linear-programming formulation of optimal control in MDPs. The method is closely related to the classic Relative Entropy Policy Search (REPS) algorithm of Peters…

机器学习 · 计算机科学 2021-03-01 Joan Bas-Serrano , Sebastian Curi , Andreas Krause , Gergely Neu

We propose a computationally efficient approach to safe reinforcement learning (RL) for frequency regulation in power systems with high levels of variable renewable energy resources. The approach draws on set-theoretic control techniques to…

系统与控制 · 电气工程与系统科学 2022-03-24 Daniel Tabas , Baosen Zhang

State of the art methods for target tracking with sensor management (or controlled sensing) are model-based and are obtained through solutions to Partially Observable Markov Decision Process (POMDP) formulations. In this paper a…

信号处理 · 电气工程与系统科学 2024-07-22 Adarsh M. Subramaniam , Argyrios Gerogiannis , James Z. Hare , Venugopal V. Veeravalli

In this paper, a review of model-free reinforcement learning for learning of dynamical systems in uncertain environments has discussed. For this purpose, the Markov Decision Process (MDP) will be reviewed. Furthermore, some learning…

机器学习 · 计算机科学 2019-05-21 Mehran Attar , Mohammadreza Dabirian