中文
相关论文

相关论文: Harnessing Causality in Reinforcement Learning Wit…

200 篇论文

In practical applications, we can rarely assume full observability of a system's environment, despite such knowledge being important for determining a reactive control system's precise interaction with its environment. Therefore, we propose…

机器学习 · 计算机科学 2022-06-24 Edi Muskardin , Martin Tappler , Bernhard K. Aichernig , Ingo Pill

Transfer reinforcement learning aims to improve the sample efficiency of solving unseen new tasks by leveraging experiences obtained from previous tasks. We consider the setting where all tasks (MDPs) share the same environment dynamic…

机器学习 · 计算机科学 2021-01-08 Kaige Yang

Uncovering causal structures from observational data is crucial for understanding complex systems and making informed decisions. While reinforcement learning (RL) has shown promise in identifying these structures in the form of a directed…

机器学习 · 计算机科学 2026-03-24 Dong Li , Zhengzhang Chen , Xujiang Zhao , Linlin Yu , Zhong Chen , Yi He , Haifeng Chen , Chen Zhao

In typical reinforcement learning (RL), the environment is assumed given and the goal of the learning is to identify an optimal policy for the agent taking actions through its interactions with the environment. In this paper, we extend this…

人工智能 · 计算机科学 2019-10-25 Haifeng Zhang , Jun Wang , Zhiming Zhou , Weinan Zhang , Ying Wen , Yong Yu , Wenxin Li

Major depressive disorder (MDD) presents challenges in diagnosis and treatment due to its complex and heterogeneous nature. Emerging evidence indicates that reward processing abnormalities may serve as a behavioral marker for MDD. To…

机器学习 · 计算机科学 2024-07-29 Xingche Guo , Donglin Zeng , Yuanjia Wang

Reinforcement learning usually assumes a given or sometimes even fixed environment in which an agent seeks an optimal policy to maximize its long-term discounted reward. In contrast, we consider agents that are not limited to passive…

机器学习 · 计算机科学 2025-10-20 Ziqing Lu , Babak Hassibi , Lifeng Lai , Weiyu Xu

Online restless multi-armed bandits (RMABs) typically assume that each arm follows a stationary Markov Decision Process (MDP) with fixed state transitions and rewards. However, in real-world applications like healthcare and recommendation…

机器学习 · 计算机科学 2025-08-15 Yu-Heng Hung , Ping-Chun Hsieh , Kai Wang

Robust Markov Decision Processes (RMDPs) intend to ensure robustness with respect to changing or adversarial system behavior. In this framework, transitions are modeled as arbitrary elements of a known and properly structured uncertainty…

机器学习 · 计算机科学 2019-07-25 Esther Derman , Daniel Mankowitz , Timothy Mann , Shie Mannor

We study reinforcement learning (RL) with linear function approximation in Markov Decision Processes (MDPs) satisfying \emph{linear Bellman completeness} -- a fundamental setting where the Bellman backup of any linear value function remains…

机器学习 · 计算机科学 2026-03-25 Zakaria Mhammedi , Alexander Rakhlin , Nneka Okolo

In many robotic applications, some aspects of the system dynamics can be modeled accurately while others are difficult to obtain or model. We present a novel reinforcement learning (RL) method for continuous state and action spaces that…

人工智能 · 计算机科学 2017-06-06 Tomoki Nishi , Prashant Doshi , Michael R. James , Danil Prokhorov

In this paper, we consider reinforcement learning of Markov Decision Processes (MDP) with peak constraints, where an agent chooses a policy to optimize an objective and at the same time satisfy additional constraints. The agent has to take…

最优化与控制 · 数学 2019-12-09 Ather Gattami

We present a model-free reinforcement learning algorithm to find an optimal policy for a finite-horizon Markov decision process while guaranteeing a desired lower bound on the probability of satisfying a signal temporal logic (STL)…

系统与控制 · 电气工程与系统科学 2021-09-29 Krishna C. Kalagarla , Rahul Jain , Pierluigi Nuzzo

In offline reinforcement learning (RL), the absence of active exploration calls for attention on the model robustness to tackle the sim-to-real gap, where the discrepancy between the simulated and deployed environments can significantly…

机器学习 · 计算机科学 2024-06-28 He Wang , Laixi Shi , Yuejie Chi

Non-stationary domains, where unforeseen changes happen, present a challenge for agents to find an optimal policy for a sequential decision making problem. This work investigates a solution to this problem that combines Markov Decision…

人工智能 · 计算机科学 2017-05-04 Leonardo A. Ferreira , Reinaldo A. C. Bianchi , Paulo E. Santos , Ramon Lopez de Mantaras

Game-theoretic resource allocation on graphs (GRAG) involves two players competing over multiple steps to control nodes of interest on a graph, a problem modeled as a multi-step Colonel Blotto Game (MCBG). Finding optimal strategies is…

机器学习 · 计算机科学 2025-05-13 Zijian An , Lifeng Zhou

We present two elegant solutions for modeling continuous-time dynamics, in a novel model-based reinforcement learning (RL) framework for semi-Markov decision processes (SMDPs), using neural ordinary differential equations (ODEs). Our models…

机器学习 · 计算机科学 2020-10-27 Jianzhun Du , Joseph Futoma , Finale Doshi-Velez

We introduce Dynamic Contextual Markov Decision Processes (DCMDPs), a novel reinforcement learning framework for history-dependent environments that generalizes the contextual MDP framework to handle non-Markov environments, where contexts…

机器学习 · 计算机科学 2023-05-19 Guy Tennenholtz , Nadav Merlis , Lior Shani , Martin Mladenov , Craig Boutilier

This paper proposes a reinforcement learning method for controller synthesis of autonomous systems in unknown and partially-observable environments with subjective time-dependent safety constraints. Mathematically, we model the system…

机器人学 · 计算机科学 2021-04-06 Yu Wang , Alper Kamil Bozkurt , Miroslav Pajic

Online learning algorithms are designed to perform in non-stationary environments, but generally there is no notion of a dynamic state to model constraints on current and future actions as a function of past actions. State-based models are…

机器学习 · 计算机科学 2015-09-01 Peng Guan , Maxim Raginsky , Rebecca Willett

Recently, we have struck the balance between the information freshness, in terms of age of information (AoI), experienced by users and energy consumed by sensors, by appropriately activating sensors to update their current status in caching…

机器学习 · 计算机科学 2021-04-15 Chao Xu , Yiping Xie , Xijun Wang , Howard H. Yang , Dusit Niyato , Tony Q. S. Quek