中文
相关论文

相关论文: Active Measuring in Reinforcement Learning With De…

200 篇论文

This paper studies the sample-efficiency of learning in Partially Observable Markov Decision Processes (POMDPs), a challenging problem in reinforcement learning that is known to be exponentially hard in the worst-case. Motivated by…

机器学习 · 计算机科学 2023-07-07 Jiacheng Guo , Minshuo Chen , Huan Wang , Caiming Xiong , Mengdi Wang , Yu Bai

In real-world scenarios, the observation data for reinforcement learning with continuous control is commonly noisy and part of it may be dynamically missing over time, which violates the assumption of many current methods developed for…

机器学习 · 计算机科学 2019-02-18 Yuhui Wang , Hao He , Xiaoyang Tan

Reinforcement learning algorithms typically rely on the assumption that the environment dynamics and value function can be expressed in terms of a Markovian state representation. However, when state information is only partially observable,…

Offline reinforcement learning -- learning a policy from a batch of data -- is known to be hard for general MDPs. These results motivate the need to look at specific classes of MDPs where offline reinforcement learning might be feasible. In…

机器学习 · 计算机科学 2023-05-16 Vincent Liu , James R. Wright , Martha White

We study reinforcement learning problems where state observations are stochastically triggered by actions, a constraint common in many real-world applications. This framework is formulated as Action-Triggered Sporadically Traceable Markov…

机器学习 · 计算机科学 2025-10-03 Alexander Ryabchenko , Wenlong Mou

Reinforcement learning would enjoy better success on real-world problems if domain knowledge could be imparted to the algorithm by the modelers. Most problems have both hidden state and unknown dynamics. Partially observable Markov decision…

机器学习 · 计算机科学 2013-01-07 Christian R. Shelton

Reinforcement learning (RL) is one of the most important branches of AI. Due to its capacity for self-adaption and decision-making in dynamic environments, reinforcement learning has been widely applied in multiple areas, such as…

机器学习 · 计算机科学 2023-01-03 Yunjiao Lei , Dayong Ye , Sheng Shen , Yulei Sui , Tianqing Zhu , Wanlei Zhou

With the rapid development of Mobile Edge Computing (MEC), various real-time applications have been deployed to benefit people's daily lives. The performance of these applications relies heavily on the freshness of collected environmental…

机器学习 · 计算机科学 2024-02-26 Xingqiu He , Chaoqun You , Tony Q. S. Quek

A major component of overfitting in model-free reinforcement learning (RL) involves the case where the agent may mistakenly correlate reward with certain spurious features from the observations generated by the Markov Decision Process…

机器学习 · 计算机科学 2020-01-01 Xingyou Song , Yiding Jiang , Stephen Tu , Yilun Du , Behnam Neyshabur

We study the reinforcement learning (RL) problem in a constrained Markov decision process (CMDP), where an agent explores the environment to maximize the expected cumulative reward while satisfying a single constraint on the expected total…

This paper addresses the problem of learning optimal control policies for systems with uncertain dynamics and high-level control objectives specified as Linear Temporal Logic (LTL) formulas. Uncertainty is considered in the workspace…

机器人学 · 计算机科学 2024-10-17 Yiannis Kantaros , Jun Wang

We propose a new reinforcement learning algorithm for partially observable Markov decision processes (POMDP) based on spectral decomposition methods. While spectral methods have been previously employed for consistent learning of (passive)…

人工智能 · 计算机科学 2017-06-20 Kamyar Azizzadenesheli , Alessandro Lazaric , Animashree Anandkumar

In this paper, we develop a safe decision-making method for self-driving cars in a multi-lane, single-agent setting. The proposed approach utilizes deep reinforcement learning (RL) to achieve a high-level policy for safe tactical…

人工智能 · 计算机科学 2021-05-17 Arash Mohammadhasani , Hamed Mehrivash , Alan Lynch , Zhan Shu

Existing automatic 3D image segmentation methods usually fail to meet the clinic use. Many studies have explored an interactive strategy to improve the image segmentation performance by iteratively incorporating user hints. However, the…

计算机视觉与模式识别 · 计算机科学 2019-11-26 Xuan Liao , Wenhao Li , Qisen Xu , Xiangfeng Wang , Bo Jin , Xiaoyun Zhang , Ya Zhang , Yanfeng Wang

Autonomous agents are limited in their ability to observe the world state. Partially observable Markov decision processes (POMDPs) formally model the problem of planning under world state uncertainty, but POMDPs with continuous actions and…

机器人学 · 计算机科学 2020-07-08 Dicong Qiu , Yibiao Zhao , Chris L. Baker

Online advertising in recommendation platforms has gained significant attention, with a predominant focus on channel recommendation and budget allocation strategies. However, current offline reinforcement learning (RL) methods face…

信息检索 · 计算机科学 2025-07-10 Langming Liu , Wanyu Wang , Chi Zhang , Bo Li , Hongzhi Yin , Xuetao Wei , Wenbo Su , Bo Zheng , Xiangyu Zhao

To ensure the usefulness of Reinforcement Learning (RL) in real systems, it is crucial to ensure they are robust to noise and adversarial attacks. In adversarial RL, an external attacker has the power to manipulate the victim agent's…

机器学习 · 计算机科学 2024-06-18 Jeremy McMahan , Young Wu , Xiaojin Zhu , Qiaomin Xie

Reactive synthesis algorithms allow automatic construction of policies to control an environment modeled as a Markov Decision Process (MDP) that are optimal with respect to high-level temporal logic specifications. However, they assume that…

形式语言与自动机理论 · 计算机科学 2022-05-31 Rajeev Alur , Suguman Bansal , Osbert Bastani , Kishor Jothimurugan

In this paper, we focus on the problem of robustifying reinforcement learning (RL) algorithms with respect to model uncertainties. Indeed, in the framework of model-based RL, we propose to merge the theory of constrained Markov decision…

机器学习 · 计算机科学 2020-10-13 Reazul Hasan Russel , Mouhacine Benosman , Jeroen Van Baar

We consider reinforcement learning (RL) for a class of problems with bagged decision times. A bag contains a finite sequence of consecutive decision times. The transition dynamics are non-Markovian and non-stationary within a bag. All…

机器学习 · 计算机科学 2025-05-08 Daiqi Gao , Hsin-Yu Lai , Predrag Klasnja , Susan A. Murphy