中文
相关论文

相关论文: Bellman operator convergence enhancements in reinf…

200 篇论文

Quantum control is concerned with the realisation of desired dynamics in quantum systems, serving as a linchpin for advancing quantum technologies and fundamental research. Analytic approaches and standard optimisation algorithms do not…

量子物理 · 物理学 2025-05-29 Jan Ole Ernst , Aniket Chatterjee , Tim Franzmeyer , Axel Kuhn

This work proposes an efficient batch algorithm for feature selection in reinforcement learning (RL) with theoretical convergence guarantees. To mitigate the estimation bias inherent in conventional regularization schemes, the first…

机器学习 · 计算机科学 2025-09-22 Kyohei Suzuki , Konstantinos Slavakis

We study computationally and statistically efficient Reinforcement Learning algorithms for the linear Bellman Complete setting. This setting uses linear function approximation to capture value functions and unifies existing models like…

机器学习 · 计算机科学 2025-03-04 Runzhe Wu , Ayush Sekhari , Akshay Krishnamurthy , Wen Sun

Recent advances in deep reinforcement learning (deep RL) enable researchers to solve challenging control problems, from simulated environments to real-world robotic tasks. However, deep RL algorithms are known to be sensitive to the problem…

机器人学 · 计算机科学 2023-02-01 Joanne Taery Kim , Sehoon Ha

Off-policy Reinforcement Learning (RL) holds the promise of better data efficiency as it allows sample reuse and potentially enables safe interaction with the environment. Current off-policy policy gradient methods either suffer from high…

机器学习 · 计算机科学 2021-06-09 Samuele Tosatto , João Carvalho , Jan Peters

The classic Reinforcement Learning (RL) formulation concerns the maximization of a scalar reward function. More recently, convex RL has been introduced to extend the RL formulation to all the objectives that are convex functions of the…

机器学习 · 计算机科学 2023-01-30 Mirco Mutti , Riccardo De Santi , Piersilvio De Bartolomeis , Marcello Restelli

Reinforcement learning (RL) is concerned with how intelligence agents take actions in a given environment to maximize the cumulative reward they receive. In healthcare, applying RL algorithms could assist patients in improving their health…

机器学习 · 统计学 2025-04-21 Chengchun Shi

Bootstrapping and rollout are two fundamental principles for value function estimation in reinforcement learning (RL). We introduce a novel class of Bellman operators, called subgraph Bellman operators, that interpolate between…

机器学习 · 计算机科学 2024-12-02 Wenlong Mou , Jian Qian

The inability to naturally enforce safety in Reinforcement Learning (RL), with limited failures, is a core challenge impeding its use in real-world applications. One notion of safety of vast practical relevance is the ability to avoid…

机器学习 · 计算机科学 2024-01-24 Agustin Castellano , Hancheng Min , Juan Andrés Bazerque , Enrique Mallada

Reinforcement learning (RL) with outcome-based rewards has proven effective for improving large language models (LLMs) on complex reasoning tasks. However, its success often depends on the base model occasionally sampling correct solutions.…

机器学习 · 计算机科学 2025-10-07 Jatin Prakash , Anirudh Buvanesh

The applicability of classical Banach contraction mapping principle in solving diverse problems caught the attention of several researchers in various fields of science and engineering. Since its introduction, many extensions and…

泛函分析 · 数学 2025-06-24 Arsalan Hojjat Ansari , Olaoluwa Jeremiah Omidire

Batch reinforcement learning (RL) is important to apply RL algorithms to many high stakes tasks. Doing batch RL in a way that yields a reliable new policy in large domains is challenging: a new decision policy may visit states and actions…

机器学习 · 计算机科学 2020-07-23 Yao Liu , Adith Swaminathan , Alekh Agarwal , Emma Brunskill

Value function approximation is important in modern reinforcement learning (RL) problems especially when the state space is (infinitely) large. Despite the importance and wide applicability of value function approximation, its theoretical…

机器学习 · 计算机科学 2023-02-24 Hanlin Zhu , Ruosong Wang , Jason D. Lee

Reinforcement Learning (RL) has emerged as a transformative approach in the domains of automation and robotics, offering powerful solutions to complex problems that conventional methods struggle to address. In scenarios where the problem…

机器人学 · 计算机科学 2023-09-04 Meraj Mammadov

This paper studies the continuous-time reinforcement learning (RL) for optimal switching problems across multiple regimes. We consider a type of exploratory formulation under entropy regularization where the agent randomizes both the timing…

最优化与控制 · 数学 2025-12-23 Yijie Huang , Mengge Li , Xiang Yu , Zhou Zhou

We propose a general formulation for addressing reinforcement learning (RL) problems in settings with observational data. That is, we consider the problem of learning good policies solely from historical data in which unobserved factors…

机器学习 · 计算机科学 2018-12-31 Chaochao Lu , Bernhard Schölkopf , José Miguel Hernández-Lobato

In recent years some researchers have explored the use of reinforcement learning (RL) algorithms as key components in the solution of various natural language processing tasks. For instance, some of these algorithms leveraging deep neural…

When function approximation is used, solving the Bellman optimality equation with stability guarantees has remained a major open problem in reinforcement learning for decades. The fundamental difficulty is that the Bellman operator may…

机器学习 · 计算机科学 2018-06-07 Bo Dai , Albert Shaw , Lihong Li , Lin Xiao , Niao He , Zhen Liu , Jianshu Chen , Le Song

This paper studies systematic exploration for reinforcement learning with rich observations and function approximation. We introduce a new model called contextual decision processes, that unifies and generalizes most prior settings. Our…

机器学习 · 计算机科学 2016-12-02 Nan Jiang , Akshay Krishnamurthy , Alekh Agarwal , John Langford , Robert E. Schapire

Reinforcement Learning (RL) has emerged as a dominant paradigm for end-to-end autonomous driving (AD). However, RL suffers from sample inefficiency and a lack of semantic interpretability in complex scenarios. Foundation Models,…

人工智能 · 计算机科学 2026-02-12 Yansong Qu , Zihao Sheng , Zilin Huang , Jiancong Chen , Yuhao Luo , Tianyi Wang , Yiheng Feng , Samuel Labi , Sikai Chen