English
Related papers

Related papers: Uncertainty-Aware Decision Transformer for Stochas…

200 papers

Many real-world domains require safe decision making in uncertain environments. In this work, we introduce a deep reinforcement learning framework for approaching this important problem. We consider a distribution over transition models,…

Machine Learning · Computer Science 2023-10-27 James Queeney , Mouhacine Benosman

In model-free deep reinforcement learning (RL) algorithms, using noisy value estimates to supervise policy evaluation and optimization is detrimental to the sample efficiency. As this noise is heteroscedastic, its effects can be mitigated…

Machine Learning · Computer Science 2022-05-04 Vincent Mai , Kaustubh Mani , Liam Paull

Reinforcement learning (RL) in robotics faces significant hurdles regarding sample efficiency and generalization across varying goals. While Offline RL mitigates the need for costly online interactions, its integration with goal-conditioned…

Robotics · Computer Science 2026-05-11 Paweł Gajewski , Dominik Żurek , Marcin Pietroń , Kamil Faber

Offline reinforcement learning (RL) enables learning control policies by utilizing only prior experience, without any online interaction. This can allow robots to acquire generalizable skills from large and diverse datasets, without any…

Machine Learning · Computer Science 2021-09-24 Aviral Kumar , Anikait Singh , Stephen Tian , Chelsea Finn , Sergey Levine

Urban autonomous driving decision making is challenging due to complex road geometry and multi-agent interactions. Current decision making methods are mostly manually designing the driving policy, which might result in sub-optimal solutions…

Machine Learning · Computer Science 2019-10-23 Jianyu Chen , Bodi Yuan , Masayoshi Tomizuka

The difficulty of exploring and training online on real production systems limits the scope of real-time online data/feedback-driven decision making. The most feasible approach is to adopt offline reinforcement learning from limited…

The paradigm of decision-making has been revolutionised by reinforcement learning and deep learning. Although this has led to significant progress in domains such as robotics, healthcare, and finance, the use of RL in practice is…

Machine Learning · Computer Science 2026-02-23 Daqian Shao

We study offline off-dynamics reinforcement learning (RL) to utilize data from an easily accessible source domain to enhance policy learning in a target domain with limited data. Our approach centers on return-conditioned supervised…

Machine Learning · Computer Science 2026-03-03 Ruhan Wang , Yu Yang , Zhishuai Liu , Dongruo Zhou , Pan Xu

Model-based offline reinforcement learning approaches generally rely on bounds of model error. Estimating these bounds is usually achieved through uncertainty estimation methods. In this work, we combine parametric and nonparametric methods…

Machine Learning · Computer Science 2022-11-07 Guy Tennenholtz , Shie Mannor

We consider off-dynamics reinforcement learning (RL) where one needs to transfer policies across different domains with dynamics mismatch. Despite the focus on developing dynamics-aware algorithms, this field is hindered due to the lack of…

Machine Learning · Computer Science 2024-10-29 Jiafei Lyu , Kang Xu , Jiacheng Xu , Mengbei Yan , Jingwen Yang , Zongzhang Zhang , Chenjia Bai , Zongqing Lu , Xiu Li

Offline reinforcement learning (RL) allows agents to learn effective, return-maximizing policies from a static dataset. Three popular algorithms for offline RL are Conservative Q-Learning (CQL), Behavior Cloning (BC), and Decision…

Machine Learning · Computer Science 2024-03-13 Prajjwal Bhargava , Rohan Chitnis , Alborz Geramifard , Shagun Sodhani , Amy Zhang

We study a multi-objective model on the allocation of reusable resources under model uncertainty. Heterogeneous customers arrive sequentially according to a latent stochastic process, request for certain amounts of resources, and occupy…

Optimization and Control · Mathematics 2023-08-02 Xilin Zhang , Wang Chi Cheung

With the advent of large datasets, offline reinforcement learning (RL) is a promising framework for learning good decision-making policies without the need to interact with the real environment. However, offline RL requires the dataset to…

Machine Learning · Computer Science 2023-03-27 Yicheng Luo , Zhengyao Jiang , Samuel Cohen , Edward Grefenstette , Marc Peter Deisenroth

Reinforcement learning (RL) has emerged as a potent paradigm for autonomous decision-making in complex environments. However, the integration of event-driven decision processes within RL remains a challenge. This paper presents a novel…

Systems and Control · Electrical Eng. & Systems 2025-05-22 Md Nur-A-Adam Dony

Designing reliable decision strategies for autonomous urban driving is challenging. Reinforcement learning (RL) has been used to automatically derive suitable behavior in uncertain environments, but it does not provide any guarantee on the…

To obtain a near-optimal policy with fewer interactions in Reinforcement Learning (RL), a promising approach involves the combination of offline RL, which enhances sample efficiency by leveraging offline datasets, and online RL, which…

Machine Learning · Computer Science 2024-11-18 Xiaoyu Wen , Xudong Yu , Rui Yang , Haoyuan Chen , Chenjia Bai , Zhen Wang

For autonomous vehicles integrating onto roadways with human traffic participants, it requires understanding and adapting to the participants' intention and driving styles by responding in predictable ways without explicit communication.…

Robotics · Computer Science 2021-07-09 Zhitao Wang , Yuzheng Zhuang , Qiang Gu , Dong Chen , Hongbo Zhang , Wulong Liu

Reinforcement learning (RL) is a powerful data-driven control method that has been largely explored in autonomous driving tasks. However, conventional RL approaches learn control policies through trial-and-error interactions with the…

Robotics · Computer Science 2021-11-03 Tianyu Shi , Dong Chen , Kaian Chen , Zhaojian Li

Ensuring reliability in modern software systems requires rigorous pre-production testing across highly heterogeneous and evolving environments. Because exhaustive evaluation is infeasible, practitioners must decide how to allocate limited…

Software Engineering · Computer Science 2025-10-08 Yu Zhu

Autonomous Vehicle (AV) perception systems have advanced rapidly in recent years, providing vehicles with the ability to accurately interpret their environment. Perception systems remain susceptible to errors caused by overly-confident…