English
Related papers

Related papers: Uncertainty-Aware Decision Transformer for Stochas…

200 papers

In-context learning is a promising approach for offline reinforcement learning (RL) to handle online tasks, which can be achieved by providing task prompts. Recent works demonstrated that in-context RL could emerge with self-improvement in…

Machine Learning · Computer Science 2024-06-03 Sili Huang , Jifeng Hu , Hechang Chen , Lichao Sun , Bo Yang

Offline meta reinforcement learning (OMRL) has emerged as a promising approach for interaction avoidance and strong generalization performance by leveraging pre-collected data and meta-learning techniques. Previous context-based approaches…

Machine Learning · Computer Science 2025-02-04 Hai Zhang , Boyuan Zheng , Tianying Ji , Jinhang Liu , Anqi Guo , Junqiao Zhao , Lanqing Li

In mixed autonomy traffic environment, every decision made by an autonomous-driving car may have a great impact on the transportation system. Because of the complex interaction between vehicles, it is challenging to make decisions that can…

Artificial Intelligence · Computer Science 2025-07-25 Ye Han , Lijun Zhang , Dejian Meng , Xingyu Hu , Yixia Lu

Online Reinforcement Learning (RL) is typically framed as the process of minimizing cumulative regret (CR) through interactions with an unknown environment. However, real-world RL applications usually involve a sequence of tasks, and the…

Machine Learning · Statistics 2024-10-28 Ziping Xu , Kelly W. Zhang , Susan A. Murphy

Reinforcement learning (RL) in robotics is often limited by the cost and risk of data collection, motivating experience transfer from a source task to a target task. Offline-to-online RL leverages prior data but typically assumes a given…

Machine Learning · Computer Science 2026-04-16 Mintae Kim , Koushil Sreenath

Continuous-time reinforcement learning (CTRL) provides a natural framework for sequential decision-making in dynamic environments where interactions evolve continuously over time. While CTRL has shown growing empirical success, its ability…

Machine Learning · Computer Science 2025-12-04 Runze Zhao , Yue Yu , Ruhan Wang , Chunfeng Huang , Dongruo Zhou

Understanding adaptive human driving behavior, in particular how drivers manage uncertainty, is of key importance for developing simulated human driver models that can be used in the evaluation and development of autonomous vehicles.…

Robotics · Computer Science 2023-11-14 Johan Engström , Ran Wei , Anthony McDonald , Alfredo Garcia , Matt O'Kelly , Leif Johnson

Reinforcement learning (RL) systems typically optimize scalar reward functions that assume precise and reliable evaluation of outcomes. However, real-world objectives--especially those derived from human preferences--are often uncertain,…

Machine Learning · Computer Science 2026-04-30 Disha Singha

We address the problem of forecasting pedestrian and vehicle trajectories in unknown environments, conditioned on their past motion and scene structure. Trajectory forecasting is a challenging problem due to the large variation in scene…

Computer Vision and Pattern Recognition · Computer Science 2021-04-30 Nachiket Deo , Mohan M. Trivedi

Offline reinforcement learning (RL) optimizes the policy on a previously collected dataset without any interactions with the environment, yet usually suffers from the distributional shift problem. To mitigate this issue, a typical solution…

Machine Learning · Computer Science 2023-09-06 Qisen Yang , Shenzhi Wang , Qihang Zhang , Gao Huang , Shiji Song

Offline reinforcement learning (RL) enables data-efficient and safe policy learning without online exploration, but its performance often degrades under distribution shift. The learned policy may visit out-of-distribution state-action pairs…

Artificial Intelligence · Computer Science 2026-03-17 Hongqiang Lin , Zhenghui Fu , Weihao Tang , Pengfei Wang , Yiding Sun , Qixian Huang , Dongxu Zhang

This work studies offline Reinforcement Learning (RL) in a class of non-Markovian environments called Regular Decision Processes (RDPs). In RDPs, the unknown dependency of future observations and rewards from the past interactions can be…

Machine Learning · Computer Science 2024-09-05 Ahana Deb , Roberto Cipollone , Anders Jonsson , Alessandro Ronca , Mohammad Sadegh Talebi

Real-time path planning in constrained environments remains a fundamental challenge for autonomous systems. Traditional classical planners, while effective under perfect perception assumptions, are often sensitive to real-world perception…

Robotics · Computer Science 2026-02-02 Feng Tao , Luca Paparusso , Chenyi Gu , Robin Koehler , Chenxu Wu , Xinyu Huang , Christian Juette , David Paz , Ren Liu

Urban traffic management demands systems that simultaneously predict future conditions, detect anomalies, and take safe corrective actions -- all while providing reliability guarantees. We present STREAM-RL, a unified framework that…

Machine Learning · Computer Science 2026-02-05 Joydeep Chandra , Satyam Kumar Navneet , Aleksandr Algazinov , Yong Zhang

Offline reinforcement learning (RL) offers a powerful paradigm for data-driven control. Compared to model-free approaches, offline model-based RL (MBRL) explicitly learns a world model from a static dataset and uses it as a surrogate…

Machine Learning · Computer Science 2026-02-02 Jiayu Chen , Le Xu , Aravind Venugopal , Jeff Schneider

Autonomous vehicles inevitably encounter a vast array of scenarios in real-world environments. Addressing long-tail scenarios, particularly those involving intensive interactions with numerous traffic participants, remains one of the most…

Robotics · Computer Science 2024-12-16 Guanzhou Li , Jianping Wu , Yujing He

Traversing terrain with good traction is crucial for achieving fast off-road navigation. Instead of manually designing costs based on terrain features, existing methods learn terrain properties directly from data via self-supervision to…

Transformers trained via Reinforcement Learning (RL) with outcome-based supervision can spontaneously develop the ability to generate intermediate reasoning steps (Chain-of-Thought). Yet the mechanism by which sparse rewards drive policy…

Machine Learning · Computer Science 2026-02-03 Yuval Ran-Milo , Yotam Alexander , Shahar Mendel , Nadav Cohen

Reinforcement learning (RL) offers a compelling data-driven paradigm for synthesizing controllers for complex systems when accurate physical models are unavailable; however, most existing control-oriented RL methods assume stationarity and,…

Machine Learning · Computer Science 2026-04-22 Austin Coursey , Abel Diaz-Gonzalez , Marcos Quinones-Grueiro , Gautam Biswas

Traversability estimation in rugged, unstructured environments remains a challenging problem in field robotics. Often, the need for precise, accurate traversability estimation is in direct opposition to the limited sensing and compute…

Robotics · Computer Science 2024-07-12 Samuel Triest , David D. Fan , Sebastian Scherer , Ali-Akbar Agha-Mohammadi