English
Related papers

Related papers: Trajectory-wise Iterative Reinforcement Learning F…

200 papers

Most offline reinforcement learning (RL) algorithms return a target policy maximizing a trade-off between (1) the expected performance gain over the behavior policy that collected the dataset, and (2) the risk stemming from the…

Machine Learning · Computer Science 2023-06-23 Zhang-Wei Hong , Pulkit Agrawal , Rémi Tachet des Combes , Romain Laroche

Designing reliable decision strategies for autonomous urban driving is challenging. Reinforcement learning (RL) has been used to automatically derive suitable behavior in uncertain environments, but it does not provide any guarantee on the…

Traditional trajectory planning methods for autonomous vehicles have several limitations. For example, heuristic and explicit simple rules limit generalizability and hinder complex motions. These limitations can be addressed using…

Robotics · Computer Science 2024-05-14 Hyunwoo Park

Learning-based vehicle planning is receiving increasing attention with the emergence of diverse driving simulators and large-scale driving datasets. While offline reinforcement learning (RL) is well suited for these safety-critical tasks,…

Robotics · Computer Science 2023-11-20 Zenan Li , Fan Nie , Qiao Sun , Fang Da , Hang Zhao

In this work, we present Transitive Reinforcement Learning (TRL), a new value learning algorithm based on a divide-and-conquer paradigm. TRL is designed for offline goal-conditioned reinforcement learning (GCRL) problems, where the aim is…

Machine Learning · Computer Science 2026-02-24 Seohong Park , Aditya Oberai , Pranav Atreya , Sergey Levine

Conventional reinforcement learning (RL) needs an environment to collect fresh data, which is impractical when online interactions are costly. Offline RL provides an alternative solution by directly learning from the previously collected…

Machine Learning · Computer Science 2023-03-15 Han Zheng , Xufang Luo , Pengfei Wei , Xuan Song , Dongsheng Li , Jing Jiang

Standard reinforcement learning algorithms with a single policy perform poorly on tasks in complex environments involving sparse rewards, diverse behaviors, or long-term planning. This led to the study of algorithms that incorporate…

Machine Learning · Computer Science 2024-07-23 Ranga Shaarad Ayyagari , Anurita Ghosh , Ambedkar Dukkipati

Offline reinforcement learning (RL) defines a sample-efficient learning paradigm, where a policy is learned from static and previously collected datasets without additional interaction with the environment. The major obstacle to offline RL…

Machine Learning · Computer Science 2022-11-16 Yunfan Zhou , Xijun Li , Qingyu Qu

A long-standing goal in AI is to develop agents capable of solving diverse tasks across a range of environments, including those never seen during training. Two dominant paradigms address this challenge: (i) reinforcement learning (RL),…

Machine Learning · Computer Science 2025-10-30 Vlad Sobal , Wancong Zhang , Kyunghyun Cho , Randall Balestriero , Tim G. J. Rudner , Yann LeCun

Offline Reinforcement Learning (RL) algorithms learn a policy using a fixed training dataset, which is then deployed online to interact with the environment and make decisions. Transformers, a standard choice for modeling time-series data,…

Artificial Intelligence · Computer Science 2025-02-18 Dan Elbaz , Oren Salzman

Recent advances in deep learning have shown significant potential for solving combinatorial optimization problems in real-time. Unlike traditional methods, deep learning can generate high-quality solutions efficiently, which is crucial for…

Machine Learning · Computer Science 2025-04-08 Imanol Echeverria , Maialen Murua , Roberto Santana

Preference-based reinforcement learning (PbRL) can help avoid sophisticated reward designs and align better with human intentions, showing great promise in various real-world applications. However, obtaining human feedback for preferences…

Machine Learning · Computer Science 2026-04-06 Yiqin Yang , Hao Hu , Yihuan Mao , Jin Zhang , Chengjie Wu , Yuhua Jiang , Xu Yang , Runpeng Xie , Yi Fan , Bo Liu , Yang Gao , Bo Xu , Chongjie Zhang

In this paper, we investigate offline reinforcement learning (RL) with the goal of training a single robust policy that generalizes effectively across environments with unseen dynamics. We propose a novel approach, Trajectory Encoding…

Machine Learning · Computer Science 2025-01-28 Batıkan Bora Ormancı , Phillip Swazinna , Steffen Udluft , Thomas A. Runkler

In a recent study, Reinforcement Learning (RL) used in combination with many-objective search, has been shown to outperform alternative techniques (random search and many-objective search) for online testing of Deep Neural Network-enabled…

Software Engineering · Computer Science 2024-03-21 Luca Giamattei , Matteo Biagiola , Roberto Pietrantuono , Stefano Russo , Paolo Tonella

Offline Reinforcement Learning (ORL) enablesus to separately study the two interlinked processes of reinforcement learning: collecting informative experience and inferring optimal behaviour. The second step has been widely studied in the…

Auto-bidding is a critical tool for advertisers to improve advertising performance. Recent progress has demonstrated that AI-Generated Bidding (AIGB), which learns a conditional generative planner from offline data, achieves superior…

Machine Learning · Computer Science 2026-03-04 Zhiyu Mou , Yiqin Lv , Miao Xu , Qi Wang , Yixiu Mao , Jinghao Chen , Qichen Ye , Chao Li , Rongquan Bai , Chuan Yu , Jian Xu , Bo Zheng

In safe offline reinforcement learning (RL), the objective is to develop a policy that maximizes cumulative rewards while strictly adhering to safety constraints, utilizing only offline data. Traditional methods often face difficulties in…

Machine Learning · Computer Science 2026-02-11 Prajwal Koirala , Zhanhong Jiang , Soumik Sarkar , Cody Fleming

Safe and efficient autonomous driving maneuvers in an interactive and complex environment can be considerably challenging due to the unpredictable actions of other surrounding agents that may be cooperative or adversarial in their…

Robotics · Computer Science 2019-01-28 Pin Wang , Ching-Yao Chan , Hanhan Li

Modern decision-making systems, from robots to web recommendation engines, are expected to adapt: to user preferences, changing circumstances or even new tasks. Yet, it is still uncommon to deploy a dynamically learning agent (rather than a…

Machine Learning · Computer Science 2022-11-15 Shengpu Tang , Felipe Vieira Frujeri , Dipendra Misra , Alex Lamb , John Langford , Paul Mineiro , Sebastian Kochman

Offline reinforcement learning (RL) aims to optimize the return given a fixed dataset of agent trajectories without additional interactions with the environment. While algorithm development has progressed rapidly, significant theoretical…

Machine Learning · Computer Science 2025-08-12 Fengdi Che