English
Related papers

Related papers: CORL: Research-oriented Deep Offline Reinforcement…

200 papers

Continual offline reinforcement learning (CORL) aims to learn a sequence of tasks from datasets collected over time while preserving performance on previously learned tasks. This setting corresponds to domains where new tasks arise over…

Machine Learning · Computer Science 2026-04-29 Dominik Żurek , Kamil Faber , Marcin Pietron , Paweł Gajewski , Roberto Corizzo

The ever-growing complexity of reinforcement learning (RL) tasks demands a distributed system to efficiently generate and process a massive amount of data. However, existing open-source libraries suffer from various limitations, which…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-06-24 Zhiyu Mei , Wei Fu , Jiaxuan Gao , Guangju Wang , Huanchen Zhang , Yi Wu

Offline reinforcement learning (ORL) holds great promise for robot learning due to its ability to learn from arbitrary pre-generated experience. However, current ORL benchmarks are almost entirely in simulation and utilize contrived…

Robotics · Computer Science 2022-10-14 Gaoyue Zhou , Liyiming Ke , Siddhartha Srinivasa , Abhinav Gupta , Aravind Rajeswaran , Vikash Kumar

Improving the performance of pre-trained policies through online reinforcement learning (RL) is a critical yet challenging topic. Existing online RL fine-tuning methods require continued training with offline pretrained Q-functions for…

Machine Learning · Computer Science 2025-05-23 Wei Xiao , Jiacheng Liu , Zifeng Zhuang , Runze Suo , Shangke Lyu , Donglin Wang

We present a reinforcement learning (RL) framework in which the learned policy comes with a machine-checkable certificate of provable adversarial robustness. Our approach, called CAROL, learns a model of the environment. In each learning…

Machine Learning · Computer Science 2023-05-30 Chenxi Yang , Greg Anderson , Swarat Chaudhuri

Offline reinforcement learning (RL) aims at learning a good policy from a batch of collected data, without extra interactions with the environment during training. However, current offline RL benchmarks commonly have a large reality gap,…

Machine Learning · Computer Science 2021-02-09 Rongjun Qin , Songyi Gao , Xingyuan Zhang , Zhen Xu , Shengkai Huang , Zewen Li , Weinan Zhang , Yang Yu

Offline multi-agent reinforcement learning (MARL) is an exciting direction of research that uses static datasets to find optimal control policies for multi-agent systems. Though the field is by definition data-driven, efforts have thus far…

Machine Learning · Computer Science 2024-09-19 Claude Formanek , Louise Beyers , Callum Rhys Tilbury , Jonathan P. Shock , Arnu Pretorius

Progress in offline reinforcement learning (RL) has been impeded by ambiguous problem definitions and entangled algorithmic designs, resulting in inconsistent implementations, insufficient ablations, and unfair evaluations. Although offline…

Machine Learning · Computer Science 2025-04-16 Matthew Thomas Jackson , Uljad Berdica , Jarek Liesen , Shimon Whiteson , Jakob Nicolaus Foerster

Offline reinforcement learning algorithms hold the promise of enabling data-driven RL methods that do not require costly or dangerous real-world exploration and benefit from large pre-collected datasets. This in turn can facilitate…

Continuous offline reinforcement learning (CORL) combines continuous and offline reinforcement learning, enabling agents to learn multiple tasks from static datasets without forgetting prior tasks. However, CORL faces challenges in…

Machine Learning · Computer Science 2024-04-09 Kaixin Huang , Li Shen , Chen Zhao , Chun Yuan , Dacheng Tao

Offline reinforcement learning (RL) enables learning control policies by utilizing only prior experience, without any online interaction. This can allow robots to acquire generalizable skills from large and diverse datasets, without any…

Machine Learning · Computer Science 2021-09-24 Aviral Kumar , Anikait Singh , Stephen Tian , Chelsea Finn , Sergey Levine

Advanced model-based controllers are well established in process industries. However, such controllers require regular maintenance to maintain acceptable performance. It is a common practice to monitor controller performance continuously…

Systems and Control · Electrical Eng. & Systems 2020-04-14 Steven Spielberg , Aditya Tulsyan , Nathan P. Lawrence , Philip D Loewen , R. Bhushan Gopaluni

The capability of continuously learning new skills via a sequence of pre-collected offline datasets is desired for an agent. However, consecutively learning a sequence of offline tasks likely leads to the catastrophic forgetting issue under…

Machine Learning · Computer Science 2024-04-23 Sibo Gai , Donglin Wang , Li He

At the interception between quantum computing and machine learning, Quantum Reinforcement Learning (QRL) has emerged as a promising research field. Due to its novelty, a standardized and comprehensive collection for QRL algorithms has not…

Quantum Physics · Physics 2025-07-11 Georg Kruse , Rodrigo Coelho , Andreas Rosskopf , Robert Wille , Jeanette Miriam Lorenz

Software testing activities scrutinize the artifacts and the behavior of a software product to find possible defects and ensure that the product meets its expected requirements. Recently, Deep Reinforcement Learning (DRL) has been…

Software Engineering · Computer Science 2023-06-30 Paulina Stevia Nouwou Mindom , Amin Nikanjam , Foutse Khomh

ObjectRL is an open-source Python codebase for deep reinforcement learning (RL), designed for research-oriented prototyping with minimal programming effort. Unlike existing codebases, ObjectRL is built on Object-Oriented Programming (OOP)…

Machine Learning · Computer Science 2025-07-08 Gulcin Baykal , Abdullah Akgül , Manuel Haussmann , Bahareh Tasdighi , Nicklas Werge , Yi-Shan Wu , Melih Kandemir

We present ShinRL, an open-source library specialized for the evaluation of reinforcement learning (RL) algorithms from both theoretical and practical perspectives. Existing RL libraries typically allow users to evaluate practical…

Machine Learning · Computer Science 2021-12-09 Toshinori Kitamura , Ryo Yonetani

In this work, we propose a new setting of continual learning: data-incremental continual offline reinforcement learning (DICORL), in which an agent is asked to learn a sequence of datasets of a single offline reinforcement learning (RL)…

Machine Learning · Computer Science 2024-12-17 Sibo Gai , Donglin Wang

Post-training algorithms based on deep reinforcement learning can push the limits of robotic models for specific objectives, such as generalizability, accuracy, and robustness. However, Intervention-requiring Failures (IR Failures) (e.g., a…

Robotics · Computer Science 2026-01-13 Huanyu Li , Kun Lei , Sheng Zang , Kaizhe Hu , Yongyuan Liang , Bo An , Xiaoli Li , Huazhe Xu

Reinforcement learning has been applied in operation research and has shown promise in solving large combinatorial optimization problems. However, existing works focus on developing neural network architectures for certain problems. These…

Optimization and Control · Mathematics 2023-03-24 Ching Pui Wan , Tung Li , Jason Min Wang