English
Related papers

Related papers: Return Augmented Decision Transformer for Off-Dyna…

200 papers

Offline Reinforcement Learning (RL) aims to learn a near-optimal policy from a fixed dataset of transitions collected by another policy. This problem has attracted a lot of attention recently, but most existing methods with strong…

Machine Learning · Computer Science 2023-05-23 Germano Gabbianelli , Gergely Neu , Nneka Okolo , Matteo Papini

Reinforcement learning (RL) has shown promise in robotics, but deploying RL on real vehicles remains challenging due to the complexity of vehicle dynamics and the mismatch between simulation and reality. Factors such as tire…

Robotics · Computer Science 2025-11-11 Thomas Steinecker , Alexander Bienemann , Denis Trescher , Thorsten Luettel , Mirko Maehlisch

Unsupervised reinforcement learning aims to acquire skills without prior goal representations, where an agent automatically explores an open-ended environment to represent goals and learn the goal-conditioned policy. However, this procedure…

Machine Learning · Computer Science 2021-10-27 Jinxin Liu , Hao Shen , Donglin Wang , Yachen Kang , Qiangxing Tian

The success of deep reinforcement learning (DRL) relies on the availability and quality of training data, often requiring extensive interactions with specific environments. In many real-world scenarios, where data collection is costly and…

Machine Learning · Computer Science 2025-04-15 Amir Abolfazli , Zekun Song , Avishek Anand , Wolfgang Nejdl

Dynamic Rank Reinforcement Learning (DR-RL) approximations rely on static rank assumptions, limiting their flexibility across diverse linguistic contexts. Our method dynamically modulates ranks based on real-time sequence dynamics,…

Machine Learning · Computer Science 2026-02-10 Caner Erden

This article presents a digital twin (DT)-enhanced reinforcement learning (RL) framework aimed at optimizing performance and reliability in network resource management, since the traditional RL methods face several unified challenges when…

Systems and Control · Electrical Eng. & Systems 2024-06-18 Nan Cheng , Xiucheng Wang , Zan Li , Zhisheng Yin , Tom Luan , Xuemin Shen

Offline-to-online (O2O) reinforcement learning (RL) pre-trains models on offline data and refines policies through online fine-tuning. However, existing O2O RL algorithms typically require maintaining the tedious offline datasets to…

Machine Learning · Computer Science 2025-02-24 Liyu Zhang , Haochi Wu , Xu Wan , Quan Kong , Ruilong Deng , Mingyang Sun

In this paper, we propose a reinforcement learning-based algorithm for trajectory optimization for constrained dynamical systems. This problem is motivated by the fact that for most robotic systems, the dynamics may not always be known.…

Machine Learning · Statistics 2020-03-05 Kei Ota , Devesh K. Jha , Tomoaki Oiki , Mamoru Miura , Takashi Nammoto , Daniel Nikovski , Toshisada Mariyama

Most deep reinforcement learning (RL) systems are not able to learn effectively from off-policy data, especially if they cannot explore online in the environment. These are critical shortcomings for applying RL to real-world problems where…

This work studies offline Reinforcement Learning (RL) in a class of non-Markovian environments called Regular Decision Processes (RDPs). In RDPs, the unknown dependency of future observations and rewards from the past interactions can be…

Machine Learning · Computer Science 2024-09-05 Ahana Deb , Roberto Cipollone , Anders Jonsson , Alessandro Ronca , Mohammad Sadegh Talebi

By formulating data samples' formation as a Markov denoising process, diffusion models achieve state-of-the-art performances in a collection of tasks. Recently, many variants of diffusion models have been proposed to enable controlled…

Machine Learning · Computer Science 2023-04-17 Hengtong Zhang , Tingyang Xu

Deep reinforcement learning (DRL) is a promising approach for adaptive robot control, but its current application to robotics is currently hindered by high sample requirements. We propose two novel data augmentation techniques for DRL in…

Artificial Intelligence · Computer Science 2019-11-18 Yijiong Lin , Jiancong Huang , Matthieu Zimmer , Juan Rojas , Paul Weng

Reinforcement learning (RL) is a powerful machine learning technique that enables an intelligent agent to learn an optimal policy that maximizes the cumulative rewards in sequential decision making. Most of methods in the existing…

Machine Learning · Statistics 2023-01-06 Chengchun Shi , Zhengling Qi , Jianing Wang , Fan Zhou

Retrieval-Augmented Generation (RAG) is an effective method to enhance the capabilities of large language models (LLMs). Existing methods typically optimize the retriever or the generator in a RAG system by directly using the top-k…

Computation and Language · Computer Science 2025-10-07 Shaohan Wang , Licheng Zhang , Zheren Fu , Zhendong Mao , Yongdong Zhang

Retrieval-augmented generation (RAG) enables large language models (LLMs) to produce evidence-based responses, and its performance hinges on the matching between the retriever and LLMs. Retriever optimization has emerged as an efficient…

Machine Learning · Computer Science 2026-02-04 Yicheng Zhang , Zhen Qin , Zhaomin Wu , Wenqi Zhang , Shuiguang Deng

Offline reinforcement learning (RL) aims to learn policies without online explorations. To enlarge the training data, model-based offline RL learns a dynamics model which is utilized as a virtual environment to generate simulation data and…

Machine Learning · Computer Science 2025-07-11 Ziqi Zhao , Zhaochun Ren , Liu Yang , Yunsen Liang , Fajie Yuan , Pengjie Ren , Zhumin Chen , jun Ma , Xin Xin

Model-based offline reinforcement learning trains policies using pre-collected datasets and learned environment models, eliminating the need for direct real-world environment interaction. However, this paradigm is inherently challenged by…

Machine Learning · Computer Science 2025-10-28 Wang Luo , Haoran Li , Zicheng Zhang , Congying Han , Chi Zhou , Jiayu Lv , Tiande Guo

Reference-model-assisted deep reinforcement learning (DRL) for inverter-based Volt-Var Control (IB-VVC) in active distribution networks is proposed. We investigate that a large action space increases the learning difficulties of DRL and…

Systems and Control · Electrical Eng. & Systems 2022-10-17 Qiong Liu , Ye Guo , Lirong Deng , Haotian Liu , Dongyu Li , Hongbin Sun

Offline reinforcement learning (RL) learns policies from fixed datasets without online interactions, but suffers from distribution shift, causing inaccurate evaluation and overestimation of out-of-distribution (OOD) actions. Existing…

Machine Learning · Computer Science 2025-10-07 Xuyang Chen , Keyu Yan , Wenhan Cao , Lin Zhao

Reinforcement Learning (RL) or Deep Reinforcement Learning (DRL) is a powerful approach to solving Markov Decision Processes (MDPs) when the model of the environment is not known a priori. However, RL models are still faced with challenges…

Systems and Control · Electrical Eng. & Systems 2024-06-04 Kabirat Olayemi , Mien Van , Luke Maguire , Sean McLoone