English
Related papers

Related papers: Should We Ever Prefer Decision Transformer for Off…

200 papers

Recent research on robot manipulation based on Behavior Cloning (BC) has made significant progress. By combining diffusion models with BC, diffusion policiy has been proposed, enabling robots to quickly learn manipulation tasks with high…

Robotics · Computer Science 2025-03-18 Qianhao Wang , Yinqian Sun , Enmeng Lu , Qian Zhang , Yi Zeng

Mobile edge computing (MEC) based wireless metaverse services offer an untethered, immersive experience to users, where the superior quality of experience (QoE) needs to be achieved under stringent latency constraints and visual quality…

Networking and Internet Architecture · Computer Science 2026-02-19 Fatih Temiz , Shavbo Salehi , Melike Erol-Kantarci

Federated Reinforcement Learning (FRL) has been deemed as a promising solution for intelligent decision-making in the era of Artificial Internet of Things. However, existing FRL approaches often entail repeated interactions with the…

Machine Learning · Computer Science 2024-05-30 Sheng Yue , Zerui Qin , Xingyuan Hua , Yongheng Deng , Ju Ren

Offline reinforcement learning methods hold the promise of learning policies from pre-collected datasets without the need to query the environment for new transitions. This setting is particularly well-suited for continuous control robotic…

Machine Learning · Computer Science 2022-03-18 Xi Chen , Ali Ghadirzadeh , Tianhe Yu , Yuan Gao , Jianhao Wang , Wenzhe Li , Bin Liang , Chelsea Finn , Chongjie Zhang

Offline preference-based reinforcement learning (PbRL) typically operates in two phases: first, use human preferences to learn a reward model and annotate rewards for a reward-free offline dataset; second, learn a policy by optimizing the…

Artificial Intelligence · Computer Science 2024-12-24 Songjun Tu , Jingbo Sun , Qichao Zhang , Yaocheng Zhang , Jia Liu , Ke Chen , Dongbin Zhao

Recent works have shown the remarkable superiority of transformer models in reinforcement learning (RL), where the decision-making problem is formulated as sequential generation. Transformer-based agents could emerge with self-improvement…

Machine Learning · Computer Science 2024-06-04 Sili Huang , Jifeng Hu , Zhejian Yang , Liwei Yang , Tao Luo , Hechang Chen , Lichao Sun , Bo Yang

Offline reinforcement learning, which aims at optimizing sequential decision-making strategies with historical data, has been extensively applied in real-life applications. State-Of-The-Art algorithms usually leverage powerful function…

Machine Learning · Computer Science 2022-11-28 Ming Yin , Mengdi Wang , Yu-Xiang Wang

Securing long-term success is the ultimate aim of recommender systems, demanding strategies capable of foreseeing and shaping the impact of decisions on future user satisfaction. Current recommendation strategies grapple with two…

Information Retrieval · Computer Science 2025-01-14 Chongming Gao , Kexin Huang , Ziang Fei , Jiaju Chen , Jiawei Chen , Jianshan Sun , Shuchang Liu , Qingpeng Cai , Peng Jiang

Deep Reinforcement Learning (DRL) has recently achieved significant advances in various domains. However, explaining the policy of RL agents still remains an open problem due to several factors, one being the complexity of explaining neural…

Machine Learning · Computer Science 2021-03-31 Zihan Ding , Pablo Hernandez-Leal , Gavin Weiguang Ding , Changjian Li , Ruitong Huang

To overcome the curses of dimensionality and modeling of Dynamic Programming (DP) methods to solve Markov Decision Process (MDP) problems, Reinforcement Learning (RL) methods are adopted in practice. Contrary to traditional RL algorithms…

Machine Learning · Computer Science 2021-08-24 Arghyadip Roy , Vivek Borkar , Abhay Karandikar , Prasanna Chaporkar

Learning-based approaches for solving large sequential decision making problems have become popular in recent years. The resulting agents perform differently and their characteristics depend on those of the underlying learning approach.…

Machine Learning · Computer Science 2020-08-04 Timo P. Gros , Daniel Höller , Jörg Hoffmann , Verena Wolf

Off-policy learning ability is an important feature of reinforcement learning (RL) for practical applications. However, even one of the most elementary RL algorithms, temporal-difference (TD) learning, is known to suffer form divergence…

Machine Learning · Computer Science 2025-04-21 Han-Dong Lim , Donghwan Lee

The purpose of offline multi-task reinforcement learning (MTRL) is to develop a unified policy applicable to diverse tasks without the need for online environmental interaction. Recent advancements approach this through sequence modeling,…

Machine Learning · Computer Science 2024-05-29 Shengchao Hu , Ziqing Fan , Li Shen , Ya Zhang , Yanfeng Wang , Dacheng Tao

Offline reinforcement learning is used to train policies in scenarios where real-time access to the environment is expensive or impossible. As a natural consequence of these harsh conditions, an agent may lack the resources to fully observe…

Machine Learning · Computer Science 2021-12-09 Jayanth Reddy Regatti , Aniket Anand Deshmukh , Frank Cheng , Young Hun Jung , Abhishek Gupta , Urun Dogan

Recent advancements in offline reinforcement learning (RL) have underscored the capabilities of Return-Conditioned Supervised Learning (RCSL), a paradigm that learns the action distribution based on target returns for each state in a…

Machine Learning · Computer Science 2023-12-22 Yuanfu Wang , Chao Yang , Ying Wen , Yu Liu , Yu Qiao

Sequential decision-making algorithms such as reinforcement learning (RL) in real-world scenarios inevitably face environments with partial observability. This paper scrutinizes the effectiveness of a popular architecture, namely…

Machine Learning · Computer Science 2024-05-31 Chenhao Lu , Ruizhe Shi , Yuyao Liu , Kaizhe Hu , Simon S. Du , Huazhe Xu

Offline reinforcement learning (RL) has achieved significant advances in domains such as robotic control, autonomous driving, and medical decision-making. Most existing methods primarily focus on training policies that maximize cumulative…

Machine Learning · Computer Science 2025-09-30 Yue Pei , Hongming Zhang , Chao Gao , Martin Müller , Mengxiao Zhu , Hao Sheng , Ziliang Chen , Liang Lin , Haogang Zhu

Hybrid Reinforcement Learning (RL), where an agent learns from both an offline dataset and online explorations in an unknown environment, has garnered significant recent interest. A crucial question posed by Xie et al. (2022) is whether…

Machine Learning · Statistics 2024-08-09 Kevin Tan , Wei Fan , Yuting Wei

Large transformer models pretrained on offline reinforcement learning datasets have demonstrated remarkable in-context reinforcement learning (ICRL) capabilities, where they can make good decisions when prompted with interaction…

Machine Learning · Computer Science 2024-05-28 Licong Lin , Yu Bai , Song Mei

Offline reinforcement learning (RL) recently gains growing interests from RL researchers. However, the performance of offline RL suffers from the out-of-distribution problem, which can be corrected by feedback in online RL. Previous offline…

Machine Learning · Computer Science 2025-06-25 Shuncheng He , Hongchang Zhang , Jianzhun Shao , Yuhang Jiang , Xiangyang Ji