English
Related papers

Related papers: Offline Reinforcement Learning with Discrete Diffu…

200 papers

Diffusion policies (DP) have recently shown great promise for generating actions in robotic manipulation. However, existing approaches often rely on global instructions to produce short-term control signals, which can result in misalignment…

Robotics · Computer Science 2026-01-06 Zhihao Gu , Ming Yang , Difan Zou , Dong Xu

The goal of offline reinforcement learning (RL) is to extract a high-performance policy from the fixed datasets, minimizing performance degradation due to out-of-distribution (OOD) samples. Offline model-based RL (MBRL) is a promising…

Machine Learning · Computer Science 2025-05-20 Dongsu Lee , Minhae Kwon

Recent research has shown that fine-tuning diffusion models (DMs) with arbitrary rewards, including non-differentiable ones, is feasible with reinforcement learning (RL) techniques, enabling flexible model alignment. However, applying…

Machine Learning · Computer Science 2025-03-12 Zhiwei Jia , Yuesong Nan , Huixi Zhao , Gengdai Liu

Deep Reinforcement Learning (DRL) is emerging as a promising approach to generate adaptive behaviors for robotic platforms. However, a major drawback of using DRL is the data-hungry training regime that requires millions of trial and error…

We study continual offline reinforcement learning, a practical paradigm that facilitates forward transfer and mitigates catastrophic forgetting to tackle sequential offline tasks. We propose a dual generative replay framework that retains…

Machine Learning · Computer Science 2024-04-19 Jinmei Liu , Wenbin Li , Xiangyu Yue , Shilin Zhang , Chunlin Chen , Zhi Wang

Demonstration-guided reinforcement learning (RL) is a promising approach for learning complex behaviors by leveraging both reward feedback and a set of target task demonstrations. Prior approaches for demonstration-guided RL treat every new…

Machine Learning · Computer Science 2021-07-22 Karl Pertsch , Youngwoon Lee , Yue Wu , Joseph J. Lim

Offline Reinforcement Learning (RL) algorithms learn a policy using a fixed training dataset, which is then deployed online to interact with the environment and make decisions. Transformers, a standard choice for modeling time-series data,…

Artificial Intelligence · Computer Science 2025-02-18 Dan Elbaz , Oren Salzman

This study considers multiple reconfigurable intelligent surfaces (RISs)-aided multiuser downlink systems with the goal of jointly optimizing the transmitter precoding and RIS phase shift matrix to maximize spectrum efficiency. Unlike prior…

Information Theory · Computer Science 2025-10-01 Po-Heng Chou , Bo-Ren Zheng , Wan-Jen Huang , Walid Saad , Yu Tsao , Ronald Y. Chang

The offline reinforcement learning (RL) paradigm provides a general recipe to convert static behavior datasets into policies that can perform better than the policy that collected the data. While policy constraints, conservatism, and other…

Artificial Intelligence · Computer Science 2023-10-19 Jianlan Luo , Perry Dong , Jeffrey Wu , Aviral Kumar , Xinyang Geng , Sergey Levine

Offline reinforcement learning (RL) learns policies entirely from static datasets, thereby avoiding the challenges associated with online data collection. Practical applications of offline RL will inevitably require learning from datasets…

Machine Learning · Computer Science 2022-11-22 Anikait Singh , Aviral Kumar , Quan Vuong , Yevgen Chebotar , Sergey Levine

Skill-based reinforcement learning (RL) has emerged as a promising strategy to leverage prior knowledge for accelerated robot learning. Skills are typically extracted from expert demonstrations and are embedded into a latent space from…

Robotics · Computer Science 2022-11-07 Krishan Rana , Ming Xu , Brendan Tidd , Michael Milford , Niko Sünderhauf

Diffusion Large Language Models (dLLMs) have emerged as a promising alternative to autoregressive (AR) LLMs for text generation, with the potential to decode multiple tokens in a single iteration. However, none of the existing open-source…

Machine Learning · Computer Science 2025-08-14 Xu Wang , Chenkai Xu , Yijie Jin , Jiachun Jin , Hao Zhang , Zhijie Deng

Reinforcement learning (RL) has been widely used to train LLM agents for multi-turn interactive tasks, but its sample efficiency is severely limited by sparse rewards and long horizons. On-policy self-distillation (OPSD) alleviates this by…

Machine Learning · Computer Science 2026-04-14 Hao Wang , Guozhi Wang , Han Xiao , Yufeng Zhou , Yue Pan , Jichao Wang , Ke Xu , Yafei Wen , Xiaohu Ruan , Xiaoxin Chen , Honggang Qi

Network slicing-based communication systems can dynamically and efficiently allocate resources for diversified services. However, due to the limitation of the network interface on channel access and the complexity of the resource…

Networking and Internet Architecture · Computer Science 2023-11-29 Zhengming Zhang , Yongming Huang , Cheng Zhang , Qingbi Zheng , Luxi Yang , Xiaohu You

Reinforcement learning-based recommender systems (RL4RS) have gained attention for their ability to adapt to dynamic user preferences. However, these systems face challenges, particularly in offline settings, where data inefficiency and…

Information Retrieval · Computer Science 2025-10-16 Xiaocong Chen , Siyu Wang , Lina Yao

The offline reinforcement learning (RL) problem aims to learn an optimal policy from historical data collected by one or more behavioural policies (experts) by interacting with an environment. However, the individual experts may be…

Cryptography and Security · Computer Science 2025-11-25 Navodita Sharma , Vishnu Vinod , Abhradeep Thakurta , Alekh Agarwal , Borja Balle , Christoph Dann , Aravindan Raghuveer

Deep reinforcement learning (DRL) has achieved remarkable success in various research domains. However, its reliance on neural networks results in a lack of transparency, which limits its practical applications. To achieve explainability,…

Machine Learning · Computer Science 2026-05-25 Yongyan Wen , Siyuan Li , Rongchang Zuo , Lei Yuan , Hangyu Mao , Peng Liu

This study presents a novel approach to addressing offline reinforcement learning (RL) problems by reframing them as regression tasks that can be effectively solved using Decision Trees. Mainly, we introduce two distinct frameworks:…

Machine Learning · Computer Science 2024-10-16 Prajwal Koirala , Cody Fleming

Offline reinforcement learning (RL) provides a promising direction to exploit massive amount of offline data for complex decision-making tasks. Due to the distribution shift issue, current offline RL algorithms are generally designed to be…

Machine Learning · Computer Science 2022-10-25 Rui Yang , Chenjia Bai , Xiaoteng Ma , Zhaoran Wang , Chongjie Zhang , Lei Han

Diffusion policy sampling enables reinforcement learning (RL) to represent multimodal action distributions beyond suboptimal unimodal Gaussian policies. However, existing diffusion-based RL methods primarily focus on offline settings for…

Machine Learning · Computer Science 2026-05-07 Xiaoyuan Cheng , Wenxuan Yuan , Boyang Li , Yuanchao Xu , Yiming Yang , Hao Liang , Bei Peng , Robert Loftin , Zhuo Sun , Yukun Hu