English
Related papers

Related papers: Reinforcement Learning with Discrete Diffusion Pol…

200 papers

Constrained reinforcement learning (RL) seeks high-performance policies under safety constraints. We focus on an offline setting where the agent has only a fixed dataset -- common in realistic tasks to prevent unsafe exploration. To address…

Machine Learning · Computer Science 2025-09-08 Junyu Guo , Zhi Zheng , Donghao Ying , Ming Jin , Shangding Gu , Costas Spanos , Javad Lavaei

Deep reinforcement learning (DRL) has long been a promising solution for sequential resource management in wireless networks. However, conventional DRL methods are fundamentally limited by their reliance on unimodal policy distributions,…

Offline reinforcement learning (RL) is challenged by the distributional shift between learning policies and datasets. To address this problem, existing works mainly focus on designing sophisticated algorithms to explicitly or implicitly…

Machine Learning · Computer Science 2022-10-18 Yang Yue , Bingyi Kang , Xiao Ma , Zhongwen Xu , Gao Huang , Shuicheng Yan

In this paper, we study the optimal dividend problem under the continuous time diffusion model with the bounded dividend rate from the Reinforcement Learning (RL) perspective. Unlike the standard literature, our main focus will be on…

Optimization and Control · Mathematics 2026-03-30 Lihua Bai , Thejani Gamage , Jin Ma , Gaozhan Wang

Reinforcement learning (RL) algorithms have proven transformative in a range of domains. To tackle real-world domains, these systems often use neural networks to learn policies directly from pixels or other high-dimensional sensory input.…

Machine Learning · Computer Science 2025-10-02 Nishil Patel , Sebastian Lee , Stefano Sarao Mannelli , Sebastian Goldt , Andrew Saxe

Reinforcement Learning (RL) is increasingly applied to large-scale decision-making problems like logistics, scheduling, and recommender systems, but existing algorithms struggle with the curse of dimensionality in such large discrete action…

Machine Learning · Computer Science 2026-05-12 Heiko Hoppe , Fabian Akkerman , Wouter van Heeswijk , Maximilian Schiffer

Diffusion-based policies have gained growing popularity in solving a wide range of decision-making tasks due to their superior expressiveness and controllable generation during inference. However, effectively training large diffusion…

Offline reinforcement learning (RL) holds promise as a means to learn high-reward policies from a static dataset, without the need for further environment interactions. However, a key challenge in offline RL lies in effectively stitching…

Machine Learning · Computer Science 2023-09-14 Siddarth Venkatraman , Shivesh Khaitan , Ravi Tej Akella , John Dolan , Jeff Schneider , Glen Berseth

The framework of deep reinforcement learning (DRL) provides a powerful and widely applicable mathematical formalization for sequential decision-making. This paper present a novel DRL framework, termed \emph{$f$-Divergence Reinforcement…

Machine Learning · Computer Science 2021-12-15 Chen Gong , Qiang He , Yunpeng Bai , Zhou Yang , Xiaoyu Chen , Xinwen Hou , Xianjie Zhang , Yu Liu , Guoliang Fan

Many real-world applications can be formulated as multi-agent cooperation problems, such as network packet routing and coordination of autonomous vehicles. The emergence of deep reinforcement learning (DRL) provides a promising approach for…

Multiagent Systems · Computer Science 2022-06-28 Zhixuan Liang , Jiannong Cao , Shan Jiang , Divya Saxena , Huafeng Xu

While deep reinforcement learning (RL) has fueled multiple high-profile successes in machine learning, it is held back from more widespread adoption by its often poor data efficiency and the limited generality of the policies it produces. A…

Machine Learning · Computer Science 2025-05-30 Jacob Beck , Risto Vuorio , Evan Zheran Liu , Zheng Xiong , Luisa Zintgraf , Chelsea Finn , Shimon Whiteson

We investigate reinforcement learning (RL) in the presence of distributional mismatch between training and deployment, where policies trained in simulators often underperform in practice due to mismatches between training and deployment…

Machine Learning · Computer Science 2025-11-12 Debamita Ghosh , George K. Atia , Yue Wang

Reinforcement learning (RL) is a framework to optimize a control policy using rewards that are revealed by the system as a response to a control action. In its standard form, RL involves a single agent that uses its policy to accomplish a…

Systems and Control · Electrical Eng. & Systems 2021-11-24 Juan Cervino , Juan Andres Bazerque , Miguel Calvo-Fullana , Alejandro Ribeiro

Fine-tuning foundation models via reinforcement learning (RL) has proven promising for aligning to downstream objectives. In the case of diffusion models (DMs), though RL training improves alignment from early timesteps, critical issues…

Machine Learning · Statistics 2024-10-14 Roberto Barceló , Cristóbal Alcázar , Felipe Tobar

Reinforcement learning (RL) involves sequential decision making in uncertain environments. The aim of the decision-making agent is to maximize the benefit of acting in its environment over an extended period of time. Finding an optimal…

Artificial Intelligence · Computer Science 2007-05-23 Istvan Szita , Balint Takacs , Andras Lorincz

Reinforcement learning (RL) algorithms have demonstrated promising results on complex tasks, yet often require impractical numbers of samples since they learn from scratch. Meta-RL aims to address this challenge by leveraging experience…

Machine Learning · Computer Science 2020-10-28 Russell Mendonca , Abhishek Gupta , Rosen Kralev , Pieter Abbeel , Sergey Levine , Chelsea Finn

Optimizing discrete diffusion model (DDM) with rewards remains a challenge: the non-autoregressive paradigm makes importance sampling intractable and rollout complex, puzzling reinforcement learning methods such as Group Relative Policy…

Artificial Intelligence · Computer Science 2025-10-06 Tianren Ma , Mu Zhang , Yibing Wang , Qixiang Ye

Recent work has shown that reinforcement learning (RL) is a promising approach to control dynamical systems described by partial differential equations (PDE). This paper shows how to use RL to tackle more general PDE control problems that…

Machine Learning · Computer Science 2018-06-20 Yangchen Pan , Amir-massoud Farahmand , Martha White , Saleh Nabi , Piyush Grover , Daniel Nikovski

Deep reinforcement learning (DRL) is a very active research area. However, several technical and scientific issues require to be addressed, amongst which we can mention data inefficiency, exploration-exploitation trade-off, and multi-task…

Machine Learning · Computer Science 2020-11-24 Mohammad Reza Samsami , Hossein Alimadad

Skills have been introduced to offline reinforcement learning (RL) as temporal abstractions to tackle complex, long-horizon tasks, promoting consistent behavior and enabling meaningful exploration. While skills in offline RL are…

Machine Learning · Computer Science 2025-03-27 RuiXi Qiao , Jie Cheng , Xingyuan Dai , Yonglin Tian , Yisheng Lv