English
Related papers

Related papers: Deep Generative Models for Offline Policy Learning…

200 papers

Diffusion and flow matching policies offer expressive, multimodal action modeling, yet they are frequently unstable in online reinforcement learning (RL) due to intractable likelihoods and gradients propagating through long sampling chains.…

Machine Learning · Computer Science 2026-03-10 Chubin Zhang , Zhenglin Wan , Feng Chen , Fuchao Yang , Lang Feng , Yaxin Zhou , Xingrui Yu , Yang You , Ivor Tsang , Bo An

We present a data-efficient framework for solving visuomotor sequential decision-making problems which exploits the combination of reinforcement learning (RL) and latent variable generative models. Our framework trains deep visuomotor…

Robotics · Computer Science 2020-11-09 Ali Ghadirzadeh , Petra Poklukar , Ville Kyrki , Danica Kragic , Mårten Björkman

Deep reinforcement learning (RL) algorithms typically parameterize the policy as a deep network that outputs either a deterministic action or a stochastic one modeled as a Gaussian distribution, hence restricting learning to a single…

Machine Learning · Computer Science 2024-06-04 Zechu Li , Rickmer Krohn , Tao Chen , Anurag Ajay , Pulkit Agrawal , Georgia Chalvatzaki

Diffusion and flow models have emerged as powerful generative approaches capable of modeling diverse and multimodal behavior. However, applying these models to offline reinforcement learning (RL) remains challenging due to the iterative…

Machine Learning · Computer Science 2025-05-30 Nicolas Espinosa-Dice , Yiyi Zhang , Yiding Chen , Bradley Guo , Owen Oertell , Gokul Swamy , Kiante Brantley , Wen Sun

Meta Reinforcement Learning (RL) methods focus on automating the design of RL algorithms that generalize to a wide range of environments. The framework introduced in (Anonymous, 2020) addresses the problem by representing different RL…

Machine Learning · Computer Science 2021-01-19 Juan Jose Garau Luis

Diffusion models have demonstrated highly-expressive generative capabilities in vision and NLP. Recent studies in reinforcement learning (RL) have shown that diffusion models are also powerful in modeling complex policies or trajectories in…

Machine Learning · Computer Science 2023-10-11 Haoran He , Chenjia Bai , Kang Xu , Zhuoran Yang , Weinan Zhang , Dong Wang , Bin Zhao , Xuelong Li

Offline Goal-Conditioned RL (GCRL) offers a feasible paradigm for learning general-purpose policies from diverse and multi-task offline datasets. Despite notable recent progress, the predominant offline GCRL methods, mainly model-free, face…

Machine Learning · Computer Science 2024-05-17 Mianchu Wang , Rui Yang , Xi Chen , Hao Sun , Meng Fang , Giovanni Montana

In the field of class incremental learning (CIL), generative replay has become increasingly prominent as a method to mitigate the catastrophic forgetting, alongside the continuous improvements in generative models. However, its application…

Computer Vision and Pattern Recognition · Computer Science 2024-05-08 Junsu Kim , Hoseong Cho , Jihyeon Kim , Yihalem Yimolal Tiruneh , Seungryul Baek

Offline multi-agent reinforcement learning (MARL) aims to learn the optimal joint policy from pre-collected datasets, requiring a trade-off between maximizing global returns and mitigating distribution shift from offline data. Recent…

Machine Learning · Computer Science 2026-04-10 Teng Pang , Zhiqiang Dong , Yan Zhang , Rongjian Xu , Guoqiang Wu , Yilong Yin

Continuous-time generative models for crystalline materials enable inverse materials design by learning to predict stable crystal structures, but incorporating explicit target properties into the generative process remains challenging.…

Machine Learning · Computer Science 2026-02-03 Philipp Hoellmer , Stefano Martiniani

Offline reinforcement learning (RL) methods can generally be categorized into two types: RL-based and Imitation-based. RL-based methods could in principle enjoy out-of-distribution generalization but suffer from erroneous off-policy…

Machine Learning · Computer Science 2023-04-06 Haoran Xu , Li Jiang , Jianxiong Li , Xianyuan Zhan

Off-policy model-free deep reinforcement learning methods using previously collected data can improve sample efficiency over on-policy policy gradient techniques. On the other hand, on-policy algorithms are often more stable and easier to…

Machine Learning · Computer Science 2017-06-02 Shixiang Gu , Timothy Lillicrap , Zoubin Ghahramani , Richard E. Turner , Bernhard Schölkopf , Sergey Levine

Deep reinforcement learning (DRL) shows promising potential for autonomous driving decision-making. However, DRL demands extensive computational resources to achieve a qualified policy in complex driving scenarios due to its low learning…

Robotics · Computer Science 2024-12-25 Hao Pang , Zhenpo Wang , Guoqiang Li

Tabular data is foundational to predictive modeling in various crucial industries, including healthcare, finance, retail, sustainability, etc. Despite the progress made in specialized models, there is an increasing demand for universal…

Machine Learning · Computer Science 2024-07-12 Xumeng Wen , Han Zhang , Shun Zheng , Wei Xu , Jiang Bian

Offline goal-conditioned reinforcement learning (GCRL) is a major problem in reinforcement learning (RL) because it provides a simple, unsupervised, and domain-agnostic way to acquire diverse behaviors and representations from unlabeled…

Machine Learning · Computer Science 2025-02-14 Seohong Park , Kevin Frans , Benjamin Eysenbach , Sergey Levine

Deep Generative models (DGMs) play two key roles in modern machine learning: (i) producing new information (e.g., image synthesis) and (ii) reducing dimensionality. However, traditional architectures often rely on auxiliary networks such as…

Machine Learning · Computer Science 2026-02-23 Georgi Hrusanov , Oliver Y. Chén , Julien S. Bodelet

Recent work has shown that Large Language Models (LLMs) can be incredibly effective for offline reinforcement learning (RL) by representing the traditional RL problem as a sequence modelling problem (Chen et al., 2021; Janner et al., 2021).…

Machine Learning · Computer Science 2023-02-01 Shyam Sudhakaran , Sebastian Risi

Offline reinforcement learning aims to train a policy on a pre-recorded and fixed dataset without any additional environment interactions. There are two major challenges in this setting: (1) extrapolation error caused by approximating the…

Machine Learning · Computer Science 2023-01-31 Dmitriy Akimov , Vladislav Kurenkov , Alexander Nikulin , Denis Tarasov , Sergey Kolesnikov

This study focuses on optimizing path planning for unmanned ground vehicles (UGVs) in precision agriculture using deep reinforcement learning (DRL) techniques in continuous action spaces. The research begins with a review of traditional…

Robotics · Computer Science 2026-01-09 Laukik Patade , Rohan Rane , Sandeep Pillai

Deep generative modeling has emerged as a powerful tool for synthesizing realistic medical images, driving advances in medical image analysis, disease diagnosis, and treatment planning. This chapter explores various deep generative models…

Image and Video Processing · Electrical Eng. & Systems 2024-10-24 Paul Friedrich , Yannik Frisch , Philippe C. Cattin