English
Related papers

Related papers: Energy-Guided Diffusion Sampling for Offline-to-On…

200 papers

Diffusion models has emerged as a powerful framework for tasks like image controllable generation and dense prediction. However, existing models often struggle to capture underlying semantics (e.g., edges, textures, shapes) and effectively…

Computer Vision and Pattern Recognition · Computer Science 2025-03-07 Zhong Ji , Weilong Cao , Yan Zhang , Yanwei Pang , Jungong Han , Xuelong Li

Offline reinforcement learning (RL) faces a critical challenge of overestimating the value of out-of-distribution (OOD) actions. Existing methods mitigate this issue by penalizing unseen samples, yet they fail to accurately identify OOD…

Machine Learning · Computer Science 2026-05-12 Qingjun Wang , Hongtu Zhou , Hang Yu , Junqiao Zhao , Yanping Zhao , Chen Ye , Ziqiao Wang , Guang Chen

Diffusion Models (DMs), as a leading class of generative models, offer key advantages for reinforcement learning (RL), including multi-modal expressiveness, stable training, and trajectory-level planning. This survey delivers a…

Machine Learning · Computer Science 2025-10-15 Changfu Xu , Jianxiong Guo , Yuzhu Liang , Haiyang Huang , Haodong Zou , Xi Zheng , Shui Yu , Xiaowen Chu , Jiannong Cao , Tian Wang

Millions of sensors, cameras, meters, and other edge devices are deployed in networks to collect and analyse data. In many cases, such devices are powered only by Energy Harvesting(EH) and have limited energy available to analyse acquired…

Networking and Internet Architecture · Computer Science 2022-05-31 Jernej Hribar , Ryoichi Shinkuma , George Iosifidis , Ivana Dusparic

Online reinforcement learning (RL) has been central to post-training language models, but its extension to diffusion models remains challenging due to intractable likelihoods. Recent works discretize the reverse sampling process to enable…

Machine Learning · Computer Science 2026-02-17 Kaiwen Zheng , Huayu Chen , Haotian Ye , Haoxiang Wang , Qinsheng Zhang , Kai Jiang , Hang Su , Stefano Ermon , Jun Zhu , Ming-Yu Liu

Sample efficiency and exploration remain major challenges in online reinforcement learning (RL). A powerful approach that can be applied to address these issues is the inclusion of offline data, such as prior trajectories from a human…

Machine Learning · Computer Science 2023-06-01 Philip J. Ball , Laura Smith , Ilya Kostrikov , Sergey Levine

Despite remarkable progress in autoregressive language models, alternative generative paradigms beyond left-to-right generation are still being actively explored. Discrete diffusion models, with the capacity for parallel generation, have…

Computation and Language · Computer Science 2025-03-10 Minkai Xu , Tomas Geffner , Karsten Kreis , Weili Nie , Yilun Xu , Jure Leskovec , Stefano Ermon , Arash Vahdat

Temporal abstraction and efficient planning pose significant challenges in offline reinforcement learning, mainly when dealing with domains that involve temporally extended tasks and delayed sparse rewards. Existing methods typically plan…

Machine Learning · Computer Science 2023-10-03 Wenhao Li

With the rise of Software-Defined Networking (SDN) for managing traffic and ensuring seamless operations across interconnected devices, challenges arise when SDN controllers share infrastructure with deep learning (DL) workloads. Resource…

Networking and Internet Architecture · Computer Science 2025-07-04 Eyad Gad , Gad Gad , Mostafa M. Fouda , Mohamed I. Ibrahem , Muhammad Ismail , Zubair Md Fadlullah

Offline reinforcement learning (RL), which aims to learn an optimal policy using a previously collected static dataset, is an important paradigm of RL. Standard RL methods often perform poorly in this regime due to the function…

Machine Learning · Computer Science 2023-08-29 Zhendong Wang , Jonathan J Hunt , Mingyuan Zhou

The deep reinforcement learning-based energy management strategies (EMS) have become a promising solution for hybrid electric vehicles (HEVs). When driving cycles are changed, the neural network will be retrained, which is a time-consuming…

Machine Learning · Computer Science 2022-04-21 Jingyi Xu , Zirui Li , Li Gao , Junyi Ma , Qi Liu , Yanan Zhao

Offline reinforcement learning (RL) provides a compelling paradigm for training autonomous systems without the risks of online exploration, particularly in safety-critical domains. However, jointly achieving strong safety and performance…

Machine Learning · Computer Science 2026-02-10 Manan Tayal , Mumuksh Tayal

In this paper, we propose a novel approach called DIffusion-guided DIversity (DIDI) for offline behavioral generation. The goal of DIDI is to learn a diverse set of skills from a mixture of label-free offline data. We achieve this by…

Machine Learning · Computer Science 2024-05-24 Jinxin Liu , Xinghong Guo , Zifeng Zhuang , Donglin Wang

Offline reinforcement learning (RL) aims to learn optimal policies from previously collected datasets. Recently, due to their powerful representational capabilities, diffusion models have shown significant potential as policy models for…

Machine Learning · Computer Science 2024-05-30 Tianle Zhang , Jiayi Guan , Lin Zhao , Yihang Li , Dongjiang Li , Zecui Zeng , Lei Sun , Yue Chen , Xuelong Wei , Lusong Li , Xiaodong He

Diffusion models are powerful generative models that allow for precise control over the characteristics of the generated samples. While these diffusion models trained on large datasets have achieved success, there is often a need to…

This paper introduces DiffCarl, a diffusion-modeled carbon- and risk-aware reinforcement learning algorithm for intelligent operation of multi-microgrid systems. With the growing integration of renewables and increasing system complexity,…

Machine Learning · Computer Science 2025-07-24 Yunyi Zhao , Wei Zhang , Cheng Xiang , Hongyang Du , Dusit Niyato , Shuhua Gao

Online Multi-Agent Reinforcement Learning (MARL) is a prominent framework for efficient agent coordination. Crucially, enhancing policy expressiveness is pivotal for achieving superior performance. Diffusion-based generative models are…

Artificial Intelligence · Computer Science 2026-02-23 Zhuoran Li , Hai Zhong , Xun Wang , Qingxin Xia , Lihua Zhang , Longbo Huang

Energy efficiency has become an integral aspect of modern computing infrastructure design, impacting the performance, cost, scalability, and durability of production systems. The incorporation of power actuation and sensing capabilities in…

Machine Learning · Computer Science 2026-01-19 Akhilesh Raj , Swann Perarnau , Aniruddha Gokhale , Solomon Bekele Abera

With the rapid advancements in wireless communication fields, including low-altitude economies, 6G, and Wi-Fi, the scale of wireless networks continues to expand, accompanied by increasing service quality demands. Traditional deep…

Networking and Internet Architecture · Computer Science 2024-10-21 Junjie Wu , Xuming Fang , Dusit Niyato , Jiacheng Wang , Jingyu Wang

Fog and Edge computing extend cloud services to the proximity of end users, allowing many Internet of Things (IoT) use cases, particularly latency-critical applications. Smart devices, such as traffic and surveillance cameras, often do not…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-10-16 Mohammad Goudarzi , Maria A. Rodriguez , Majid Sarvi , Rajkumar Buyya