English
Related papers

Related papers: Advantage-Guided Diffusion for Model-Based Reinfor…

200 papers

Unrestricted adversarial attacks present a serious threat to deep learning models and adversarial defense techniques. They pose severe security problems for deep learning applications because they can effectively bypass defense mechanisms.…

Machine Learning · Computer Science 2024-07-16 Xuelong Dai , Kaisheng Liang , Bin Xiao

While time series diffusion models have received considerable focus from many recent works, the performance of existing models remains highly unstable. Factors limiting time series diffusion models include insufficient time series datasets…

Machine Learning · Computer Science 2024-10-25 Jingwei Liu , Ling Yang , Hongyan Li , Shenda Hong

Recent advances in one-step text-to-image generation have enabled real-time synthesis with remarkable efficiency and quality. Previous reinforcement learning methods for one-step generators combine image-space reward optimization with…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Junyi Wu , Weijian Luo , Haoyang Zheng , Ruizhe Zhang , Guang Lin

Adding additional control to pretrained diffusion models has become an increasingly popular research area, with extensive applications in computer vision, reinforcement learning, and AI for science. Recently, several studies have proposed…

Machine Learning · Computer Science 2024-05-30 Yifei Shen , Xinyang Jiang , Yezhen Wang , Yifan Yang , Dongqi Han , Dongsheng Li

Guidance serves as a key concept in diffusion models, yet its effectiveness is often limited by the need for extra data annotation or classifier pretraining. That is why guidance was harnessed from self-supervised learning backbones, like…

Computer Vision and Pattern Recognition · Computer Science 2023-12-15 Vincent Tao Hu , Yunlu Chen , Mathilde Caron , Yuki M. Asano , Cees G. M. Snoek , Bjorn Ommer

Diffusion recommender systems achieve strong recommendation accuracy but often suffer from popularity bias, resulting in unequal item exposure. To address this shortcoming, we introduce A2G-DiffRec, a diffusion recommender that incorporates…

Information Retrieval · Computer Science 2026-04-27 Zihan Li , Gustavo Escobedo , Marta Moscati , Oleg Lesota , Markus Schedl

Pre-trained diffusion models have enabled significant advancements in All-in-One Restoration (AiOR), offering improved perceptual quality and generalization. However, diffusion-based restoration methods primarily rely on fine-tuning or…

Computer Vision and Pattern Recognition · Computer Science 2026-04-07 Sudarshan Rajagopalan , Vishal M. Patel

Autoregressive video models are promising for world modeling via next-frame prediction, but they suffer from exposure bias: a mismatch between training on clean contexts and inference on self-generated frames, causing errors to compound and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Ryan Po , Eric Ryan Chan , Changan Chen , Gordon Wetzstein

Recent advances in reinforcement learning (RL) have achieved great successes by leveraging the multimodality and exploration capability of diffusion policies. Among these approaches, one representative branch focuses on the sampling-based…

Robotics · Computer Science 2026-05-29 Shutong Ding , Zejia Zhong , Zhongyi Wang , Ke Hu , Bikang Pan , Jingya Wang , Ye Shi

Training-free guided sampling in diffusion models leverages off-the-shelf pre-trained networks, such as an aesthetic evaluation model, to guide the generation process. Current training-free guided sampling algorithms obtain the guidance…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Jiachun Pan , Hanshu Yan , Jun Hao Liew , Jiashi Feng , Vincent Y. F. Tan

Reinforcement Learning (RL)-based motion planning has recently shown the potential to outperform traditional approaches from autonomous navigation to robot manipulation. In this work, we focus on a motion planning task for an evasive target…

Robotics · Computer Science 2025-05-12 Zixuan Wu , Sean Ye , Manisha Natarajan , Matthew C. Gombolay

This paper proposes a novel inverse reinforcement learning framework using a diffusion-based adaptive lookahead planner (IRL-DAL) for autonomous vehicles. Training begins with imitation from an expert finite state machine (FSM) controller…

Robotics · Computer Science 2026-02-02 Seyed Ahmad Hosseini Miangoleh , Amin Jalal Aghdasian , Farzaneh Abdollahi

Decision-making stands as a pivotal component in the realm of autonomous vehicles (AVs), playing a crucial role in navigating the intricacies of autonomous driving. Amidst the evolving landscape of data-driven methodologies, enhancing…

Robotics · Computer Science 2024-04-08 Jiaqi Liu , Peng Hang , Xiaocong Zhao , Jianqiang Wang , Jian Sun

Negative guidance -- explicitly suppressing unwanted attributes -- remains a fundamental challenge in diffusion models, particularly in few-step sampling regimes. While Classifier-Free Guidance (CFG) works well in standard settings, it…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Dar-Yen Chen , Hmrishav Bandyopadhyay , Kai Zou , Yi-Zhe Song

Reward Feedback Learning (ReFL) has recently shown great potential in aligning model outputs with human preferences across various generative tasks. In this work, we introduce a ReFL framework, named DiffusionReward, to the Blind Face…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Bin Wu , Wei Wang , Yahui Liu , Zixiang Li , Yao Zhao

Masked auto-regressive diffusion models (MAR) benefit from the expressive modeling ability of diffusion models and the flexibility of masked auto-regressive ordering. However, vanilla MAR suffers from slow inference due to its hierarchical…

Machine Learning · Computer Science 2026-03-18 Yuxuan Gu , Weimin Bai , Yifei Wang , Weijian Luo , He Sun

Model-free reinforcement learning has emerged as a powerful method for developing robust robot control policies capable of navigating through complex and unstructured terrains. The effectiveness of these methods hinges on two essential…

Robotics · Computer Science 2024-10-15 Youwei Yu , Junhong Xu , Lantao Liu

Diffusion Models (DMs), as a leading class of generative models, offer key advantages for reinforcement learning (RL), including multi-modal expressiveness, stable training, and trajectory-level planning. This survey delivers a…

Machine Learning · Computer Science 2025-10-15 Changfu Xu , Jianxiong Guo , Yuzhu Liang , Haiyang Huang , Haodong Zou , Xi Zheng , Shui Yu , Xiaowen Chu , Jiannong Cao , Tian Wang

Recently, diffusion probabilistic models have attracted attention in generative time series forecasting due to their remarkable capacity to generate high-fidelity samples. However, the effective utilization of their strong modeling ability…

Machine Learning · Computer Science 2024-03-19 Xinyao Fan , Yueying Wu , Chang Xu , Yuhao Huang , Weiqing Liu , Jiang Bian

Diffusion models have achieved remarkable success in sequential decision-making by leveraging the highly expressive model capabilities in policy learning. A central problem for learning diffusion policies is to align the policy output with…

Machine Learning · Computer Science 2024-12-17 Zhao Shan , Chenyou Fan , Shuang Qiu , Jiyuan Shi , Chenjia Bai