English
Related papers

Related papers: Emergence of Distortions in High-Dimensional Guide…

200 papers

Feature selection is fundamental to robust data-centric AI, but most existing methods optimize predictive performance under a single data distribution. This often selects spurious features that fail under distribution shifts. Motivated by…

Machine Learning · Computer Science 2026-03-24 Arun Vignesh Malarkkan , Xinyuan Wang , Kunpeng Liu , Denghui Zhang , Yanjie Fu

Negative guidance -- explicitly suppressing unwanted attributes -- remains a fundamental challenge in diffusion models, particularly in few-step sampling regimes. While Classifier-Free Guidance (CFG) works well in standard settings, it…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Dar-Yen Chen , Hmrishav Bandyopadhyay , Kai Zou , Yi-Zhe Song

Negative Prompting (NP) is widely utilized in diffusion models, particularly in text-to-image applications, to prevent the generation of undesired features. In this paper, we show that conventional NP is limited by the assumption of a…

Computer Vision and Pattern Recognition · Computer Science 2025-06-12 Felix Koulischer , Johannes Deleu , Gabriel Raya , Thomas Demeester , Luca Ambrogioni

In this paper, we consider the conditional generation problem by guiding off-the-shelf unconditional diffusion models with differentiable loss functions in a plug-and-play fashion. While previous research has primarily focused on balancing…

Computer Vision and Pattern Recognition · Computer Science 2024-11-21 Youyuan Zhang , Zehua Liu , Zenan Li , Zhaoyu Li , James J. Clark , Xujie Si

Denoising diffusion models (DDMs) have attracted attention for their exceptional generation quality and diversity. This success is largely attributed to the use of class- or text-conditional diffusion guidance methods, such as classifier…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Susung Hong , Gyuseong Lee , Wooseok Jang , Seungryong Kim

Diffusion models, a powerful and universal generative AI technology, have achieved tremendous success in computer vision, audio, reinforcement learning, and computational biology. In these applications, diffusion models provide flexible…

Machine Learning · Computer Science 2024-04-12 Minshuo Chen , Song Mei , Jianqing Fan , Mengdi Wang

We introduce GUIDE, a novel continual learning approach that directs diffusion models to rehearse samples at risk of being forgotten. Existing generative strategies combat catastrophic forgetting by randomly sampling rehearsal examples from…

Machine Learning · Computer Science 2024-06-03 Bartosz Cywiński , Kamil Deja , Tomasz Trzciński , Bartłomiej Twardowski , Łukasz Kuciński

The design of diffusion-based audio generation systems has been investigated from diverse perspectives, such as data space, network architecture, and conditioning techniques, while most of these innovations require model re-training. In…

Sound · Computer Science 2026-04-10 Junyou Wang , Zehua Chen , Binjie Yuan , Kaiwen Zheng , Chang Li , Yuxuan Jiang , Jun Zhu

Generative models excel at synthesizing high-fidelity samples from complex data distributions, but they often violate hard constraints arising from physical laws or task specifications. A common remedy is to project intermediate samples…

Machine Learning · Computer Science 2025-09-30 Jinhao Liang , Yixuan Sun , Anirban Samaddar , Sandeep Madireddy , Ferdinando Fioretto

Practically, training diffusion models typically requires explicit time conditioning to guide the network through the denoising sampling process. Especially in deterministic methods like DDIM, the absence of time conditioning leads to…

Machine Learning · Computer Science 2026-04-29 Liuzhuozheng Li , Zhiyuan Zhan , Shuhong Liu , Dengyang Jiang , Zanyi Wang , Guang Dai , Jingdong Wang , Mengmeng Wang

Diffusion models excel in generating high-quality images. However, current diffusion models struggle to produce reliable images without guidance methods, such as classifier-free guidance (CFG). Are guidance methods truly necessary?…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Donghoon Ahn , Jiwon Kang , Sanghyun Lee , Jaewon Min , Minjae Kim , Wooseok Jang , Hyoungwon Cho , Sayak Paul , SeonHwa Kim , Eunju Cha , Kyong Hwan Jin , Seungryong Kim

Diffusion models have demonstrated superior performance across various generative tasks including images, videos, and audio. However, they encounter difficulties in directly generating high-resolution samples. Previously proposed solutions…

Computer Vision and Pattern Recognition · Computer Science 2024-04-03 Juno Hwang , Yong-Hyun Park , Junghyo Jo

3D Gaussian Splatting (3DGS) has shown convincing performance in rendering speed and fidelity, yet the generation of Gaussian Splatting remains a challenge due to its discreteness and unstructured nature. In this work, we propose DiffGS, a…

Computer Vision and Pattern Recognition · Computer Science 2024-10-31 Junsheng Zhou , Weiqi Zhang , Yu-Shen Liu

Guidance techniques are simple yet effective for improving conditional generation in diffusion models. Albeit their empirical success, the practical implementation of guidance diverges significantly from its theoretical motivation. In this…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Zhengqi Gao , Kaiwen Zha , Tianyuan Zhang , Zihui Xue , Duane S. Boning

Conditional diffusion models serve as the foundation of modern image synthesis and find extensive application in fields like computational biology and reinforcement learning. In these applications, conditional diffusion models incorporate…

Machine Learning · Computer Science 2024-03-19 Hengyu Fu , Zhuoran Yang , Mengdi Wang , Minshuo Chen

Diffusion Models have demonstrated remarkable performance in image generation. However, their demanding computational requirements for training have prompted ongoing efforts to enhance the quality of generated images through modifications…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Eleftherios Tsonis , Paraskevi Tzouveli , Athanasios Voulodimos

Masked generative models (MGMs) have shown impressive generative ability while providing an order of magnitude efficient sampling steps compared to continuous diffusion models. However, MGMs still underperform in image synthesis compared to…

Computer Vision and Pattern Recognition · Computer Science 2024-10-18 Jiwan Hur , Dong-Jae Lee , Gyojin Han , Jaehyun Choi , Yunho Jeon , Junmo Kim

Recent studies have demonstrated that diffusion models are capable of generating high-quality samples, but their quality heavily depends on sampling guidance techniques, such as classifier guidance (CG) and classifier-free guidance (CFG).…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Donghoon Ahn , Hyoungwon Cho , Jaewon Min , Wooseok Jang , Jungwoo Kim , SeonHwa Kim , Hyun Hee Park , Kyong Hwan Jin , Seungryong Kim

Adding additional control to pretrained diffusion models has become an increasingly popular research area, with extensive applications in computer vision, reinforcement learning, and AI for science. Recently, several studies have proposed…

Machine Learning · Computer Science 2024-05-30 Yifei Shen , Xinyang Jiang , Yezhen Wang , Yifan Yang , Dongqi Han , Dongsheng Li

Generative models have the potential to accelerate key steps in the discovery of novel molecular therapeutics and materials. Diffusion models have recently emerged as a powerful approach, excelling at unconditional sample generation and,…

Biomolecules · Quantitative Biology 2024-07-17 Leo Klarner , Tim G. J. Rudner , Garrett M. Morris , Charlotte M. Deane , Yee Whye Teh