English
Related papers

Related papers: SafeCFG: Controlling Harmful Features with Dynamic…

200 papers

While Classifier-Free Guidance (CFG) has become standard for improving sample fidelity in conditional diffusion models, it can harm diversity and induce memorization by applying constant guidance regardless of whether a particular sample…

Computer Vision and Pattern Recognition · Computer Science 2025-10-10 Felix Koulischer , Florian Handke , Johannes Deleu , Thomas Demeester , Luca Ambrogioni

Diffusion models are known for generating high-quality images, causing serious security concerns. To combat this, most efforts rely on deep neural networks (e.g., CNNs and Transformers), while largely overlooking the potential of…

Computer Vision and Pattern Recognition · Computer Science 2026-04-16 Mengxin Fu , Yuezun Li

Generative models now produce images with such stunning realism that they can easily deceive the human eye. While this progress unlocks vast creative potential, it also presents significant risks, such as the spread of misinformation.…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Yichi Zhang , Xiaogang Xu

Classifier-free guidance (CFG) has become an essential component of modern diffusion models to enhance both generation quality and alignment with input conditions. However, CFG requires specific training procedures and is limited to…

Graphics · Computer Science 2025-11-06 Javad Rajabi , Soroush Mehraban , Seyedmorteza Sadat , Babak Taati

Negative guidance -- explicitly suppressing unwanted attributes -- remains a fundamental challenge in diffusion models, particularly in few-step sampling regimes. While Classifier-Free Guidance (CFG) works well in standard settings, it…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Dar-Yen Chen , Hmrishav Bandyopadhyay , Kai Zou , Yi-Zhe Song

Diffusion models for continuous data gained widespread adoption owing to their high quality generation and control mechanisms. However, controllable diffusion on discrete data faces challenges given that continuous guidance methods do not…

Camouflage Images Generation (CIG) is an emerging research area that focuses on synthesizing images in which objects are harmoniously blended and exhibit high visual consistency with their surroundings. Existing methods perform CIG by…

Computer Vision and Pattern Recognition · Computer Science 2025-11-26 Yuhang Qian , Haiyan Chen , Wentong Li , Ningzhong Liu , Jie Qin

Proper guidance strategies are essential to achieve high-quality generation results without retraining diffusion and flow-based text-to-image models. Existing guidance either requires specific training or strong inductive biases of…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Tiancheng Li , Weijian Luo , Zhiyang Chen , Liyuan Ma , Guo-Jun Qi

We introduce Value Sign Flip (VSF), a simple and efficient method for incorporating negative prompt guidance in few-step diffusion and flow-matching image generation models. Unlike existing approaches such as classifier-free guidance (CFG),…

Computer Vision and Pattern Recognition · Computer Science 2026-02-20 Wenqi Guo , Shan Du

Classifier-free guidance (CFG) is widely used in diffusion models but often introduces over-contrast and over-saturation artifacts at higher guidance strengths. We present EP-CFG (Energy-Preserving Classifier-Free Guidance), which addresses…

Computer Vision and Pattern Recognition · Computer Science 2024-12-16 Kai Zhang , Fujun Luan , Sai Bi , Jianming Zhang

In diffusion and flow-matching generative models, guidance techniques are widely used to improve sample quality and consistency. Classifier-free guidance (CFG) is the de facto choice in modern systems and achieves this by contrasting…

Computer Vision and Pattern Recognition · Computer Science 2025-12-22 Ankit Yadav , Ta Duc Huy , Lingqiao Liu

Diffusion and flow-based generative models dominate visual synthesis, with guidance aligning samples to user input and improving perceptual quality. However, Classifier-Free Guidance (CFG) and extrapolation-based methods are heuristic…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Parsa Esmati , Junha Hyung , Amirhossein Dadashzadeh , Jaegul Choo , Majid Mirmehdi

Current sampling mechanisms for conditional diffusion models rely mainly on Classifier Free Guidance (CFG) to generate high-quality images. However, CFG requires several denoising passes in each time step, e.g., up to three passes in image…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Mehdi Noroozi , Alberto Gil Ramos , Luca Morreale , Ruchika Chavhan , Malcolm Chadwick , Abhinav Mehrotra , Sourav Bhattacharya

With advances in diffusion models, image generation has shown significant performance improvements. This raises concerns about the potential abuse of image generation, such as the creation of explicit or violent images, commonly referred to…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Junha Park , Jaehui Hwang , Ian Ryu , Hyungkeun Park , Jiyoon Kim , Jong-Seok Lee

Diffusion-based editing models have emerged as a powerful tool for semantic image and video manipulation. However, existing models lack a mechanism for smoothly controlling the intensity of text-guided edits. In standard text-conditioned…

Computer Vision and Pattern Recognition · Computer Science 2026-02-04 Alon Wolf , Chen Katzir , Kfir Aberman , Or Patashnik

Image generation can solve insufficient labeled data issues in defect detection. Most defect generation methods are only trained on a single product without considering the consistencies among multiple products, leading to poor quality and…

Computer Vision and Pattern Recognition · Computer Science 2024-08-02 Qingfeng Shi , Jing Wei , Fei Shen , Zhengtao Zhang

Score-based generative models (SBM), also known as diffusion models, are the de facto state of the art for image synthesis. Despite their unparalleled performance, SBMs have recently been in the spotlight for being tricked into creating…

Computer Vision and Pattern Recognition · Computer Science 2025-05-15 Camilo Carvajal Reyes , Joaquín Fontbona , Felipe Tobar

Classifier free guidance is a standard method for conditional sampling in diffusion models, but its sampling rule is not aligned with the objective used in training. This mismatch induces a structural sampling error through the interaction…

Machine Learning · Computer Science 2026-05-27 Nakgyu Yang , Yechan Lee , SooJean Han

Generating stylistic text with specific attributes is a key problem in controllable text generation. Recently, diffusion models have emerged as a powerful paradigm for both visual and textual generation. Existing approaches can be broadly…

Computation and Language · Computer Science 2025-10-09 Fan Zhou , Chang Tian , Tim Van de Cruys

Classifier-free guidance (CFG) has become the standard method for enhancing the quality of conditional diffusion models. However, employing CFG requires either training an unconditional model alongside the main diffusion model or modifying…

Machine Learning · Computer Science 2025-06-04 Seyedmorteza Sadat , Manuel Kansy , Otmar Hilliges , Romann M. Weber