English
Related papers

Related papers: SafeCFG: Controlling Harmful Features with Dynamic…

200 papers

Malware is a significant threat to the security of computer systems and networks which requires sophisticated techniques to analyze the behavior and functionality for detection. Traditional signature-based malware detection methods have…

Cryptography and Security · Computer Science 2023-06-22 Shaswata Mitra , Stephen A. Torri , Sudip Mittal

In recent years, significant progress has been made in the development of text-to-image generation models. However, these models still face limitations when it comes to achieving full controllability during the generation process. Often,…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Salaheldin Mohamed

Classifier-free guidance is a key component for enhancing the performance of conditional generative models across diverse tasks. While it has previously demonstrated remarkable improvements for the sample quality, it has only been…

Machine Learning · Computer Science 2023-12-11 Qinqing Zheng , Matt Le , Neta Shaul , Yaron Lipman , Aditya Grover , Ricky T. Q. Chen

Guided or controlled data generation with diffusion models\blfootnote{Partial preliminary results of this work appeared in International Conference on Machine Learning 2025 \citep{li2025provable}.} has become a cornerstone of modern…

Machine Learning · Statistics 2025-12-05 Yuchen Jiao , Yuxin Chen , Gen Li

Diffusion models (DMs) excel in photorealism, image editing, and solving inverse problems, aided by classifier-free guidance and image inversion techniques. However, rectified flow models (RFMs) remain underexplored for these tasks.…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Maitreya Patel , Song Wen , Dimitris N. Metaxas , Yezhou Yang

Generating high-dimensional visual modalities is a computationally intensive task. A common solution is progressive generation, where the outputs are synthesized in a coarse-to-fine spectral autoregressive manner. While diffusion models…

Computer Vision and Pattern Recognition · Computer Science 2025-06-25 Moayed Haji-Ali , Willi Menapace , Ivan Skorokhodov , Arpit Sahni , Sergey Tulyakov , Vicente Ordonez , Aliaksandr Siarohin

The rapid advancement of text-to-image (T2I) models, such as Stable Diffusion, has enhanced their capability to synthesize images from textual prompts. However, this progress also raises significant risks of misuse, including the generation…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Yu Xie , Chengjie Zeng , Lingyun Zhang , Yanwei Fu

Discrete diffusion models are a class of generative models that construct sequences by progressively denoising samples from a categorical noise distribution. Beyond their rapidly growing ability to generate coherent natural language, these…

Computation and Language · Computer Science 2025-12-11 Michael Cardei , Jacob K Christopher , Thomas Hartvigsen , Bhavya Kailkhura , Ferdinando Fioretto

Diffusion-based image generation models have advanced rapidly but pose a safety risk due to their potential to generate Not-Safe-For-Work (NSFW) content. Existing NSFW detection methods mainly operate either before or after image…

Computer Vision and Pattern Recognition · Computer Science 2026-04-10 Jinghan Yang , Yihe Fan , Xudong Pan , Min Yang

Training-free guided sampling in diffusion models leverages off-the-shelf pre-trained networks, such as an aesthetic evaluation model, to guide the generation process. Current training-free guided sampling algorithms obtain the guidance…

Computer Vision and Pattern Recognition · Computer Science 2023-12-20 Jiachun Pan , Hanshu Yan , Jun Hao Liew , Jiashi Feng , Vincent Y. F. Tan

Guidance in conditional diffusion generation is of great importance for sample quality and controllability. However, existing guidance schemes are to be desired. On one hand, mainstream methods such as classifier guidance and…

Machine Learning · Computer Science 2023-10-18 Jiajun Ma , Tianyang Hu , Wenjia Wang , Jiacheng Sun

Diffusion models have revolutionized video generation, becoming essential tools in creative content generation and physical simulation. Transformer-based architectures (DiTs) and classifier-free guidance (CFG) are two cornerstones of this…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Zhiye Song , Steve Dai , Ben Keller , Brucek Khailany

Denoising diffusion probabilistic models (DDPMs) are a recent family of generative models that achieve state-of-the-art results. In order to obtain class-conditional generation, it was suggested to guide the diffusion process by gradients…

Computer Vision and Pattern Recognition · Computer Science 2023-03-17 Bahjat Kawar , Roy Ganz , Michael Elad

Diffusion models have emerged as powerful generative models for graph generation, yet their use for conditional graph generation remains a fundamental challenge. In particular, guiding diffusion models on graphs under arbitrary reward…

Machine Learning · Computer Science 2025-05-27 Victor M. Tenorio , Nicolas Zilberstein , Santiago Segarra , Antonio G. Marques

Despite their remarkable image generation capabilities, text-to-image diffusion models inadvertently learn inappropriate concepts from vast and unfiltered training data, which leads to various ethical and business risks. Specifically,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Die Chen , Zhiwen Li , Mingyuan Fan , Cen Chen , Wenmeng Zhou , Yanhao Wang , Yaliang Li

Automatic image generation is no longer just of interest to researchers, but also to practitioners. However, current models are sensitive to the settings used and automatic optimization methods often require human involvement. To bridge…

Computer Vision and Pattern Recognition · Computer Science 2024-11-22 Dominik Sobania , Martin Briesch , Franz Rothlauf

This paper presents a sampled-data framework for the safe navigation of controlled agents in environments cluttered with obstacles governed by uncertain linear dynamics. Collision-free motion is achieved by combining Control Barrier…

Systems and Control · Electrical Eng. & Systems 2026-01-13 Hugo Matias , Daniel Silvestre

Denoising diffusion models (DDMs) have attracted attention for their exceptional generation quality and diversity. This success is largely attributed to the use of class- or text-conditional diffusion guidance methods, such as classifier…

Computer Vision and Pattern Recognition · Computer Science 2023-08-25 Susung Hong , Gyuseong Lee , Wooseok Jang , Seungryong Kim

Image generation models (IGMs), while capable of producing impressive and creative content, often memorize a wide range of undesirable concepts from their training data, leading to the reproduction of unsafe content such as NSFW imagery and…

Computer Vision and Pattern Recognition · Computer Science 2026-05-07 Renyang Liu , Kangjie Chen , Han Qiu , Jie Zhang , Kwok-Yan Lam , Tianwei Zhang , See-Kiong Ng

Despite recent advances in Text-to-Video (T2V) synthesis, generating high-fidelity and dynamic motion remains a significant challenge. Existing methods primarily rely on Classifier-Free Guidance (CFG), often with explicit negative prompts…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Byungjun Kim , Soobin Um , Jong Chul Ye