English
Related papers

Related papers: Geometry-Aware Attention Guidance for Diffusion Mo…

200 papers

Generative models have recently undergone significant advancement due to the diffusion models. The success of these models can be often attributed to their use of guidance techniques, such as classifier or classifier-free guidance, which…

Computer Vision and Pattern Recognition · Computer Science 2023-01-31 Gyeongnyeon Kim , Wooseok Jang , Gyuseong Lee , Susung Hong , Junyoung Seo , Seungryong Kim

Iterative refinement methods based on a denoising-inversion cycle are powerful tools for enhancing the quality and control of diffusion models. However, their effectiveness is critically limited when combined with standard Classifier-Free…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Haosen Li , Wenshuo Chen , Shaofeng Liang , Lei Wang , Haozhe Jia , Yutao Yue

Diffusion models have shown impressive results in generating high-quality conditional samples using guidance techniques such as Classifier-Free Guidance (CFG). However, existing methods often require additional training or neural function…

Machine Learning · Computer Science 2025-07-22 Kwanyoung Kim , Byeongsu Sim

Extracting geometry features from photographic images independently of surface texture and transferring them onto different materials remains a complex challenge. In this study, we introduce Harmonizing Attention, a novel training-free…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Eito Ikuta , Yohan Lee , Akihiro Iohara , Yu Saito , Toshiyuki Tanaka

Constructing high-resolution 3D geological models from sparse 1D borehole and 2D surface data is a highly ill-posed inverse problem. Traditional heuristic and implicit modeling methods fundamentally fail to capture non-linear topological…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Zhixiang Lu , Mengqi Han , Peixin Guo , Tianming Bai , Jionglong Su , Fei Fang , Sifan Song

Recent advancements have explored text-to-image diffusion models for synthesizing out-of-distribution (OOD) samples, substantially enhancing the performance of OOD detection. However, existing approaches typically rely on perturbing…

Computer Vision and Pattern Recognition · Computer Science 2025-10-28 Xin Gao , Jiyao Liu , Guanghao Li , Yueming Lyu , Jianxiong Gao , Weichen Yu , Ningsheng Xu , Liang Wang , Caifeng Shan , Ziwei Liu , Chenyang Si

Proper guidance strategies are essential to achieve high-quality generation results without retraining diffusion and flow-based text-to-image models. Existing guidance either requires specific training or strong inductive biases of…

Computer Vision and Pattern Recognition · Computer Science 2025-09-29 Tiancheng Li , Weijian Luo , Zhiyang Chen , Liyuan Ma , Guo-Jun Qi

Diffusion models have emerged as powerful generative models for graph generation, yet their use for conditional graph generation remains a fundamental challenge. In particular, guiding diffusion models on graphs under arbitrary reward…

Machine Learning · Computer Science 2025-05-27 Victor M. Tenorio , Nicolas Zilberstein , Santiago Segarra , Antonio G. Marques

Classifier-free guidance (CFG) is a core technique powering state-of-the-art image generation systems, yet its underlying mechanisms remain poorly understood. In this work, we begin by analyzing CFG in a simplified linear diffusion model,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-12 Xiang Li , Rongrong Wang , Qing Qu

In this paper, we propose Tortoise and Hare Guidance (THG), a training-free strategy that accelerates diffusion sampling while maintaining high-fidelity generation. We demonstrate that the noise estimate and the additional guidance term…

Computer Vision and Pattern Recognition · Computer Science 2025-11-07 Yunghee Lee , Byeonghyun Pak , Junwha Hong , Hoseong Kim

Diffusion models often exhibit inconsistent sample quality due to stochastic variations inherent in their sampling trajectories. Although training-based fine-tuning (e.g. DDPO [1]) and inference-time alignment techniques[2] aim to improve…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Sixian Wang , Zhiwei Tang , Tsung-Hui Chang

Personalizing text-to-image diffusion models is crucial for adapting the pre-trained models to specific target concepts, enabling diverse image generation. However, fine-tuning with few images introduces an inherent trade-off between…

Computer Vision and Pattern Recognition · Computer Science 2025-08-04 Sunghyun Park , Seokeon Choi , Hyoungwoo Park , Sungrack Yun

Given an unconditional diffusion model and a predictor for a target property of interest (e.g., a classifier), the goal of training-free guidance is to generate samples with desirable target properties without additional training. Existing…

Machine Learning · Computer Science 2024-11-20 Haotian Ye , Haowei Lin , Jiaqi Han , Minkai Xu , Sheng Liu , Yitao Liang , Jianzhu Ma , James Zou , Stefano Ermon

Score-based generative models require guidance in order to generate plausible, on-manifold samples. The most popular guidance method, Classifier-Free Guidance (CFG), is only applicable in settings with labeled data and requires training an…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Eric Yeats , Darryl Hannan , Wilson Fearn , Timothy Doster , Henry Kvinge , Scott Mahan

3D style transfer enables the creation of visually expressive 3D content, enriching the visual appearance of 3D scenes and objects. However, existing VGG- and CLIP-based methods struggle to model multi-view consistency within the model…

Computer Vision and Pattern Recognition · Computer Science 2026-01-28 Yitong Yang , Xuexin Liu , Yinglin Wang , Jing Wang , Hao Dou , Changshuo Wang , Shuting He

Recent diffusion-based generators can produce high-quality images from textual prompts. However, they often disregard textual instructions that specify the spatial layout of the composition. We propose a simple approach that achieves robust…

Computer Vision and Pattern Recognition · Computer Science 2023-11-30 Minghao Chen , Iro Laina , Andrea Vedaldi

Electrocardiogram (ECG) analysis plays a crucial role in diagnosing cardiovascular diseases, but accurate interpretation of these complex signals remains challenging. This paper introduces a novel multimodal framework(GAF-FusionNet) for ECG…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Jiahao Qin , Feng Liu

Classifier-free guidance (CFG) is a fundamental tool in modern diffusion models for text-guided generation. Although effective, CFG has notable drawbacks. For instance, DDIM with CFG lacks invertibility, complicating image editing;…

Computer Vision and Pattern Recognition · Computer Science 2024-09-13 Hyungjin Chung , Jeongsol Kim , Geon Yeong Park , Hyelin Nam , Jong Chul Ye

We study masked discrete diffusion models with classifier-free guidance (CFG). Assuming no score error nor discretization error, we derive an explicit solution to the guided reverse dynamics, so that how guidance influences the sampling…

Machine Learning · Statistics 2025-06-13 He Ye , Rojas Kevin , Tao Molei

Given an unconditional generative model and a predictor for a target property (e.g., a classifier), the goal of training-free guidance is to generate samples with desirable target properties without additional training. As a highly…

Machine Learning · Computer Science 2025-03-19 Haowei Lin , Shanda Li , Haotian Ye , Yiming Yang , Stefano Ermon , Yitao Liang , Jianzhu Ma