English
Related papers

Related papers: History-Guided Video Diffusion

200 papers

Classifier-Free Guidance (CFG) enhances the quality and condition adherence of text-to-image diffusion models. It operates by combining the conditional and unconditional predictions using a fixed weight. However, recent works vary the…

Computer Vision and Pattern Recognition · Computer Science 2025-01-23 Xi Wang , Nicolas Dufour , Nefeli Andreou , Marie-Paule Cani , Victoria Fernandez Abrevaya , David Picard , Vicky Kalogeiton

The diffusion model presents a powerful ability to capture the entire (conditional) data distribution. However, due to the lack of sufficient training and data to learn to cover low-probability areas, the model will be penalized for failing…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Xingyu Zhou , Qifan Li , Xiaobin Hu , Hai Chen , Shuhang Gu

Classifier-free guidance (CFG) is widely used in diffusion models but often introduces over-contrast and over-saturation artifacts at higher guidance strengths. We present EP-CFG (Energy-Preserving Classifier-Free Guidance), which addresses…

Computer Vision and Pattern Recognition · Computer Science 2024-12-16 Kai Zhang , Fujun Luan , Sai Bi , Jianming Zhang

Classifier-free guidance (CFG) has emerged as a pivotal advancement in text-to-image latent diffusion models, establishing itself as a cornerstone technique for achieving high-quality image synthesis. However, under high guidance weights,…

Machine Learning · Computer Science 2025-06-26 Cheng Jin , Zhenyu Xiao , Chutao Liu , Yuantao Gu

Various weather modelling problems (e.g., weather forecasting, optimizing turbine placements, etc.) require ample access to high-resolution, highly accurate wind data. Acquiring such high-resolution wind data, however, remains a challenging…

Machine Learning · Computer Science 2025-12-17 Jacob Schnell , Aditya Makkar , Gunadi Gani , Aniket Srinivasan Ashok , Darren Lo , Mike Optis , Alexander Wong , Yuhao Chen

Recent advances in diffusion-based generative models have shown incredible promise for zero shot image-to-image translation and editing. Most of these approaches work by combining or replacing network-specific features used in the…

Computer Vision and Pattern Recognition · Computer Science 2025-10-06 Zeqi Gu , Ethan Yang , Abe Davis

Image generation using diffusion models have demonstrated outstanding learning capabilities, effectively capturing the full distribution of the training dataset. They are known to generate wide variations in sampled images, albeit with a…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Rahul Shenoy , Zhihong Pan , Kaushik Balakrishnan , Qisen Cheng , Yongmoon Jeon , Heejune Yang , Jaewon Kim

Diffusion models have emerged as a powerful tool for generating high-quality images, videos, and 3D content. While sampling guidance techniques like CFG improve quality, they reduce diversity and motion. Autoguidance mitigates these issues…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Junha Hyung , Kinam Kim , Susung Hong , Min-Jung Kim , Jaegul Choo

Classifier-free guidance is a key component for enhancing the performance of conditional generative models across diverse tasks. While it has previously demonstrated remarkable improvements for the sample quality, it has only been…

Machine Learning · Computer Science 2023-12-11 Qinqing Zheng , Matt Le , Neta Shaul , Yaron Lipman , Aditya Grover , Ricky T. Q. Chen

Video generation primarily aims to model authentic and customized motion across frames, making understanding and controlling the motion a crucial topic. Most diffusion-based studies on video motion focus on motion customization with…

Computer Vision and Pattern Recognition · Computer Science 2024-11-13 Zeqi Xiao , Yifan Zhou , Shuai Yang , Xingang Pan

Classifier-free guidance (CFG) is the de facto standard for conditional sampling in diffusion models, yet it often reduces sample diversity. Using tools from statistical physics, we analyze the emergence of generative distortions induced by…

Machine Learning · Statistics 2026-05-11 Enrico Ventura , Beatrice Achilli , Luca Ambrogioni , Carlo Lucibello

Classifier guidance is a recently introduced method to trade off mode coverage and sample fidelity in conditional diffusion models post training, in the same spirit as low temperature sampling or truncation in other types of generative…

Machine Learning · Computer Science 2022-07-27 Jonathan Ho , Tim Salimans

Classifier-free guidance (CFG) is a widely used technique for controllable generation in diffusion and flow-based models. Despite its empirical success, CFG relies on a heuristic linear extrapolation that is often sensitive to the guidance…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Jian-Feng Cai , Haixia Liu , Zhengyi Su , Chao Wang

Diffusion and flow-based generative models dominate visual synthesis, with guidance aligning samples to user input and improving perceptual quality. However, Classifier-Free Guidance (CFG) and extrapolation-based methods are heuristic…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Parsa Esmati , Junha Hyung , Amirhossein Dadashzadeh , Jaegul Choo , Majid Mirmehdi

Guidance techniques are commonly used in diffusion and flow models to improve image quality and input consistency for conditional generative tasks such as class-conditional and text-to-image generation. In particular, classifier-free…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Tariq Berrada Ifriqi , Adriana Romero-Soriano , Michal Drozdzal , Jakob Verbeek , Karteek Alahari

Guided or controlled data generation with diffusion models\blfootnote{Partial preliminary results of this work appeared in International Conference on Machine Learning 2025 \citep{li2025provable}.} has become a cornerstone of modern…

Machine Learning · Statistics 2025-12-05 Yuchen Jiao , Yuxin Chen , Gen Li

Classifier-Free Guidance (CFG) has recently emerged in text-to-image generation as a lightweight technique to encourage prompt-adherence in generations. In this work, we demonstrate that CFG can be used broadly as an inference-time…

Computation and Language · Computer Science 2023-07-03 Guillaume Sanchez , Honglu Fan , Alexander Spangher , Elad Levi , Pawan Sasanka Ammanamanchi , Stella Biderman

Classifier-free guidance (CFG) is crucial for improving both generation quality and alignment between the input condition and final output in diffusion models. While a high guidance scale is generally required to enhance these aspects, it…

Machine Learning · Computer Science 2025-06-04 Seyedmorteza Sadat , Otmar Hilliges , Romann M. Weber

The primary axes of interest in image-generating diffusion models are image quality, the amount of variation in the results, and how well the results align with a given condition, e.g., a class label or a text prompt. The popular…

Computer Vision and Pattern Recognition · Computer Science 2024-12-20 Tero Karras , Miika Aittala , Tuomas Kynkäänniemi , Jaakko Lehtinen , Timo Aila , Samuli Laine

Denoising diffusion models excel at generating high-quality images conditioned on text prompts, yet their effectiveness heavily relies on careful guidance during the sampling process. Classifier-Free Guidance (CFG) provides a widely used…

Graphics · Computer Science 2026-03-04 Shai Yehezkel , Omer Dahary , Andrey Voynov , Daniel Cohen-Or