English
Related papers

Related papers: Towards Accurate Guided Diffusion Sampling through…

200 papers

While text-to-video diffusion models have made significant strides, many still face challenges in generating videos with temporal consistency. Within diffusion frameworks, guidance techniques have proven effective in enhancing output…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Hyelin Nam , Jaemin Kim , Dohun Lee , Jong Chul Ye

Analyzing medical data to find abnormalities is a time-consuming and costly task, particularly for rare abnormalities, requiring tremendous efforts from medical experts. Artificial intelligence has become a popular tool for the automatic…

Diffusion models and flow-matching models have enabled generating diverse and realistic images by learning to transfer noise to data. However, sampling from these models involves iterative denoising over many neural network passes, making…

Machine Learning · Computer Science 2025-06-24 Kevin Frans , Danijar Hafner , Sergey Levine , Pieter Abbeel

We present SinDiffusion, leveraging denoising diffusion models to capture internal distribution of patches from a single natural image. SinDiffusion significantly improves the quality and diversity of generated samples compared with…

Computer Vision and Pattern Recognition · Computer Science 2022-11-23 Weilun Wang , Jianmin Bao , Wengang Zhou , Dongdong Chen , Dong Chen , Lu Yuan , Houqiang Li

Infrared and visible image fusion (IVIF) is essential for integrating thermal saliency with textural details to support downstream perception. However, most existing approaches suffer from "semantic blindness," leading to the erroneous…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Xiaoyang Zhang , jinjiang Li , Guodong Fan , Yakun Ju , Linwei Fan , Jun Liu , Alex C. Kot

Generative models (e.g., GANs, diffusion models) learn the underlying data distribution in an unsupervised manner. However, many applications of interest require sampling from a particular region of the output space or sampling evenly over…

Computer Vision and Pattern Recognition · Computer Science 2022-10-18 Chen Henry Wu , Saman Motamed , Shaunak Srivastava , Fernando De la Torre

Most existing CNN-based salient object detection methods can identify local segmentation details like hair and animal fur, but often misinterpret the real saliency due to the lack of global contextual information caused by the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-09 Bo Xu , Guanze Liu , Han Huang , Cheng Lu , Yandong Guo

Diffusion and flow-based generative models dominate visual synthesis, with guidance aligning samples to user input and improving perceptual quality. However, Classifier-Free Guidance (CFG) and extrapolation-based methods are heuristic…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Parsa Esmati , Junha Hyung , Amirhossein Dadashzadeh , Jaegul Choo , Majid Mirmehdi

Synthetic data generation is an important application of machine learning in the field of medical imaging. While existing approaches have successfully applied fine-tuned diffusion models for synthesizing medical images, we explore potential…

Computer Vision and Pattern Recognition · Computer Science 2024-10-04 Lakshmi Nair

Designing free-form photonic devices is fundamentally challenging due to the vast number of possible geometries and the complex requirements of fabrication constraints. Traditional inverse-design approaches--whether driven by human…

Optics · Physics 2025-04-25 Dongjin Seo , Soobin Um , Sangbin Lee , Jong Chul Ye , Haejun Chung

Generating images from graph-structured inputs, such as scene graphs, is uniquely challenging due to the difficulty of aligning nodes and connections in graphs with objects and their relations in images. Most existing methods address this…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Ling Yang , Zhilin Huang , Yang Song , Shenda Hong , Guohao Li , Wentao Zhang , Bin Cui , Bernard Ghanem , Ming-Hsuan Yang

We introduce a novel, training-free approach for enhancing alignment in Transformer-based Text-Guided Diffusion Models (TGDMs). Existing TGDMs often struggle to generate semantically aligned images, particularly when dealing with complex…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Shulei Wang , Wang Lin , Hai Huang , Hanting Wang , Sihang Cai , WenKang Han , Tao Jin , Jingyuan Chen , Jiacheng Sun , Jieming Zhu , Zhou Zhao

Classifier-Free Guidance (CFG) improves sample quality in diffusion models, but its dual-pass inference and reliance on null-condition training limit its use in few-step regimes. Attention-space guidance has emerged as a complementary…

Machine Learning · Computer Science 2026-05-19 Kwanyoung Kim

Recent advancements in generative AI have made text-guided image inpainting - adding, removing, or altering image regions using textual prompts - widely accessible. However, generating semantically correct photorealistic imagery, typically…

Computer Vision and Pattern Recognition · Computer Science 2025-08-05 Paschalis Giakoumoglou , Dimitrios Karageorgiou , Symeon Papadopoulos , Panagiotis C. Petrantonakis

We describe a novel learning-by-synthesis method for estimating gaze direction of an automated intelligent surveillance system. Recently, progress in learning-by-synthesis has proposed training models on synthetic images, which can…

Computer Vision and Pattern Recognition · Computer Science 2018-10-09 Tongtong Zhao , Yuxiao Yan , Jinjia Peng , Zetian Mi , Xianping Fu

Diffusion Probabilistic Methods are employed for state-of-the-art image generation. In this work, we present a method for extending such models for performing image segmentation. The method learns end-to-end, without relying on a…

Computer Vision and Pattern Recognition · Computer Science 2022-09-08 Tomer Amit , Tal Shaharbany , Eliya Nachmani , Lior Wolf

Deep learning-based food image classification enables precise identification of food categories, further facilitating accurate nutritional analysis. However, real-world food images often show a skewed distribution, with some food types…

Computer Vision and Pattern Recognition · Computer Science 2025-06-03 GaYeon Koh , Hyun-Jic Oh , Jeonghyun Noh , Won-Ki Jeong

Guidance techniques are commonly used in diffusion and flow models to improve image quality and input consistency for conditional generative tasks such as class-conditional and text-to-image generation. In particular, classifier-free…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Tariq Berrada Ifriqi , Adriana Romero-Soriano , Michal Drozdzal , Jakob Verbeek , Karteek Alahari

The advance of generative models for images has inspired various training techniques for image recognition utilizing synthetic images. In semantic segmentation, one promising approach is extracting pseudo-masks from attention maps in…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Ryota Yoshihashi , Yuya Otsuka , Kenji Doi , Tomohiro Tanaka , Hirokatsu Kataoka

In this paper, we propose a self-supervised visual representation learning approach which involves both generative and discriminative proxies, where we focus on the former part by requiring the target network to recover the original image…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Yunjie Tian , Lingxi Xie , Xiaopeng Zhang , Jiemin Fang , Haohang Xu , Wei Huang , Jianbin Jiao , Qi Tian , Qixiang Ye