English
Related papers

Related papers: Perceptual Similarity guidance and text guidance o…

200 papers

The success of image generative models has enabled us to build methods that can edit images based on text or other user input. However, these methods are bespoke, imprecise, require additional information, or are limited to only 2D image…

Computer Vision and Pattern Recognition · Computer Science 2025-01-03 Rahul Sajnani , Jeroen Vanbaar , Jie Min , Kapil Katyal , Srinath Sridhar

Recent works on diffusion models have demonstrated a strong capability for conditioning image generation, e.g., text-guided image synthesis. Such success inspires many efforts trying to use large-scale pre-trained diffusion models for…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Zhixing Zhang , Ligong Han , Arnab Ghosh , Dimitris Metaxas , Jian Ren

In this paper, we introduce the problem of zero-shot text-guided exploration of the solutions to open-domain image super-resolution. Our goal is to allow users to explore diverse, semantically accurate reconstructions that preserve data…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Kanchana Vaishnavi Gandikota , Paramanand Chandramouli

While 2D diffusion models have achieved remarkable success in identity-preserving personalization, extending this capability to 3D assets remains a significant challenge due to the complexities of multi-view consistency and spatial control.…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Jinxin Ai , Matthias Nießner , Ziya Erkoç

Image generation and editing have seen a great deal of advancements with the rise of large-scale diffusion models that allow user control of different modalities such as text, mask, depth maps, etc. However, controlled editing of videos…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 AmirHossein Zamani , Amir G. Aghdam , Tiberiu Popa , Eugene Belilovsky

We propose a method for generating spurious features by leveraging large-scale text-to-image diffusion models. Although the previous work detects spurious features in a large-scale dataset like ImageNet and introduces Spurious ImageNet, we…

Computer Vision and Pattern Recognition · Computer Science 2024-02-14 AprilPyone MaungMaung , Huy H. Nguyen , Hitoshi Kiya , Isao Echizen

Recent advancements in diffusion models have significantly impacted the trajectory of generative machine learning research, with many adopting the strategy of fine-tuning pre-trained models using domain-specific text-to-image datasets.…

Computer Vision and Pattern Recognition · Computer Science 2023-12-21 Mischa Dombrowski , Hadrien Reynaud , Johanna P. Müller , Matthew Baugh , Bernhard Kainz

Diffusion models have the ability to generate high quality images by denoising pure Gaussian noise images. While previous research has primarily focused on improving the control of image generation through adjusting the denoising process,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Jiafeng Mao , Xueting Wang , Kiyoharu Aizawa

Diffusion models have shown great promise in text-guided image style transfer, but there is a trade-off between style transformation and content preservation due to their stochastic nature. Existing methods require computationally expensive…

Computer Vision and Pattern Recognition · Computer Science 2023-04-13 Serin Yang , Hyunmin Hwang , Jong Chul Ye

Rectified Flow text-to-image models surpass diffusion models in image quality and text alignment, but adapting ReFlow for real-image editing remains challenging. We propose a new real-image editing method for ReFlow by analyzing the…

Computer Vision and Pattern Recognition · Computer Science 2025-07-03 Jimyeong Kim , Jungwon Park , Yeji Song , Nojun Kwak , Wonjong Rhee

We present a diffusion-based image morphing approach with perceptually-uniform sampling (IMPUS) that produces smooth, direct and realistic interpolations given an image pair. The embeddings of two images may lie on distinct conditioned…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Zhaoyuan Yang , Zhengyang Yu , Zhiwei Xu , Jaskirat Singh , Jing Zhang , Dylan Campbell , Peter Tu , Richard Hartley

Recent methods in flow-based diffusion editing have enabled direct transformations between source and target image distribution without explicit inversion. However, the latent trajectories in these methods often exhibit accumulated velocity…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Zixiang Li , Yue Song , Jianing Peng , Ting Liu , Jun Huang , Xiaochao Qu , Luoqi Liu , Wei Wang , Yao Zhao , Yunchao Wei

Latent diffusion models excel at producing high-quality images from text. Yet, concerns appear about the lack of diversity in the generated imagery. To tackle this, we introduce Diverse Diffusion, a method for boosting image diversity…

Computer Vision and Pattern Recognition · Computer Science 2023-10-20 Mariia Zameshina , Olivier Teytaud , Laurent Najman

Based on recent advanced diffusion models, Text-to-image (T2I) generation models have demonstrated their capabilities to generate diverse and high-quality images. However, leveraging their potential for real-world content creation,…

Computer Vision and Pattern Recognition · Computer Science 2025-05-08 Sandra Zhang Ding , Jiafeng Mao , Kiyoharu Aizawa

Despite significant advancements in customizing text-to-image and video generation models, generating images and videos that effectively integrate multiple personalized concepts remains a challenging task. To address this, we present…

Computer Vision and Pattern Recognition · Computer Science 2025-03-05 Gihyun Kwon , Jong Chul Ye

Diffusion models have demonstrated remarkable progress in image generation quality, especially when guidance is used to control the generative process. However, guidance requires a large amount of image-annotation pairs for training and is…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Vincent Tao Hu , David W Zhang , Yuki M. Asano , Gertjan J. Burghouts , Cees G. M. Snoek

Text-to-image diffusion models produce impressive results but are frustrating tools for artists who desire fine-grained control. For example, a common use case is to create images of a specific instance in novel contexts, i.e.,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-28 Shengqu Cai , Eric Chan , Yunzhi Zhang , Leonidas Guibas , Jiajun Wu , Gordon Wetzstein

Diffusion generative models have recently greatly improved the power of text-conditioned image generation. Existing image generation models mainly include text conditional diffusion model and cross-modal guided diffusion model, which are…

Computer Vision and Pattern Recognition · Computer Science 2022-11-04 Wei Li , Xue Xu , Xinyan Xiao , Jiachen Liu , Hu Yang , Guohao Li , Zhanpeng Wang , Zhifan Feng , Qiaoqiao She , Yajuan Lyu , Hua Wu

Text-to-image diffusion models often make implicit assumptions about the world when generating images. While some assumptions are useful (e.g., the sky is blue), they can also be outdated, incorrect, or reflective of social biases present…

Computer Vision and Pattern Recognition · Computer Science 2023-08-28 Hadas Orgad , Bahjat Kawar , Yonatan Belinkov

Existing fusion methods are tailored for high-quality images but struggle with degraded images captured under harsh circumstances, thus limiting the practical potential of image fusion. This work presents a \textbf{D}egradation and…

Computer Vision and Pattern Recognition · Computer Science 2025-04-01 Linfeng Tang , Chunyu Li , Guoqing Wang , Yixuan Yuan , Jiayi Ma