English
Related papers

Related papers: Blind Inverse Problem Solving Made Easy by Text-to…

200 papers

An unbiased method for improving the resolution of astronomical images is presented. The strategy at the core of this method is to establish a linear transformation between the recorded image and an improved image at some desirable…

Astrophysics · Physics 2016-08-30 F. P. Pijpers

In the field of image editing, Null-text Inversion (NTI) enables fine-grained editing while preserving the structure of the original image by optimizing null embeddings during the DDIM sampling process. However, the NTI process is…

Computer Vision and Pattern Recognition · Computer Science 2024-01-19 Gwanhyeong Koo , Sunjae Yoon , Chang D. Yoo

With the help of conditioning mechanisms, the state-of-the-art diffusion models have achieved tremendous success in guided image generation, particularly in text-to-image synthesis. To gain a better understanding of the training process and…

Cryptography and Security · Computer Science 2023-10-24 Shengfang Zhai , Yinpeng Dong , Qingni Shen , Shi Pu , Yuejian Fang , Hang Su

Diffusion models have been widely utilized for image restoration. However, previous blind image restoration methods still need to assume the type of degradation model while leaving the parameters to be optimized, limiting their real-world…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Siwei Tu , Weidong Yang , Ben Fei

Diffusion inversion is a task of recovering the noise of an image in a diffusion model, which is vital for controllable diffusion image editing. At present, diffusion inversion still remains a challenging task due to the lack of viable…

Computer Vision and Pattern Recognition · Computer Science 2026-01-06 Ziyue Zhang , Luxi Lin , Xiaolin Hu , Chao Chang , HuaiXi Wang , Yiyi Zhou , Rongrong Ji

Image editing approaches with diffusion models have been rapidly developed, yet their applicability are subject to requirements such as specific editing types (e.g., foreground or background object editing, style transfer), multiple…

Computer Vision and Pattern Recognition · Computer Science 2023-12-12 Yuming Qiao , Fanyi Wang , Jingwen Su , Yanhao Zhang , Yunjie Yu , Siyu Wu , Guo-Jun Qi

Recovering textures under shadows has remained a challenging problem due to the difficulty of inferring shadow-free scenes from shadow images. In this paper, we propose the use of diffusion models as they offer a promising approach to…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Kangfu Mei , Luis Figueroa , Zhe Lin , Zhihong Ding , Scott Cohen , Vishal M. Patel

Recently, diffusion model-based inverse problem solvers (DIS) have emerged as state-of-the-art approaches for addressing inverse problems, including image super-resolution, deblurring, inpainting, etc. However, their application to video…

Computer Vision and Pattern Recognition · Computer Science 2025-02-28 Taesung Kwon , Jong Chul Ye

Diffusion models have emerged as a dominant paradigm for generative modeling across a wide range of domains, including prompt-conditional generation. The vast majority of samplers, however, rely on forward discretization of the reverse…

Computer Vision and Pattern Recognition · Computer Science 2025-12-01 Zhenghan Fang , Jian Zheng , Qiaozi Gao , Xiaofeng Gao , Jeremias Sulam

Recently it has been shown that using diffusion models for inverse problems can lead to remarkable results. However, these approaches require a closed-form expression of the degradation model and can not support complex degradations. To…

Computer Vision and Pattern Recognition · Computer Science 2023-06-06 Di You , Andreas Floros , Pier Luigi Dragotti

Latent diffusion models excel at producing high-quality images from text. Yet, concerns appear about the lack of diversity in the generated imagery. To tackle this, we introduce Diverse Diffusion, a method for boosting image diversity…

Computer Vision and Pattern Recognition · Computer Science 2023-10-20 Mariia Zameshina , Olivier Teytaud , Laurent Najman

Solving inverse problems without any training involves using a pretrained generative model and making appropriate modifications to the generation process to avoid finetuning of the generative model. While recent methods have explored the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Ashwini Pokle , Matthew J. Muckley , Ricky T. Q. Chen , Brian Karrer

The recent development of diffusion models has led to significant progress in solving inverse problems by leveraging these models as powerful generative priors. However, challenges persist due to the ill-posed nature of such problems, often…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Jeongsol Kim , Geon Yeong Park , Hyungjin Chung , Jong Chul Ye

Text-to-image generation models~(e.g., Stable Diffusion) have achieved significant advancements, enabling the creation of high-quality and realistic images based on textual descriptions. Prompt inversion, the task of identifying the textual…

Computer Vision and Pattern Recognition · Computer Science 2026-03-06 Mingzhe Li , Kejing Xia , Gehao Zhang , Zhenting Wang , Guanhong Tao , Siqi Pan , Juan Zhai , Shiqing Ma

Image inversion is a fundamental task in generative models, aiming to map images back to their latent representations to enable downstream applications such as editing, restoration, and style transfer. This paper provides a comprehensive…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Yinan Chen , Jiangning Zhang , Yali Bi , Xiaobin Hu , Teng Hu , Zhucun Xue , Ran Yi , Yong Liu , Ying Tai

Mitigating biases in generative AI and, particularly in text-to-image models, is of high importance given their growing implications in society. The biased datasets used for training pose challenges in ensuring the responsible development…

Computer Vision and Pattern Recognition · Computer Science 2024-06-11 Carolina Lopez Olmos , Alexandros Neophytou , Sunando Sengupta , Dim P. Papadopoulos

The recent years have seen a surge of interest in methods for imaging beyond the direct line of sight. The most prominent techniques rely on time-resolved optical impulse responses, obtained by illuminating a diffuse wall with an ultrashort…

Computer Vision and Pattern Recognition · Computer Science 2020-01-30 Javier Grau Chopite , Matthias B. Hullin , Michael Wand , Julian Iseringhausen

This paper introduces innovative solutions to enhance spatial controllability in diffusion models reliant on text queries. We first introduce vision guidance as a foundational spatial cue within the perturbed distribution. This…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Zipeng Qi , Guoxi Huang , Chenyang Liu , Fei Ye

In the next generation wireless networks, lowlatency communication is critical to support emerging diversified applications, e.g., Tactile Internet and Virtual Reality. In this paper, a novel blind demixing approach is developed to reduce…

Information Theory · Computer Science 2018-12-07 Jialin Dong , Kai Yang , Yuanming Shi

We introduce a novel diffusion transformer, LazyDiffusion, that generates partial image updates efficiently. Our approach targets interactive image editing applications in which, starting from a blank canvas or an image, a user specifies a…

Computer Vision and Pattern Recognition · Computer Science 2024-04-19 Yotam Nitzan , Zongze Wu , Richard Zhang , Eli Shechtman , Daniel Cohen-Or , Taesung Park , Michaël Gharbi