English
Related papers

Related papers: Diffusion Restoration Adapter for Real-World Image…

200 papers

Diffusion models have demonstrated their utility as learned priors for solving various inverse problems. However, most existing approaches are limited to linear inverse problems. This paper exploits the efficient and unsupervised posterior…

Image and Video Processing · Electrical Eng. & Systems 2025-01-07 Mehmet Onurcan Kaya , Figen S. Oktem

Diffusion models currently achieve state-of-the-art performance for both conditional and unconditional image generation. However, so far, image diffusion models do not support tasks required for 3D understanding, such as view-consistent 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Titas Anciukevičius , Zexiang Xu , Matthew Fisher , Paul Henderson , Hakan Bilen , Niloy J. Mitra , Paul Guerrero

Learning from a large corpus of data, pre-trained models have achieved impressive progress nowadays. As popular generative pre-training, diffusion models capture both low-level visual knowledge and high-level semantic relations. In this…

Computer Vision and Pattern Recognition · Computer Science 2023-03-20 Chaofan Ma , Yuhuan Yang , Chen Ju , Fei Zhang , Jinxiang Liu , Yu Wang , Ya Zhang , Yanfeng Wang

Image data augmentation constitutes a critical methodology in modern computer vision tasks, since it can facilitate towards enhancing the diversity and quality of training datasets; thereby, improving the performance and robustness of…

Computer Vision and Pattern Recognition · Computer Science 2025-01-13 Panagiotis Alimisis , Ioannis Mademlis , Panagiotis Radoglou-Grammatikis , Panagiotis Sarigiannidis , Georgios Th. Papadopoulos

Many existing video inpainting algorithms utilize optical flows to construct the corresponding maps and then propagate pixels from adjacent frames to missing areas by mapping. Despite the effectiveness of the propagation mechanism, they…

Computer Vision and Pattern Recognition · Computer Science 2025-05-20 Xian Wu , Chang Liu

Inspired by the in-context learning mechanism of large language models (LLMs), a new paradigm of generalizable visual prompt-based image editing is emerging. Existing single-reference methods typically focus on style or appearance…

Computer Vision and Pattern Recognition · Computer Science 2025-06-04 Yan Gong , Yiren Song , Yicheng Li , Chenglin Li , Yin Zhang

Zero-shot image restoration (IR) methods based on pretrained diffusion models have recently achieved significant success. These methods typically require at least a parametric form of the degradation model. However, in real-world scenarios,…

Computer Vision and Pattern Recognition · Computer Science 2025-03-28 Hamadi Chihaoui , Paolo Favaro

Recent advances in diffusion models enable many powerful instruments for image editing. One of these instruments is text-driven image manipulations: editing semantic attributes of an image according to the provided text description. %…

Computer Vision and Pattern Recognition · Computer Science 2023-04-11 Nikita Starodubcev , Dmitry Baranchuk , Valentin Khrulkov , Artem Babenko

Diffusion models have shown remarkable capabilities in generating high quality and creative images conditioned on text. An interesting application of such models is structure preserving text guided image editing. Existing approaches rely on…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Hareesh Ravi , Sachin Kelkar , Midhun Harikumar , Ajinkya Kale

In this paper, we rethink the low-light image enhancement task and propose a physically explainable and generative diffusion model for low-light image enhancement, termed as Diff-Retinex. We aim to integrate the advantages of the physical…

Computer Vision and Pattern Recognition · Computer Science 2023-08-28 Xunpeng Yi , Han Xu , Hao Zhang , Linfeng Tang , Jiayi Ma

Recent advances in diffusion transformers (DiTs) have set new standards in image generation, yet remain impractical for on-device deployment due to their high computational and memory costs. In this work, we present an efficient DiT…

Large-scale diffusion models have achieved remarkable performance in generative tasks. Beyond their initial training applications, these models have proven their ability to function as versatile plug-and-play priors. For instance, 2D…

Computer Vision and Pattern Recognition · Computer Science 2025-02-21 Xiaofeng Yang , Cheng Chen , Xulei Yang , Fayao Liu , Guosheng Lin

Ultrasound image reconstruction can be approximately cast as a linear inverse problem that has traditionally been solved with penalized optimization using the $l_1$ or $l_2$ norm, or wavelet-based terms. However, such regularization…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Yuxin Zhang , Clément Huneau , Jérôme Idier , Diana Mateus

We present DiffBIR, a general restoration pipeline that could handle different blind image restoration tasks in a unified framework. DiffBIR decouples blind image restoration problem into two stages: 1) degradation removal: removing…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Xinqi Lin , Jingwen He , Ziyan Chen , Zhaoyang Lyu , Bo Dai , Fanghua Yu , Wanli Ouyang , Yu Qiao , Chao Dong

The correct insertion of virtual objects in images of real-world scenes requires a deep understanding of the scene's lighting, geometry and materials, as well as the image formation process. While recent large-scale diffusion models have…

Computer Vision and Pattern Recognition · Computer Science 2024-08-20 Ruofan Liang , Zan Gojcic , Merlin Nimier-David , David Acuna , Nandita Vijaykumar , Sanja Fidler , Zian Wang

Spiking neural networks (SNNs) have low power consumption and bio-interpretable characteristics, and are considered to have tremendous potential for energy-efficient computing. However, the exploration of SNNs on image generation tasks…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Shu Yang , Hanzhi Ma , Chengting Yu , Aili Wang , Er-Ping Li

Plug-and-play Image Restoration (IR) has been widely recognized as a flexible and interpretable method for solving various inverse problems by utilizing any off-the-shelf denoiser as the implicit image prior. However, most existing methods…

Computer Vision and Pattern Recognition · Computer Science 2023-05-17 Yuanzhi Zhu , Kai Zhang , Jingyun Liang , Jiezhang Cao , Bihan Wen , Radu Timofte , Luc Van Gool

Diffusion models have attained remarkable success in the domains of image generation and editing. It is widely recognized that employing larger inversion and denoising steps in diffusion model leads to improved image reconstruction quality.…

Computer Vision and Pattern Recognition · Computer Science 2024-01-05 Chen Hou , Guoqiang Wei , Zhibo Chen

Diffusion models have established new state of the art in a multitude of computer vision tasks, including image restoration. Diffusion-based inverse problem solvers generate reconstructions of exceptional visual quality from heavily…

Image and Video Processing · Electrical Eng. & Systems 2024-08-21 Zalan Fabian , Berk Tinaz , Mahdi Soltanolkotabi

Blind face restoration endeavors to restore a clear face image from a degraded counterpart. Recent approaches employing Generative Adversarial Networks (GANs) as priors have demonstrated remarkable success in this field. However, these…

Computer Vision and Pattern Recognition · Computer Science 2024-09-13 Xiaobin Lu , Xiaobin Hu , Jun Luo , Ben Zhu , Yaping Ruan , Wenqi Ren