English
Related papers

Related papers: SILO: Solving Inverse Problems with Latent Operato…

200 papers

Low-light image enhancement aims to improve the visibility of degraded images to better align with human visual perception. While diffusion-based methods have shown promising performance due to their strong generative capabilities. However,…

Computer Vision and Pattern Recognition · Computer Science 2025-07-25 Jinhong He , Minglong Xue , Zhipu Liu , Mingliang Zhou , Aoxiang Ning , Palaiahnakote Shivakumara

Since the advent of popular visual generation frameworks like VQGAN and latent diffusion models, state-of-the-art image generation systems have generally been two-stage systems that first tokenize or compress visual data into a…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Kyle Sargent , Kyle Hsu , Justin Johnson , Li Fei-Fei , Jiajun Wu

Diffusion models have achieved promising results in image restoration tasks, yet suffer from time-consuming, excessive computational resource consumption, and unstable restoration. To address these issues, we propose a robust and efficient…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Hai Jiang , Ao Luo , Songchen Han , Haoqiang Fan , Shuaicheng Liu

The computer vision community has developed numerous techniques for digitally restoring true scene information from single-view degraded photographs, an important yet extremely ill-posed task. In this work, we tackle image restoration from…

Computer Vision and Pattern Recognition · Computer Science 2025-03-19 Yucheng Mao , Boyang Wang , Nilesh Kulkarni , Jeong Joon Park

Enforcing alignment between the internal representations of diffusion or flow-based generative models and those of pretrained self-supervised encoders has recently been shown to provide a powerful inductive bias, improving both convergence…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Loukas Sfountouris , Giannis Daras , Paris Giampouras

The recent use of diffusion prior, enhanced by pre-trained text-image models, has markedly elevated the performance of image super-resolution (SR). To alleviate the huge computational cost required by pixel-based diffusion SR, latent-based…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Feng Luo , Jinxi Xiang , Jun Zhang , Xiao Han , Wei Yang

Diffusion models are powerful generative models that achieve state-of-the-art performance in image synthesis. However, training them demands substantial amounts of data and computational resources. Continual learning would allow for…

Machine Learning · Computer Science 2025-03-05 Sergi Masip , Pau Rodriguez , Tinne Tuytelaars , Gido M. van de Ven

We present AutoDIR, an innovative all-in-one image restoration system incorporating latent diffusion. AutoDIR excels in its ability to automatically identify and restore images suffering from a range of unknown degradations. AutoDIR offers…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Yitong Jiang , Zhaoyang Zhang , Tianfan Xue , Jinwei Gu

The advent of handheld fundus imaging devices has made ophthalmologic diagnosis and disease screening more accessible, efficient, and cost-effective. However, images captured from these setups often suffer from artifacts such as flash…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Mathumetha Palani , Kavya Puthumana , Ayantika Das , Ganapathy Krishnamurthi

Diffusion models are emerging as powerful solutions for generating high-fidelity and diverse images, often surpassing GANs under many circumstances. However, their slow inference speed hinders their potential for real-time applications. To…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Luan Thanh Trinh , Tomoki Hamagami

Inverse problems in imaging are typically ill-posed and are usually solved by employing regularized optimization techniques. The usage of appropriate constraints can restrict the solution space, thus making it feasible for a reconstruction…

Image and Video Processing · Electrical Eng. & Systems 2025-11-14 Jasleen Birdi , Tamal Majumder , Debanjan Halder , Muskan Kularia , Kedar Khare

Diffusion models, known for their powerful generative capabilities, play a crucial role in addressing real-world super-resolution challenges. However, these models often focus on improving local textures while neglecting the impacts of…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Chunyang Bi , Xin Luo , Sheng Shen , Mengxi Zhang , Huanjing Yue , Jingyu Yang

Many interesting tasks in image restoration can be cast as linear inverse problems. A recent family of approaches for solving these problems uses stochastic algorithms that sample from the posterior distribution of natural images given the…

Image and Video Processing · Electrical Eng. & Systems 2022-10-14 Bahjat Kawar , Michael Elad , Stefano Ermon , Jiaming Song

Diffusion models (DMs) have achieved promising performance in image restoration but haven't been explored for stereo images. The application of DM in stereo image restoration is confronted with a series of challenges. The need to…

Computer Vision and Pattern Recognition · Computer Science 2025-01-20 Huiyun Cao , Yuan Shi , Bin Xia , Xiaoyu Jin , Wenming Yang

Large-scale generative models have achieved remarkable advancements in various visual tasks, yet their application to shadow removal in images remains challenging. These models often generate diverse, realistic details without adequate…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Xinjie Li , Yang Zhao , Dong Wang , Yuan Chen , Li Cao , Xiaoping Liu

Although learning-based image restoration methods have made significant progress, they still struggle with limited generalization to real-world scenarios due to the substantial domain gap caused by training on synthetic data. Existing…

Computer Vision and Pattern Recognition · Computer Science 2025-02-20 Kang Liao , Zongsheng Yue , Zhouxia Wang , Chen Change Loy

Despite the significant progress made by all-in-one models in universal image restoration, existing methods suffer from a generalization bottleneck in real-world scenarios, as they are mostly trained on small-scale synthetic datasets with…

Computer Vision and Pattern Recognition · Computer Science 2024-12-03 Hao Li , Xiang Chen , Jiangxin Dong , Jinhui Tang , Jinshan Pan

In this paper we consider the problem of acoustic inversion in the context of the optoacoustic tomography image reconstruction problem. By leveraging the ability of the recently proposed diffusion models for image generative tasks among…

Image and Video Processing · Electrical Eng. & Systems 2024-04-17 M. G. González , M. Vera , A. Dreszman , L. J. Rey Vega

Denoising diffusion models are a powerful type of generative models used to capture complex distributions of real-world signals. However, their applicability is limited to scenarios where training samples are readily available, which is not…

Computer Vision and Pattern Recognition · Computer Science 2023-11-20 Ayush Tewari , Tianwei Yin , George Cazenavette , Semon Rezchikov , Joshua B. Tenenbaum , Frédo Durand , William T. Freeman , Vincent Sitzmann

In nighttime circumstances, it is challenging for individuals and machines to perceive their surroundings. While prevailing image restoration methods adeptly handle singular forms of degradation, they falter when confronted with intricate…

Computer Vision and Pattern Recognition · Computer Science 2026-05-15 Yifan Chen , Fei Yin , Chunle Guo , Chongyi Li , Yujiu Yang