English
Related papers

Related papers: Text-Aware Image Restoration with Diffusion Models

200 papers

Images captured in challenging environments--such as nighttime, smoke, rainy weather, and underwater--often suffer from significant degradation, resulting in a substantial loss of visual quality. The effective restoration of these degraded…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Wenfeng Huang , Guoan Xu , Wenjing Jia , Stuart Perry , Guangwei Gao

The field of text-to-image generation has undergone significant advancements with the introduction of diffusion models. Nevertheless, the challenge of editing real images persists, as most methods are either computationally intensive or…

Computer Vision and Pattern Recognition · Computer Science 2025-07-16 Guillermo Gomez-Trenado , Pablo Mesejo , Oscar Cordón , Stéphane Lathuilière

Recent state-of-the-art image restoration methods mostly adopt latent diffusion models with U-Net backbones, yet still facing challenges in achieving high-quality restoration due to their limited capabilities. Diffusion transformers (DiTs),…

Computer Vision and Pattern Recognition · Computer Science 2025-04-28 Dehong Kong , Fan Li , Zhixin Wang , Jiaqi Xu , Renjing Pei , Wenbo Li , WenQi Ren

As digital content becomes increasingly ubiquitous, the need for robust watermark removal techniques has grown due to the inadequacy of existing embedding techniques, which lack robustness. This paper introduces a novel Saliency-Aware…

Computer Vision and Pattern Recognition · Computer Science 2025-04-18 Inzamamul Alam , Md Tanvir Islam , Simon S. Woo

Image reconstruction-based anomaly detection models are widely explored in industrial visual inspection. However, existing models usually suffer from the trade-off between normal reconstruction fidelity and abnormal reconstruction…

Computer Vision and Pattern Recognition · Computer Science 2025-03-17 Tongkun Liu , Bing Li , Xiao Du , Bingke Jiang , Leqi Geng , Feiyang Wang , Zhuo Zhao

Existing methods for restoring degraded human-centric images often struggle with insufficient fidelity, particularly in human body restoration (HBR). Recent diffusion-based restoration methods commonly adapt pre-trained text-to-image…

Computer Vision and Pattern Recognition · Computer Science 2026-02-05 Jue Gong , Zihan Zhou , Jingkai Wang , Shu Li , Libo Liu , Jianliang Lan , Yulun Zhang

In this paper, we propose the first diffusion-based all-in-one video restoration method that utilizes the power of a pre-trained Stable Diffusion and a fine-tuned ControlNet. Our method can restore various types of video degradation with a…

Computer Vision and Pattern Recognition · Computer Science 2025-01-07 Yizhou Li , Zihua Liu , Yusuke Monno , Masatoshi Okutomi

Thermal-infrared (TIR) hyperspectral imagery (HSI) provides critical scene information for various applications. However, its practical utility is severely limited by unique sensor degradations beyond the capabilities of existing…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Cheng Dai , Jiale Lin , Bingxuan Song , Yifei Chen , Jiashuo Chen , Xin Yuan , Fanglin Bao

Due to the high potential for abuse of GenAI systems, the task of detecting synthetic images has recently become of great interest to the research community. Unfortunately, existing image-space detectors quickly become obsolete as new…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 George Cazenavette , Avneesh Sud , Thomas Leung , Ben Usman

Recently, text-to-image (T2I) editing has been greatly pushed forward by applying diffusion models. Despite the visual promise of the generated images, inconsistencies with the expected textual prompt remain prevalent. This paper aims to…

Computer Vision and Pattern Recognition · Computer Science 2024-09-20 Aoxue Li , Mingyang Yi , Zhenguo Li

Faithful image super-resolution (SR) not only needs to recover images that appear realistic, similar to image generation tasks, but also requires that the restored images maintain fidelity and structural consistency with the input. To this…

Computer Vision and Pattern Recognition · Computer Science 2024-12-02 Junyang Chen , Jinshan Pan , Jiangxin Dong

Image restoration problems are typically ill-posed in the sense that each degraded image can be restored in infinitely many valid ways. To accommodate this, many works generate a diverse set of outputs by attempting to randomly sample from…

Computer Vision and Pattern Recognition · Computer Science 2024-03-12 Noa Cohen , Hila Manor , Yuval Bahat , Tomer Michaeli

Universal image restoration is a practical and potential computer vision task for real-world applications. The main challenge of this task is handling the different degradation distributions at once. Existing methods mainly utilize…

Computer Vision and Pattern Recognition · Computer Science 2024-03-19 Dian Zheng , Xiao-Ming Wu , Shuzhou Yang , Jian Zhang , Jian-Fang Hu , Wei-Shi Zheng

We introduce DiffSteISR, a pioneering framework for reconstructing real-world stereo images. DiffSteISR utilizes the powerful prior knowledge embedded in pre-trained text-to-image model to efficiently recover the lost texture details in…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Yuanbo Zhou , Xinlin Zhang , Wei Deng , Tao Wang , Tao Tan , Qinquan Gao , Tong Tong

Diffusion models have become the dominant approach for visual generation. They are trained by denoising a Markovian process which gradually adds noise to the input. We argue that the Markovian property limits the model's ability to fully…

Computer Vision and Pattern Recognition · Computer Science 2025-01-24 Jiatao Gu , Yuyang Wang , Yizhe Zhang , Qihang Zhang , Dinghuai Zhang , Navdeep Jaitly , Josh Susskind , Shuangfei Zhai

The diffusion-based text-to-image model harbors immense potential in transferring reference style. However, current encoder-based approaches significantly impair the text controllability of text-to-image models while transferring styles. In…

Computer Vision and Pattern Recognition · Computer Science 2024-03-13 Tianhao Qi , Shancheng Fang , Yanze Wu , Hongtao Xie , Jiawei Liu , Lang Chen , Qian He , Yongdong Zhang

Image restoration aims to recover high-quality images from degraded observations. When the degradation process is known, the recovery problem can be formulated as an inverse problem, and in a Bayesian context, the goal is to sample a clean…

Image and Video Processing · Electrical Eng. & Systems 2025-10-13 Darshan Thaker , Abhishek Goyal , René Vidal

We propose Diverse Restormer (DART), a novel image restoration method that effectively integrates information from various sources (long sequences, local and global regions, feature dimensions, and positional dimensions) to address…

Computer Vision and Pattern Recognition · Computer Science 2024-04-10 Juan Wen , Yawei Li , Chao Zhang , Weiyan Hou , Radu Timofte , Luc Van Gool

Face video restoration (FVR) is a challenging but important problem where one seeks to recover a perceptually realistic face videos from a low-quality input. While diffusion probabilistic models (DPMs) have been shown to achieve remarkable…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Zihao Zou , Jiaming Liu , Shirin Shoushtari , Yubo Wang , Weijie Gan , Ulugbek S. Kamilov

Scene Text Image Super-Resolution (STISR) aims to restore high-resolution details in low-resolution text images, which is crucial for both human readability and machine recognition. Existing methods, however, often depend on external…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Axi Niu , Kang Zhang , Qingsen Yan , Hao Jin , Jinqiu Sun , Yanning Zhang