English
Related papers

Related papers: Text-Aware Image Restoration with Diffusion Models

200 papers

The goal of scene text image super-resolution is to reconstruct high-resolution text-line images from unrecognizable low-resolution inputs. The existing methods relying on the optimization of pixel-level loss tend to yield text edges that…

Computer Vision and Pattern Recognition · Computer Science 2025-03-18 Baolin Liu , Zongyuan Yang , Pengfei Wang , Junjie Zhou , Ziqi Liu , Ziyi Song , Yan Liu , Yongping Xiong

Diffusion models have recently emerged as a promising framework for Image Restoration (IR), owing to their ability to produce high-quality reconstructions and their compatibility with established methods. Existing methods for solving noisy…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Kyungsung Lee , Donggyu Lee , Myungjoo Kang

Though diffusion models have been successfully applied to various image restoration (IR) tasks, their performance is sensitive to the choice of training datasets. Typically, diffusion models trained in specific datasets fail to recover…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Ziwei Luo , Fredrik K. Gustafsson , Zheng Zhao , Jens Sjölund , Thomas B. Schön

Most existing image restoration methods use neural networks to learn strong image-level priors from huge data to estimate the lost information. However, these works still struggle in cases when images have severe information deficits.…

Computer Vision and Pattern Recognition · Computer Science 2023-03-01 Yunpeng Bai , Cairong Wang , Shuzhao Xie , Chao Dong , Chun Yuan , Zhi Wang

Changing facial expressions, gestures, or background details may dramatically alter the meaning conveyed by an image. Notably, recent advances in diffusion models greatly improve the quality of image manipulation while also opening the door…

Computer Vision and Pattern Recognition · Computer Science 2025-06-13 Alex Costanzino , Woody Bayliss , Juil Sock , Marc Gorriz Blanch , Danijela Horak , Ivan Laptev , Philip Torr , Fabio Pizzati

Although diffusion-based real-world image restoration (Real-IR) has achieved remarkable progress, efficiently leveraging ultra-large-scale pre-trained text-to-image (T2I) models and fully exploiting their potential remain significant…

Computer Vision and Pattern Recognition · Computer Science 2026-03-24 Purui Bai , Junxian Duan , Pin Wang , Jinhua Hao , Ming Sun , Chao Zhou , Huaibo Huang

Hyperspectral image (HSI) restoration aims at recovering clean images from degraded observations and plays a vital role in downstream tasks. Existing model-based methods have limitations in accurately modeling the complex image…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Li Pang , Xiangyu Rui , Long Cui , Hongzhong Wang , Deyu Meng , Xiangyong Cao

Diffusion-based image super-resolution (SR) methods have shown promise in reconstructing high-resolution images with fine details from low-resolution counterparts. However, these approaches typically require tens or even hundreds of…

Computer Vision and Pattern Recognition · Computer Science 2024-08-15 Xiao He , Huaao Tang , Zhijun Tu , Junchao Zhang , Kun Cheng , Hanting Chen , Yong Guo , Mingrui Zhu , Nannan Wang , Xinbo Gao , Jie Hu

Image restoration aims to enhance low quality images, producing high quality images that exhibit natural visual characteristics and fine semantic attributes. Recently, the diffusion model has emerged as a powerful technique for image…

Computer Vision and Pattern Recognition · Computer Science 2024-07-23 Jiangtong Tan , Feng Zhao

Deep image restoration models aim to learn a mapping from degraded image space to natural image space. However, they face several critical challenges: removing degradation, generating realistic details, and ensuring pixel-level consistency.…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Xinqi Lin , Fanghua Yu , Jinfan Hu , Zhiyuan You , Wu Shi , Jimmy S. Ren , Jinjin Gu , Chao Dong

Diffusion models have achieved remarkable progress in generative modelling, particularly in enhancing image quality to conform to human preferences. Recently, these models have also been applied to low-level computer vision for…

Computer Vision and Pattern Recognition · Computer Science 2025-10-09 Ziwei Luo , Fredrik K. Gustafsson , Zheng Zhao , Jens Sjölund , Thomas B. Schön

Diffusion models, known for their powerful generative capabilities, play a crucial role in addressing real-world super-resolution challenges. However, these models often focus on improving local textures while neglecting the impacts of…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Chunyang Bi , Xin Luo , Sheng Shen , Mengxi Zhang , Huanjing Yue , Jingyu Yang

Reconstructing missing details from degraded low-quality inputs poses a significant challenge. Recent progress in image restoration has demonstrated the efficacy of learning large models capable of addressing various degradations…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Eduard Zamfir , Zongwei Wu , Nancy Mehta , Danda Pani Paudel , Yulun Zhang , Radu Timofte

We present AutoDIR, an innovative all-in-one image restoration system incorporating latent diffusion. AutoDIR excels in its ability to automatically identify and restore images suffering from a range of unknown degradations. AutoDIR offers…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Yitong Jiang , Zhaoyang Zhang , Tianfan Xue , Jinwei Gu

Large-scale text-to-image models have demonstrated amazing ability to synthesize diverse and high-fidelity images. However, these models are often violated by several limitations. Firstly, they require the user to provide precise and…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Yupei Lin , Sen Zhang , Xiaojun Yang , Xiao Wang , Yukai Shi

Interactive Text-to-image retrieval (I-TIR) is an important enabler for a wide range of state-of-the-art services in domains such as e-commerce and education. However, current methods rely on finetuned Multimodal Large Language Models…

Information Retrieval · Computer Science 2025-07-11 Zijun Long , Kangheng Liang , Gerardo Aragon-Camarasa , Richard Mccreadie , Paul Henderson

Existing multi-modal image fusion methods fail to address the compound degradations presented in source images, resulting in fusion images plagued by noise, color bias, improper exposure, \textit{etc}. Additionally, these methods often…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Hao Zhang , Lei Cao , Jiayi Ma

Recent years have witnessed the remarkable performance of diffusion models in various vision tasks. However, for image restoration that aims to recover clear images with sharper details from given degraded observations, diffusion-based…

Computer Vision and Pattern Recognition · Computer Science 2023-10-10 Liyan Wang , Qinyu Yang , Cong Wang , Wei Wang , Jinshan Pan , Zhixun Su

Most recent extreme rescaling methods struggle to preserve semantically consistent structures and produce realistic details, due to the severely ill-posed nature of low- to high-resolution mapping under scaling factors of $16\times$ or…

Computer Vision and Pattern Recognition · Computer Science 2026-05-04 Hao Wei , Yanhui Zhou , Chenyang Ge , Saeed Anwar , Ajmal Mian

Image rescaling aims to learn the optimal low-resolution (LR) image that can be accurately reconstructed to its original high-resolution (HR) counterpart, providing an efficient image processing and storage method for ultra-high definition…

Computer Vision and Pattern Recognition · Computer Science 2025-03-11 Ce Wang , Zhenyu Hu , Wanjie Sun , Zhenzhong Chen