中文
相关论文

相关论文: Text-Aware Image Restoration with Diffusion Models

200 篇论文

The goal of scene text image super-resolution is to reconstruct high-resolution text-line images from unrecognizable low-resolution inputs. The existing methods relying on the optimization of pixel-level loss tend to yield text edges that…

计算机视觉与模式识别 · 计算机科学 2025-03-18 Baolin Liu , Zongyuan Yang , Pengfei Wang , Junjie Zhou , Ziqi Liu , Ziyi Song , Yan Liu , Yongping Xiong

Diffusion models have recently emerged as a promising framework for Image Restoration (IR), owing to their ability to produce high-quality reconstructions and their compatibility with established methods. Existing methods for solving noisy…

计算机视觉与模式识别 · 计算机科学 2025-11-21 Kyungsung Lee , Donggyu Lee , Myungjoo Kang

Though diffusion models have been successfully applied to various image restoration (IR) tasks, their performance is sensitive to the choice of training datasets. Typically, diffusion models trained in specific datasets fail to recover…

计算机视觉与模式识别 · 计算机科学 2024-04-16 Ziwei Luo , Fredrik K. Gustafsson , Zheng Zhao , Jens Sjölund , Thomas B. Schön

Most existing image restoration methods use neural networks to learn strong image-level priors from huge data to estimate the lost information. However, these works still struggle in cases when images have severe information deficits.…

计算机视觉与模式识别 · 计算机科学 2023-03-01 Yunpeng Bai , Cairong Wang , Shuzhao Xie , Chao Dong , Chun Yuan , Zhi Wang

Changing facial expressions, gestures, or background details may dramatically alter the meaning conveyed by an image. Notably, recent advances in diffusion models greatly improve the quality of image manipulation while also opening the door…

计算机视觉与模式识别 · 计算机科学 2025-06-13 Alex Costanzino , Woody Bayliss , Juil Sock , Marc Gorriz Blanch , Danijela Horak , Ivan Laptev , Philip Torr , Fabio Pizzati

Although diffusion-based real-world image restoration (Real-IR) has achieved remarkable progress, efficiently leveraging ultra-large-scale pre-trained text-to-image (T2I) models and fully exploiting their potential remain significant…

计算机视觉与模式识别 · 计算机科学 2026-03-24 Purui Bai , Junxian Duan , Pin Wang , Jinhua Hao , Ming Sun , Chao Zhou , Huaibo Huang

Hyperspectral image (HSI) restoration aims at recovering clean images from degraded observations and plays a vital role in downstream tasks. Existing model-based methods have limitations in accurately modeling the complex image…

计算机视觉与模式识别 · 计算机科学 2024-02-27 Li Pang , Xiangyu Rui , Long Cui , Hongzhong Wang , Deyu Meng , Xiangyong Cao

Diffusion-based image super-resolution (SR) methods have shown promise in reconstructing high-resolution images with fine details from low-resolution counterparts. However, these approaches typically require tens or even hundreds of…

计算机视觉与模式识别 · 计算机科学 2024-08-15 Xiao He , Huaao Tang , Zhijun Tu , Junchao Zhang , Kun Cheng , Hanting Chen , Yong Guo , Mingrui Zhu , Nannan Wang , Xinbo Gao , Jie Hu

Image restoration aims to enhance low quality images, producing high quality images that exhibit natural visual characteristics and fine semantic attributes. Recently, the diffusion model has emerged as a powerful technique for image…

计算机视觉与模式识别 · 计算机科学 2024-07-23 Jiangtong Tan , Feng Zhao

Deep image restoration models aim to learn a mapping from degraded image space to natural image space. However, they face several critical challenges: removing degradation, generating realistic details, and ensuring pixel-level consistency.…

计算机视觉与模式识别 · 计算机科学 2025-07-31 Xinqi Lin , Fanghua Yu , Jinfan Hu , Zhiyuan You , Wu Shi , Jimmy S. Ren , Jinjin Gu , Chao Dong

Diffusion models have achieved remarkable progress in generative modelling, particularly in enhancing image quality to conform to human preferences. Recently, these models have also been applied to low-level computer vision for…

计算机视觉与模式识别 · 计算机科学 2025-10-09 Ziwei Luo , Fredrik K. Gustafsson , Zheng Zhao , Jens Sjölund , Thomas B. Schön

Diffusion models, known for their powerful generative capabilities, play a crucial role in addressing real-world super-resolution challenges. However, these models often focus on improving local textures while neglecting the impacts of…

计算机视觉与模式识别 · 计算机科学 2024-04-02 Chunyang Bi , Xin Luo , Sheng Shen , Mengxi Zhang , Huanjing Yue , Jingyu Yang

Reconstructing missing details from degraded low-quality inputs poses a significant challenge. Recent progress in image restoration has demonstrated the efficacy of learning large models capable of addressing various degradations…

计算机视觉与模式识别 · 计算机科学 2024-06-04 Eduard Zamfir , Zongwei Wu , Nancy Mehta , Danda Pani Paudel , Yulun Zhang , Radu Timofte

We present AutoDIR, an innovative all-in-one image restoration system incorporating latent diffusion. AutoDIR excels in its ability to automatically identify and restore images suffering from a range of unknown degradations. AutoDIR offers…

计算机视觉与模式识别 · 计算机科学 2024-05-29 Yitong Jiang , Zhaoyang Zhang , Tianfan Xue , Jinwei Gu

Large-scale text-to-image models have demonstrated amazing ability to synthesize diverse and high-fidelity images. However, these models are often violated by several limitations. Firstly, they require the user to provide precise and…

计算机视觉与模式识别 · 计算机科学 2023-05-09 Yupei Lin , Sen Zhang , Xiaojun Yang , Xiao Wang , Yukai Shi

Interactive Text-to-image retrieval (I-TIR) is an important enabler for a wide range of state-of-the-art services in domains such as e-commerce and education. However, current methods rely on finetuned Multimodal Large Language Models…

信息检索 · 计算机科学 2025-07-11 Zijun Long , Kangheng Liang , Gerardo Aragon-Camarasa , Richard Mccreadie , Paul Henderson

Existing multi-modal image fusion methods fail to address the compound degradations presented in source images, resulting in fusion images plagued by noise, color bias, improper exposure, \textit{etc}. Additionally, these methods often…

计算机视觉与模式识别 · 计算机科学 2024-11-01 Hao Zhang , Lei Cao , Jiayi Ma

Recent years have witnessed the remarkable performance of diffusion models in various vision tasks. However, for image restoration that aims to recover clear images with sharper details from given degraded observations, diffusion-based…

计算机视觉与模式识别 · 计算机科学 2023-10-10 Liyan Wang , Qinyu Yang , Cong Wang , Wei Wang , Jinshan Pan , Zhixun Su

Most recent extreme rescaling methods struggle to preserve semantically consistent structures and produce realistic details, due to the severely ill-posed nature of low- to high-resolution mapping under scaling factors of $16\times$ or…

计算机视觉与模式识别 · 计算机科学 2026-05-04 Hao Wei , Yanhui Zhou , Chenyang Ge , Saeed Anwar , Ajmal Mian

Image rescaling aims to learn the optimal low-resolution (LR) image that can be accurately reconstructed to its original high-resolution (HR) counterpart, providing an efficient image processing and storage method for ultra-high definition…

计算机视觉与模式识别 · 计算机科学 2025-03-11 Ce Wang , Zhenyu Hu , Wanjie Sun , Zhenzhong Chen