English
Related papers

Related papers: Dual Prompting Image Restoration with Diffusion Tr…

200 papers

Common image-to-image translation methods rely on joint training over data from both source and target domains. The training process requires concurrent access to both datasets, which hinders data separation and privacy protection; and…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Xuan Su , Jiaming Song , Chenlin Meng , Stefano Ermon

Hyperspectral image (HSI) restoration aims at recovering clean images from degraded observations and plays a vital role in downstream tasks. Existing model-based methods have limitations in accurately modeling the complex image…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Li Pang , Xiangyu Rui , Long Cui , Hongzhong Wang , Deyu Meng , Xiangyong Cao

Diffusion Transformers (DiTs) have emerged as a leading architecture for text-to-image synthesis, producing high-quality and photorealistic images. However, the quadratic scaling properties of the attention in DiTs hinder image generation…

Computer Vision and Pattern Recognition · Computer Science 2025-08-12 Philipp Becker , Abhinav Mehrotra , Ruchika Chavhan , Malcolm Chadwick , Luca Morreale , Mehdi Noroozi , Alberto Gil Ramos , Sourav Bhattacharya

All-in-one image restoration aims to address diverse degradation types using a single unified model. Existing methods typically rely on degradation priors to guide restoration, yet often struggle to reconstruct content in severely degraded…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Yanjie Tu , Qingsen Yan , Axi Niu , Jiacong Tang

Diffusion models are widely recognized for their ability to generate high-fidelity images. Despite the excellent performance and scalability of the Diffusion Transformer (DiT) architecture, it applies fixed compression across different…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Weinan Jia , Mengqi Huang , Nan Chen , Lei Zhang , Zhendong Mao

Image deblurring continues to achieve impressive performance with the development of generative models. Nonetheless, there still remains a displeasing problem if one wants to improve perceptual quality and quantitative scores of recovered…

Computer Vision and Pattern Recognition · Computer Science 2024-01-30 Pengwei Liang , Junjun Jiang , Xianming Liu , Jiayi Ma

Restoring real-world degraded images, such as old photographs or low-resolution images, presents a significant challenge due to the complex, mixed degradations they exhibit, such as scratches, color fading, and noise. Recent data-driven…

Computer Vision and Pattern Recognition · Computer Science 2025-05-28 Peng Xiao , Hongbo Zhao , Yijun Wang , Jianxin Lin

Three-dimensional microscopy is often limited by anisotropic spatial resolution, resulting in lower axial resolution than lateral resolution. Current State-of-The-Art (SoTA) isotropic reconstruction methods utilizing deep neural networks…

Image and Video Processing · Electrical Eng. & Systems 2023-06-22 Mingjie Pan , Yulu Gan , Fangxu Zhou , Jiaming Liu , Aimin Wang , Shanghang Zhang , Dawei Li

Though diffusion models have been successfully applied to various image restoration (IR) tasks, their performance is sensitive to the choice of training datasets. Typically, diffusion models trained in specific datasets fail to recover…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Ziwei Luo , Fredrik K. Gustafsson , Zheng Zhao , Jens Sjölund , Thomas B. Schön

Recovering degraded low-resolution text images is challenging, especially for Chinese text images with complex strokes and severe degradation in real-world scenarios. Ensuring both text fidelity and style realness is crucial for…

Computer Vision and Pattern Recognition · Computer Science 2024-03-05 Yuzhe Zhang , Jiawei Zhang , Hao Li , Zhouxia Wang , Luwei Hou , Dongqing Zou , Liheng Bian

Image restoration refers to the process of restoring a damaged low-quality image back to its corresponding high-quality image. Typically, we use convolutional neural networks to directly learn the mapping from low-quality images to…

Image and Video Processing · Electrical Eng. & Systems 2024-08-30 Conghan Yue , Zhengwei Peng , Junlong Ma , Dongyu Zhang

Inversion by Direct Iteration (InDI) is a new formulation for supervised image restoration that avoids the so-called "regression to the mean" effect and produces more realistic and detailed images than existing regression-based methods. It…

Image and Video Processing · Electrical Eng. & Systems 2024-02-05 Mauricio Delbracio , Peyman Milanfar

Diffusion-based image compression has recently shown outstanding perceptual fidelity, yet its practicality is hindered by prohibitive sampling overhead and high memory usage. Most existing diffusion codecs employ U-Net architectures, where…

Image and Video Processing · Electrical Eng. & Systems 2026-03-16 Junqi Shi , Ming Lu , Xingchen Li , Anle Ke , Ruiqi Zhang , Zhan Ma

While diffusion-based image restoration (IR) methods have achieved remarkable success, they are still limited by the low inference speed attributed to the necessity of executing hundreds or even thousands of sampling steps. Existing…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Zongsheng Yue , Jianyi Wang , Chen Change Loy

Recovering noise-covered details from low-light images is challenging, and the results given by previous methods leave room for improvement. Recent diffusion models show realistic and detailed image generation through a sequence of…

Computer Vision and Pattern Recognition · Computer Science 2023-05-18 Dewei Zhou , Zongxin Yang , Yi Yang

Image restoration is a fundamental problem that involves recovering a high-quality clean image from its degraded observation. All-In-One image restoration models can effectively restore images from various types and levels of degradation…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Marcos V. Conde , Gregor Geigle , Radu Timofte

Image restoration faces challenges including ineffective feature fusion, computational bottlenecks and inefficient diffusion processes. To address these, we propose DiffRWKVIR, a novel framework unifying Test-Time Training (TTT) with…

Computer Vision and Pattern Recognition · Computer Science 2025-12-15 Rongchang Lu , Tianduo Luo , Yunzhi Jiang , Conghan Yue , Pei Yang , Guibao Liu , Changyang Gu

Recent advances in generative models, especially diffusion models, have significantly improved image restoration (IR) performance. However, existing problem-agnostic diffusion model-based image restoration (DMIR) methods face challenges in…

Computer Vision and Pattern Recognition · Computer Science 2025-11-14 Chenxu Wu , Qingpeng Kong , Peiang Zhao , Wendi Yang , Wenxin Ma , Fenghe Tang , Zihang Jiang , S. Kevin Zhou

Recent advances in diffusion-based Large Restoration Models (LRMs) have significantly improved photo-realistic image restoration by leveraging the internal knowledge embedded within model weights. However, existing LRMs often suffer from…

Computer Vision and Pattern Recognition · Computer Science 2024-10-10 Hang Guo , Tao Dai , Zhihao Ouyang , Taolin Zhang , Yaohua Zha , Bin Chen , Shu-tao Xia

Large-scale pre-trained diffusion models are becoming increasingly popular in solving the Real-World Image Super-Resolution (Real-ISR) problem because of their rich generative priors. The recent development of diffusion transformer (DiT)…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Zheng-Peng Duan , Jiawei Zhang , Xin Jin , Ziheng Zhang , Zheng Xiong , Dongqing Zou , Jimmy S. Ren , Chun-Le Guo , Chongyi Li