English
Related papers

Related papers: FUMO: Prior-Modulated Diffusion for Single Image R…

200 papers

We present a novel approach to leverage prior knowledge encapsulated in pre-trained text-to-image diffusion models for blind super-resolution (SR). Specifically, by employing our time-aware encoder, we can achieve promising restoration…

Computer Vision and Pattern Recognition · Computer Science 2024-07-01 Jianyi Wang , Zongsheng Yue , Shangchen Zhou , Kelvin C. K. Chan , Chen Change Loy

Reference-based super-resolution (RefSR) has the potential to build bridges across spatial and temporal resolutions of remote sensing images. However, existing RefSR methods are limited by the faithfulness of content reconstruction and the…

Image and Video Processing · Electrical Eng. & Systems 2024-03-27 Runmin Dong , Shuai Yuan , Bin Luo , Mengxuan Chen , Jinxiao Zhang , Lixian Zhang , Weijia Li , Juepeng Zheng , Haohuan Fu

Blind face restoration methods have shown remarkable performance, particularly when trained on large-scale synthetic datasets with supervised learning. These datasets are often generated by simulating low-quality face images with a…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Tianshu Kuai , Sina Honari , Igor Gilitschenski , Alex Levinshtein

While burst LR images are useful for improving the SR image quality compared with a single LR image, prior SR networks accepting the burst LR images are trained in a deterministic manner, which is known to produce a blurry SR image. In…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Kyotaro Tokoro , Kazutoshi Akita , Norimichi Ukita

Diffusion models represent the state-of-the-art in generative modeling. Due to their high training costs, many works leverage pre-trained diffusion models' powerful representations for downstream tasks, such as face super-resolution (FSR),…

Computer Vision and Pattern Recognition · Computer Science 2024-12-24 Jiarui Yang , Tao Dai , Yufei Zhu , Naiqi Li , Jinmin Li , Shutao Xia

Single Image Reflection Removal (SIRR) technique plays a crucial role in image processing by eliminating unwanted reflections from the background. These reflections, often caused by photographs taken through glass surfaces, can…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Jie Cai , Kangning Yang , Ling Ouyang , Lan Fu , Jiaming Ding , Huiming Sun , Chiu Man Ho , Zibo Meng

The recent use of diffusion prior, enhanced by pre-trained text-image models, has markedly elevated the performance of image super-resolution (SR). To alleviate the huge computational cost required by pixel-based diffusion SR, latent-based…

Computer Vision and Pattern Recognition · Computer Science 2023-12-14 Feng Luo , Jinxi Xiang , Jun Zhang , Xiao Han , Wei Yang

Recovering textures under shadows has remained a challenging problem due to the difficulty of inferring shadow-free scenes from shadow images. In this paper, we propose the use of diffusion models as they offer a promising approach to…

Computer Vision and Pattern Recognition · Computer Science 2025-05-13 Kangfu Mei , Luis Figueroa , Zhe Lin , Zhihong Ding , Scott Cohen , Vishal M. Patel

Recent state-of-the-art image restoration methods mostly adopt latent diffusion models with U-Net backbones, yet still facing challenges in achieving high-quality restoration due to their limited capabilities. Diffusion transformers (DiTs),…

Computer Vision and Pattern Recognition · Computer Science 2025-04-28 Dehong Kong , Fan Li , Zhixin Wang , Jiaqi Xu , Renjing Pei , Wenbo Li , WenQi Ren

3D reconstruction methods such as Neural Radiance Fields (NeRFs) excel at rendering photorealistic novel views of complex scenes. However, recovering a high-quality NeRF typically requires tens to hundreds of input images, resulting in a…

Computer Vision and Pattern Recognition · Computer Science 2023-12-06 Rundi Wu , Ben Mildenhall , Philipp Henzler , Keunhong Park , Ruiqi Gao , Daniel Watson , Pratul P. Srinivasan , Dor Verbin , Jonathan T. Barron , Ben Poole , Aleksander Holynski

Single image reflection separation aims to separate the transmission and reflection layers from a mixed image. Existing methods typically combine general priors from pre-trained models with task-specific priors such as text prompts and…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Yue Huang , Tianle Hu , Yu Chen , Zi'ang Li , Jie Wen , Xiaozhao Fang

Complex degradations like noise, blur, and low resolution are typical challenges in real world image fusion tasks, limiting the performance and practicality of existing methods. End to end neural network based approaches are generally…

Computer Vision and Pattern Recognition · Computer Science 2026-04-13 Yu Shi , Yu Liu , Zhong-Cheng Wu , Juan Cheng , Huafeng Li , Xun Chen

Recent diffusion-based one-step methods have shown remarkable progress in the field of image super-resolution, yet they remain constrained by three critical limitations: (1) inferior fidelity performance caused by the information loss from…

Computer Vision and Pattern Recognition · Computer Science 2025-12-17 Hao Chen , Junyang Chen , Jinshan Pan , Jiangxin Dong

While diffusion-based image restoration (IR) methods have achieved remarkable success, they are still limited by the low inference speed attributed to the necessity of executing hundreds or even thousands of sampling steps. Existing…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Zongsheng Yue , Jianyi Wang , Chen Change Loy

Reflection is common in images capturing scenes behind a glass window, which is not only a disturbance visually but also influence the performance of other computer vision algorithms. Single image reflection removal is an ill-posed problem…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Yunfei Liu , Yu Li , Shaodi You , Feng Lu

Hyperspectral imaging (HSI) enables detailed land cover classification, yet low spatial resolution and sparse annotations pose significant challenges. We present a label-efficient framework that leverages spatial features from a frozen…

Computer Vision and Pattern Recognition · Computer Science 2025-12-04 Yuzhen Hu , Biplab Banerjee , Saurabh Prasad

Diffusion models have achieved great progress in image animation due to powerful generative capabilities. However, maintaining spatio-temporal consistency with detailed information from the input static image over time (e.g., style,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-24 Xin Ma , Yaohui Wang , Gengyun Jia , Xinyuan Chen , Yuan-Fang Li , Cunjian Chen , Yu Qiao

Multi-modal image fusion aims to consolidate complementary information from diverse source images into a unified representation. The fused image is expected to preserve fine details and maintain high visual fidelity. While diffusion models…

Computer Vision and Pattern Recognition · Computer Science 2026-01-29 Xingxin Xu , Bing Cao , DongDong Li , Qinghua Hu , Pengfei Zhu

Hyperspectral image (HSI) reconstruction aims to recover 3D HSI from its degraded 2D measurements. Recently great progress has been made in deep learning-based methods, however, these methods often struggle to accurately capture…

Computer Vision and Pattern Recognition · Computer Science 2025-07-21 Mingyang Yu , Zhijian Wu , Dingjiang Huang

Pre-trained diffusion models utilized for image generation encapsulate a substantial reservoir of a priori knowledge pertaining to intricate textures. Harnessing the potential of leveraging this a priori knowledge in the context of image…

Computer Vision and Pattern Recognition · Computer Science 2024-07-10 Junxiong Lin , Yan Wang , Zeng Tao , Boyang Wang , Qing Zhao , Haorang Wang , Xuan Tong , Xinji Mai , Yuxuan Lin , Wei Song , Jiawen Yu , Shaoqi Yan , Wenqiang Zhang