English
Related papers

Related papers: Visual-Instructed Degradation Diffusion for All-in…

200 papers

In this work, we address the limitations of denoising diffusion models (DDMs) in image restoration tasks, particularly the shape and color distortions that can compromise image quality. While DDMs have demonstrated a promising performance…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Xinlong Cheng , Tiantian Cao , Guoan Cheng , Bangxuan Huang , Xinghan Tian , Ye Wang , Xiaoyu He , Weixin Li , Tianfan Xue , Xuan Dong

In recent times, diffusion models have achieved remarkable performance in image restoration tasks. Their core mechanism relies on the restricted presumption of degradation prior to the additive noise operation. However, the blur model, one…

Computer Vision and Pattern Recognition · Computer Science 2026-05-26 Sasidhar Parvathireddy , Vamsidhar Saraswathula , Rama Krishna Gorthi

In various learning-based image restoration tasks, such as image denoising and image super-resolution, the degradation representations were widely used to model the degradation process and handle complicated degradation patterns. However,…

Computer Vision and Pattern Recognition · Computer Science 2022-08-15 Dasong Li , Yi Zhang , Ka Chun Cheung , Xiaogang Wang , Hongwei Qin , Hongsheng Li

Previous raw image-based low-light image enhancement methods predominantly relied on feed-forward neural networks to learn deterministic mappings from low-light to normally-exposed images. However, they failed to capture critical…

Computer Vision and Pattern Recognition · Computer Science 2023-08-16 Yufei Wang , Yi Yu , Wenhan Yang , Lanqing Guo , Lap-Pui Chau , Alex C. Kot , Bihan Wen

In this paper, we introduce a new perspective for improving image restoration by removing degradation in the textual representations of a given degraded image. Intuitively, restoration is much easier on text modality than image one. For…

Computer Vision and Pattern Recognition · Computer Science 2024-01-01 Jingbo Lin , Zhilu Zhang , Yuxiang Wei , Dongwei Ren , Dongsheng Jiang , Wangmeng Zuo

Diffusion Probabilistic Models (DPMs) have recently shown remarkable performance in image generation tasks, which are capable of generating highly realistic images. When adopting DPMs for image restoration tasks, the crucial aspect lies in…

Computer Vision and Pattern Recognition · Computer Science 2023-06-01 Yi Zhang , Xiaoyu Shi , Dasong Li , Xiaogang Wang , Jian Wang , Hongsheng Li

Although learning-based image restoration methods have made significant progress, they still struggle with limited generalization to real-world scenarios due to the substantial domain gap caused by training on synthetic data. Existing…

Computer Vision and Pattern Recognition · Computer Science 2025-02-20 Kang Liao , Zongsheng Yue , Zhouxia Wang , Chen Change Loy

Image restoration is essential for enhancing degraded images across computer vision tasks. However, most existing methods address only a single type of degradation (e.g., blur, noise, or haze) at a time, limiting their real-world…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Debabrata Mandal , Soumitri Chattopadhyay , Guansen Tong , Praneeth Chakravarthula

We propose DepR, a depth-guided single-view scene reconstruction framework that integrates instance-level diffusion within a compositional paradigm. Instead of reconstructing the entire scene holistically, DepR generates individual objects…

Computer Vision and Pattern Recognition · Computer Science 2025-07-31 Qingcheng Zhao , Xiang Zhang , Haiyang Xu , Zeyuan Chen , Jianwen Xie , Yuan Gao , Zhuowen Tu

Blind image restoration remains a significant challenge in low-level vision tasks. Recently, denoising diffusion models have shown remarkable performance in image synthesis. Guided diffusion models, leveraging the potent generative priors…

Computer Vision and Pattern Recognition · Computer Science 2024-11-20 Jun Xiao , Zihang Lyu , Hao Xie , Cong Zhang , Yakun Ju , Changjian Shui , Kin-Man Lam

Image restoration is a fundamental problem that involves recovering a high-quality clean image from its degraded observation. All-In-One image restoration models can effectively restore images from various types and levels of degradation…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Marcos V. Conde , Gregor Geigle , Radu Timofte

Diffusion models show promise for dynamic scene deblurring; however, existing studies often fail to leverage the intrinsic nature of the blurring process within diffusion models, limiting their full potential. To address it, we present a…

Computer Vision and Pattern Recognition · Computer Science 2026-01-09 Jin-Ting He , Fu-Jen Tsai , Yan-Tsung Peng , Min-Hung Chen , Chia-Wen Lin , Yen-Yu Lin

We present InstructDiffusion, a unifying and generic framework for aligning computer vision tasks with human instructions. Unlike existing approaches that integrate prior knowledge and pre-define the output space (e.g., categories and…

Computer Vision and Pattern Recognition · Computer Science 2023-09-08 Zigang Geng , Binxin Yang , Tiankai Hang , Chen Li , Shuyang Gu , Ting Zhang , Jianmin Bao , Zheng Zhang , Han Hu , Dong Chen , Baining Guo

All-in-one image restoration aims to address diverse degradation types using a single unified model. Existing methods typically rely on degradation priors to guide restoration, yet often struggle to reconstruct content in severely degraded…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Yanjie Tu , Qingsen Yan , Axi Niu , Jiacong Tang

Denoising diffusion models have emerged as a powerful tool for various image generation and editing tasks, facilitating the synthesis of visual content in an unconditional or input-conditional manner. The core idea behind them is learning…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 Yi Huang , Jiancheng Huang , Yifan Liu , Mingfu Yan , Jiaxi Lv , Jianzhuang Liu , Wei Xiong , He Zhang , Liangliang Cao , Shifeng Chen

Diffusion models currently achieve state-of-the-art performance for both conditional and unconditional image generation. However, so far, image diffusion models do not support tasks required for 3D understanding, such as view-consistent 3D…

Computer Vision and Pattern Recognition · Computer Science 2024-02-22 Titas Anciukevičius , Zexiang Xu , Matthew Fisher , Paul Henderson , Hakan Bilen , Niloy J. Mitra , Paul Guerrero

Recently, several discriminative learning approaches have been proposed for effective image restoration, achieving convincing trade-off between image quality and computational efficiency. However, these methods require separate training for…

Computer Vision and Pattern Recognition · Computer Science 2018-07-04 Lei Xiao , Felix Heide , Wolfgang Heidrich , Bernhard Schölkopf , Michael Hirsch

Novel-view synthesis through diffusion models has demonstrated remarkable potential for generating diverse and high-quality images. Yet, the independent process of image generation in these prevailing methods leads to challenges in…

Computer Vision and Pattern Recognition · Computer Science 2024-03-01 Xianghui Yang , Yan Zuo , Sameera Ramasinghe , Loris Bazzani , Gil Avraham , Anton van den Hengel

Though diffusion models have been successfully applied to various image restoration (IR) tasks, their performance is sensitive to the choice of training datasets. Typically, diffusion models trained in specific datasets fail to recover…

Computer Vision and Pattern Recognition · Computer Science 2024-04-16 Ziwei Luo , Fredrik K. Gustafsson , Zheng Zhao , Jens Sjölund , Thomas B. Schön

Diffusion models have demonstrated remarkable efficacy in generating high-quality samples. Existing diffusion-based image restoration algorithms exploit pre-trained diffusion models to leverage data priors, yet they still preserve elements…

Image and Video Processing · Electrical Eng. & Systems 2024-08-07 Hongjie Wu , Linchao He , Mingqin Zhang , Dongdong Chen , Kunming Luo , Mengting Luo , Ji-Zhe Zhou , Hu Chen , Jiancheng Lv