English
Related papers

Related papers: All-in-One Medical Image Restoration with Latent D…

200 papers

Diffusion model-based image restoration (IR) aims to use diffusion models to recover high-quality (HQ) images from degraded images, achieving promising performance. Due to the inherent property of diffusion models, most existing methods…

Computer Vision and Pattern Recognition · Computer Science 2024-04-01 Jiezhang Cao , Yue Shi , Kai Zhang , Yulun Zhang , Radu Timofte , Luc Van Gool

Limited-angle and sparse-view computed tomography (LACT and SVCT) are crucial for expanding the scope of X-ray CT applications. However, they face challenges due to incomplete data acquisition, resulting in diverse artifacts in the…

Image and Video Processing · Electrical Eng. & Systems 2024-07-22 Chenhe Du , Xiyue Lin , Qing Wu , Xuanyu Tian , Ying Su , Zhe Luo , Rui Zheng , Yang Chen , Hongjiang Wei , S. Kevin Zhou , Jingyi Yu , Yuyao Zhang

Night photography often struggles with challenges like low light and blurring, stemming from dark environments and prolonged exposures. Current methods either disregard priors and directly fitting end-to-end networks, leading to…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Wenbin Zou , Hongxia Gao , Tian Ye , Liang Chen , Weipeng Yang , Shasha Huang , Hongsheng Chen , Sixiang Chen

Recent progress in generative models has significantly improved image restoration capabilities, particularly through powerful diffusion models that offer remarkable recovery of semantic details and local fidelity. However, deploying these…

Computer Vision and Pattern Recognition · Computer Science 2025-04-14 Yongsheng Yu , Haitian Zheng , Zhifei Zhang , Jianming Zhang , Yuqian Zhou , Connelly Barnes , Yuchen Liu , Wei Xiong , Zhe Lin , Jiebo Luo

Diffusion model (DM) has achieved SOTA performance by modeling the image synthesis process into a sequential application of a denoising network. However, different from image synthesis, image restoration (IR) has a strong constraint to…

Computer Vision and Pattern Recognition · Computer Science 2023-08-17 Bin Xia , Yulun Zhang , Shiyin Wang , Yitong Wang , Xinglong Wu , Yapeng Tian , Wenming Yang , Luc Van Gool

In this work, we introduce MedIL, a first-of-its-kind autoencoder built for encoding medical images with heterogeneous sizes and resolutions for image generation. Medical images are often large and heterogeneous, where fine details are of…

Computer Vision and Pattern Recognition · Computer Science 2025-04-15 Tyler Spears , Shen Zhu , Yinzhu Jin , Aman Shrivastava , P. Thomas Fletcher

Composed Image Retrieval (CIR) retrieves target images using a multi-modal query that combines a reference image with text describing desired modifications. The primary challenge is effectively fusing this visual and textual information.…

Computer Vision and Pattern Recognition · Computer Science 2025-04-16 Chaoyang Wang , Zeyu Zhang , Long Teng , Zijun Li , Shichao Kan

Traditional model-based image reconstruction (MBIR) methods combine forward and noise models with simple object priors. Recent application of deep learning methods for image reconstruction provides a successful data-driven approach to…

Image and Video Processing · Electrical Eng. & Systems 2022-05-20 Ling Chen , Zhishen Huang , Yong Long , Saiprasad Ravishankar

Pre-trained Latent Diffusion Models (LDMs) have recently shown strong perceptual priors for low-level vision tasks, making them a promising direction for multi-exposure High Dynamic Range (HDR) reconstruction. However, directly applying…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Tao Hu , Weiyu Zhou , Yanjie Tu , Peng Wu , Wei Dong , Qingsen Yan , Yanning Zhang

Data-driven flow-field reconstruction typically relies on autoencoder architectures that compress high-dimensional states into low-dimensional latent representations. However, classical approaches such as variational autoencoders (VAEs)…

Machine Learning · Computer Science 2026-01-14 AmirPouya Hemmasian , Amir Barati Farimani

We present AutoDIR, an innovative all-in-one image restoration system incorporating latent diffusion. AutoDIR excels in its ability to automatically identify and restore images suffering from a range of unknown degradations. AutoDIR offers…

Computer Vision and Pattern Recognition · Computer Science 2024-05-29 Yitong Jiang , Zhaoyang Zhang , Tianfan Xue , Jinwei Gu

Recently, diffusion models (DM) have been applied in magnetic resonance imaging (MRI) super-resolution (SR) reconstruction, exhibiting impressive performance, especially with regard to detailed reconstruction. However, the current DM-based…

Computer Vision and Pattern Recognition · Computer Science 2024-04-09 Guangyuan Li , Chen Rao , Juncheng Mo , Zhanjie Zhang , Wei Xing , Lei Zhao

Low-dose CT (LDCT) imaging is desirable in many clinical applications to reduce X-ray radiation dose to patients. Inspired by deep learning (DL), a recent promising direction of model-based iterative reconstruction (MBIR) methods for LDCT…

Image and Video Processing · Electrical Eng. & Systems 2021-02-18 Qiaoqiao Ding , Yuesong Nan , Hao Gao , Hui Ji

Deep learning-based image compression algorithms typically focus on designing encoding and decoding networks and improving the accuracy of entropy model estimation to enhance the rate-distortion (RD) performance. However, few algorithms…

Image and Video Processing · Electrical Eng. & Systems 2024-10-08 Junhui Li , Jutao Li , Xingsong Hou , Huake Wang

High-resolution (HR) MRI scans obtained from research-grade medical centers provide precise information about imaged tissues. However, routine clinical MRI scans are typically in low-resolution (LR) and vary greatly in contrast and spatial…

Image and Video Processing · Electrical Eng. & Systems 2023-08-25 Jueqi Wang , Jacob Levman , Walter Hugo Lopez Pinaya , Petru-Daniel Tudosiu , M. Jorge Cardoso , Razvan Marinescu

Despite remarkable advances made in all-in-one image restoration (AIR) for handling different types of degradations simultaneously, existing methods remain vulnerable to out-of-distribution degradations and images, limiting their real-world…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Xiaole Tang , Xiaoyi He , Xiang Gu , Jian Sun

Image restoration is essential for enhancing degraded images across computer vision tasks. However, most existing methods address only a single type of degradation (e.g., blur, noise, or haze) at a time, limiting their real-world…

Computer Vision and Pattern Recognition · Computer Science 2025-03-24 Debabrata Mandal , Soumitri Chattopadhyay , Guansen Tong , Praneeth Chakravarthula

Computed Tomography (CT) technology reduces radiation haz-ards to the human body through sparse sampling, but fewer sampling angles pose challenges for image reconstruction. Score-based generative models are widely used in sparse-view CT…

Image and Video Processing · Electrical Eng. & Systems 2025-12-22 Junyan Zhang , Mengxiao Geng , Pinhuang Tan , Yi Liu , Zhili Liu , Bin Huang , Qiegen Liu

Image restoration is a classic low-level problem aimed at recovering high-quality images from low-quality images with various degradations such as blur, noise, rain, haze, etc. However, due to the inherent complexity and non-uniqueness of…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Yuhong Zhang , Hengsheng Zhang , Xinning Chai , Zhengxue Cheng , Rong Xie , Li Song , Wenjun Zhang

Diffusion models have revealed powerful potential in all-in-one image restoration (AiOIR), which is talented in generating abundant texture details. The existing AiOIR methods either retrain a diffusion model or fine-tune the pretrained…

Computer Vision and Pattern Recognition · Computer Science 2025-08-06 Ni Tang , Xiaotong Luo , Zihan Cheng , Liangtai Zhou , Dongxiao Zhang , Yanyun Qu