English
Related papers

Related papers: Latent Diffusion Prior Enhanced Deep Unfolding for…

200 papers

Diffusion-based generative models are extremely effective in generating high-quality images, with generated samples often surpassing the quality of those produced by other models under several metrics. One distinguishing feature of these…

Machine Learning · Computer Science 2022-10-25 Ashwini Pokle , Zhengyang Geng , Zico Kolter

The remarkable achievements of both generative models of 2D images and neural field representations for 3D scenes present a compelling opportunity to integrate the strengths of both approaches. In this work, we propose a methodology that…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Azmi Haider , Dan Rosenbaum

We aim to tackle sparse-view reconstruction of a 360 3D scene using priors from latent diffusion models (LDM). The sparse-view setting is ill-posed and underconstrained, especially for scenes where the camera rotates 360 degrees around a…

Computer Vision and Pattern Recognition · Computer Science 2024-06-04 Soumava Paul , Christopher Wewer , Bernt Schiele , Jan Eric Lenssen

Latent-based image generative models, such as Latent Diffusion Models (LDMs) and Mask Image Models (MIMs), have achieved notable success in image generation tasks. These models typically leverage reconstructive autoencoders like VQGAN or…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Yongxin Zhu , Bocheng Li , Hang Zhang , Xin Li , Linli Xu , Lidong Bing

Image recovery from compressive measurements requires a signal prior for the images being reconstructed. Recent work has explored the use of deep generative models with low latent dimension as signal priors for such problems. However, their…

Computer Vision and Pattern Recognition · Computer Science 2021-03-02 Niklas Smedemark-Margulies , Jung Yeon Park , Max Daniels , Rose Yu , Jan-Willem van de Meent , Paul Hand

To obtain high-quality positron emission tomography (PET) scans while reducing radiation exposure to the human body, various approaches have been proposed to reconstruct standard-dose PET (SPET) images from low-dose PET (LPET) images. One…

Image and Video Processing · Electrical Eng. & Systems 2023-08-22 Zeyu Han , Yuhan Wang , Luping Zhou , Peng Wang , Binyu Yan , Jiliu Zhou , Yan Wang , Dinggang Shen

Flood prediction is critical for emergency planning and response to mitigate human and economic losses. Traditional physics-based hydrodynamic models generate high-resolution flood maps using numerical methods requiring fine-grid…

Computer Vision and Pattern Recognition · Computer Science 2025-11-19 Sun Han Neo , Sachith Seneviratne , Herath Mudiyanselage Viraj Vidura Herath , Abhishek Saha , Sanka Rasnayaka , Lucy Amanda Marshall

This work aims to improve the applicability of diffusion models in realistic image restoration. Specifically, we enhance the diffusion model in several aspects such as network architecture, noise level, denoising steps, training image size,…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Ziwei Luo , Fredrik K. Gustafsson , Zheng Zhao , Jens Sjölund , Thomas B. Schön

Deep generative models have emerged as promising tools for detecting arbitrary anomalies in data, dispensing with the necessity for manual labelling. Recently, autoregressive transformers have achieved state-of-the-art performance for…

Reconstructing and understanding 3D structures from a limited number of images is a well-established problem in computer vision. Traditional methods usually break this task into multiple subtasks, each requiring complex transformations…

Computer Vision and Pattern Recognition · Computer Science 2024-11-01 Zhiwen Fan , Jian Zhang , Wenyan Cong , Peihao Wang , Renjie Li , Kairun Wen , Shijie Zhou , Achuta Kadambi , Zhangyang Wang , Danfei Xu , Boris Ivanovic , Marco Pavone , Yue Wang

In recent years, diffusion models have become one of the main methods for generating images. However, detecting images generated by these models remains a challenging task. This paper proposes a novel method for detecting images generated…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Dmitry Vesnin , Dmitry Levshun , Andrey Chechulin

Diffusion model-based approaches recently achieved re-markable success in MRI reconstruction, but integration into clinical routine remains challenging due to its time-consuming convergence. This phenomenon is partic-ularly notable when…

Image and Video Processing · Electrical Eng. & Systems 2024-11-07 Yu Guan , Qinrong Cai , Wei Li , Qiuyun Fan , Dong Liang , Qiegen Liu

This work proposes a novel channel estimator based on diffusion models (DMs), one of the currently top-rated generative models. Contrary to related works utilizing generative priors, a lightweight convolutional neural network (CNN) with…

Signal Processing · Electrical Eng. & Systems 2024-03-07 Benedikt Fesl , Michael Baur , Florian Strasser , Michael Joham , Wolfgang Utschick

Positron emission tomography (PET) is an advanced medical imaging technique that plays a crucial role in non-invasive clinical diagnosis. However, while reducing radiation exposure through low-dose PET scans is beneficial for patient…

Computer Vision and Pattern Recognition · Computer Science 2024-07-02 Bin Huang , Xubiao Liu , Lei Fang , Qiegen Liu , Bingxuan Li

Purpose: To accelerate MRI acquisition by incorporating the previous scans of a subject during reconstruction. Although longitudinal imaging constitutes much of clinical MRI, leveraging previous scans is challenging due to the complex…

Image and Video Processing · Electrical Eng. & Systems 2025-10-21 Yonatan Urman , Zachary Shah , Ashwin Kumar , Bruno P. Soares , Kawin Setsompop

Existing approaches for all-in-one weather-degraded image restoration suffer from inefficiencies in leveraging degradation-aware priors, resulting in sub-optimal performance in adapting to different weather conditions. To this end, we…

Computer Vision and Pattern Recognition · Computer Science 2024-11-13 Yuanbo Wen , Tao Gao , Ziqi Li , Jing Zhang , Kaihao Zhang , Ting Chen

In this paper, conditional denoising diffusion probabilistic models (DDPMs) are proposed to enhance the data transmission and reconstruction over wireless channels. The underlying mechanism of DDPM is to decompose the data generation…

Information Theory · Computer Science 2024-11-21 Mehdi Letafati , Samad Ali , Matti Latva-aho

Compressed sensing Synthetic Aperture Radar (SAR) image formation, formulated as an inverse problem and solved with traditional iterative optimization methods can be very computationally expensive. We investigate the use of denoising…

Image and Video Processing · Electrical Eng. & Systems 2025-04-25 Odysseas Pappas , Perla Mayo , Andrew Austin , Alin Achim

Diffusion models have shown great promise for image generation, beating GANs in terms of generation diversity, with comparable image quality. However, their application to 3D shapes has been limited to point or voxel representations that…

Computer Vision and Pattern Recognition · Computer Science 2022-12-16 Gimin Nam , Mariem Khlifi , Andrew Rodriguez , Alberto Tono , Linqi Zhou , Paul Guerrero

This research paper proposes a Latent Diffusion Model for 3D (LDM3D) that generates both image and depth map data from a given text prompt, allowing users to generate RGBD images from text prompts. The LDM3D model is fine-tuned on a dataset…

Computer Vision and Pattern Recognition · Computer Science 2023-05-23 Gabriela Ben Melech Stan , Diana Wofk , Scottie Fox , Alex Redden , Will Saxton , Jean Yu , Estelle Aflalo , Shao-Yen Tseng , Fabio Nonato , Matthias Muller , Vasudev Lal