English
Related papers

Related papers: Prototype Clustered Diffusion Models for Versatile…

200 papers

Used as priors for Bayesian inverse problems, diffusion models have recently attracted considerable attention in the literature. Their flexibility and high variance enable them to generate multiple solutions for a given task, such as…

Machine Learning · Computer Science 2025-07-10 Emile Pierret , Bruno Galerne

Diffusion models have gained attention for their ability to represent complex distributions and incorporate uncertainty, making them ideal for robust predictions in the presence of noisy or incomplete data. In this study, we develop and…

Machine Learning · Computer Science 2024-11-05 Yilin Zhuang , Sibo Cheng , Karthik Duraisamy

We provide a framework for solving inverse problems with diffusion models learned from linearly corrupted data. Firstly, we extend the Ambient Diffusion framework to enable training directly from measurements corrupted in the Fourier…

Computer Vision and Pattern Recognition · Computer Science 2025-04-23 Asad Aali , Giannis Daras , Brett Levac , Sidharth Kumar , Alexandros G. Dimakis , Jonathan I. Tamir

Many backdoor removal techniques in machine learning models require clean in-distribution data, which may not always be available due to proprietary datasets. Model inversion techniques, often considered privacy threats, can reconstruct…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Si Chen , Yi Zeng , Jiachen T. Wang , Won Park , Xun Chen , Lingjuan Lyu , Zhuoqing Mao , Ruoxi Jia

Diffusion models have been used as priors for solving inverse problems. However, existing approaches typically overlook side information that could significantly improve reconstruction quality, especially in severely ill-posed settings. In…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Mahdi Farahbakhsh , Vishnu Teja Kunde , Dileep Kalathil , Krishna Narayanan , Jean-Francois Chamberland

Methods based on diffusion models (DMs) for solving inverse problems (IPs) have recently achieved remarkable performance. However, DM-based methods typically struggle against outliers, which are common in real-world measurements. In this…

Computer Vision and Pattern Recognition · Computer Science 2026-05-12 Yang Zheng , Jiahua Liu , Tongyao Pang , Wen Li , Zhaoqiang Liu

Diffusion models have recently demonstrated notable success in solving inverse problems. However, current diffusion model-based solutions typically require a large number of function evaluations (NFEs) to generate high-quality images…

Computer Vision and Pattern Recognition · Computer Science 2024-12-06 Tianyu Chen , Zhendong Wang , Mingyuan Zhou

We explore the oscillatory behavior observed in inversion methods applied to large-scale text-to-image diffusion models, with a focus on the "Flux" model. By employing a fixed-point-inspired iterative approach to invert real-world images,…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Yan Zheng , Zhenxiao Liang , Xiaoyan Cong , Lanqing guo , Yuehao Wang , Peihao Wang , Zhangyang Wang

Inverse medium scattering is an ill-posed, nonlinear wave-based imaging problem arising in medical imaging, remote sensing, and non-destructive testing. Machine learning (ML) methods offer increased inference speed and flexibility in…

Computational Physics · Physics 2025-12-12 Olivia Tsang , Owen Melia , Vasileios Charisopoulos , Jeremy Hoskins , Yuehaw Khoo , Rebecca Willett

Discriminative classifiers have become a foundational tool in deep learning for medical imaging, excelling at learning separable features of complex data distributions. However, these models often need careful design, augmentation, and…

Computer Vision and Pattern Recognition · Computer Science 2025-08-11 Gian Mario Favero , Parham Saremi , Emily Kaczmarek , Brennan Nichyporuk , Tal Arbel

While diffusion models have shown great success in image generation, their noise-inverting generative process does not explicitly consider the structure of images, such as their inherent multi-scale nature. Inspired by diffusion models and…

Computer Vision and Pattern Recognition · Computer Science 2023-04-14 Severi Rissanen , Markus Heinonen , Arno Solin

Many interesting tasks in image restoration can be cast as linear inverse problems. A recent family of approaches for solving these problems uses stochastic algorithms that sample from the posterior distribution of natural images given the…

Image and Video Processing · Electrical Eng. & Systems 2022-10-14 Bahjat Kawar , Michael Elad , Stefano Ermon , Jiaming Song

Solving inverse problems without any training involves using a pretrained generative model and making appropriate modifications to the generation process to avoid finetuning of the generative model. While recent methods have explored the…

Computer Vision and Pattern Recognition · Computer Science 2024-10-22 Ashwini Pokle , Matthew J. Muckley , Ricky T. Q. Chen , Brian Karrer

Diffusion models represent a class of generative models that produce data by denoising a sample corrupted by white noise. Despite the success of diffusion models in computer vision, audio synthesis, and point cloud generation, so far they…

Statistical Mechanics · Physics 2025-01-17 Kanta Masuki , Yuto Ashida

Diffusion models are the current state-of-the-art for solving inverse problems in imaging. Their impressive generative capability allows them to approximate sampling from a prior distribution, which alongside a known likelihood function…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Samuel W. Remedios , Zhangxing Bian , Shuwen Wei , Aaron Carass , Jerry L. Prince , Blake E. Dewey

Recent advances in deep learning have enabled the generation of realistic data by training generative models on large datasets of text, images, and audio. While these models have demonstrated exceptional performance in generating novel and…

Materials Science · Physics 2024-06-17 Izumi Takahara , Kiyou Shibata , Teruyasu Mizoguchi

We study image inverse problems with a normalizing flow prior. Our formulation views the solution as the maximum a posteriori estimate of the image conditioned on the measurements. This formulation allows us to use noise models with…

Machine Learning · Computer Science 2021-07-02 Jay Whang , Qi Lei , Alexandros G. Dimakis

Microstructure reconstruction, a major component of inverse computational materials engineering, is currently advancing at an unprecedented rate. While various training-based and training-free approaches are developed, the majority of…

Materials Science · Physics 2022-11-28 Christian Düreth , Paul Seibert , Dennis Rücker , Stephanie Handford , Markus Kästner , Maik Gude

Phase retrieval refers to the problem of recovering an image from the magnitudes of its complex-valued linear measurements. Since the problem is ill-posed, the recovery requires prior knowledge on the unknown image. We present DOLPH as a…

Image and Video Processing · Electrical Eng. & Systems 2022-11-03 Shirin Shoushtari , Jiaming Liu , Ulugbek S. Kamilov

In this work, we utilize the high-fidelity generation abilities of diffusion models to solve blind JPEG restoration at high compression levels. We propose an elegant modification of the forward stochastic differential equation of diffusion…

Image and Video Processing · Electrical Eng. & Systems 2024-05-08 Simon Welker , Henry N. Chapman , Timo Gerkmann