English
Related papers

Related papers: Patch-Based Diffusion Models Beat Whole-Image Mode…

200 papers

Score-based diffusion models achieve state-of-the-art performance for inverse problems, but their practical deployment is hindered by long inference times and cumbersome hyperparameter tuning. While pretrained diffusion models can be reused…

Computer Vision and Pattern Recognition · Computer Science 2026-05-13 Julio Oscanoa , Irmak Sivgin , Cagan Alkan , Daniel Ennis , John Pauly , Mert Pilanci , Shreyas Vasanawala

We present a principled approach for detecting out-of-distribution (OOD) and adversarial samples in deep neural networks. Our approach consists in modeling the outputs of the various layers (deep features) with parametric probability…

Machine Learning · Statistics 2019-09-27 Nilesh A. Ahuja , Ibrahima Ndiour , Trushant Kalyanpur , Omesh Tickoo

To detect distribution shifts and improve model safety, many out-of-distribution (OOD) detection methods rely on the predictive uncertainty or features of supervised models trained on in-distribution data. In this paper, we critically…

Machine Learning · Computer Science 2025-07-03 Yucen Lily Li , Daohan Lu , Polina Kirichenko , Shikai Qiu , Tim G. J. Rudner , C. Bayan Bruss , Andrew Gordon Wilson

Diffusion probabilistic models excel at sampling new images from learned distributions. Originally motivated by drift-diffusion concepts from physics, they apply image perturbations such as noise and blur in a forward process that results…

Image and Video Processing · Electrical Eng. & Systems 2024-06-07 Pascal Peter

Pretrained Transformers achieve remarkable performance when training and test data are from the same distribution. However, in real-world scenarios, the model often faces out-of-distribution (OOD) instances that can cause severe semantic…

Computation and Language · Computer Science 2022-01-24 Wenxuan Zhou , Fangyu Liu , Muhao Chen

Recent studies demonstrate that diffusion models can serve as a strong prior for solving inverse problems. A prominent example is Diffusion Posterior Sampling (DPS), which approximates the posterior distribution of data given the measure…

Machine Learning · Statistics 2024-09-16 Yaxuan Zhu , Zehao Dou , Haoxin Zheng , Yasi Zhang , Ying Nian Wu , Ruiqi Gao

Diffusion models have attained prominence for their ability to synthesize a probability distribution for a given dataset via a diffusion process, enabling the generation of new data points with high fidelity. However, diffusion processes…

Machine Learning · Computer Science 2024-11-25 Shervin Khalafi , Dongsheng Ding , Alejandro Ribeiro

Inverse problems are fundamental to science and engineering, where the goal is to infer an underlying signal or state from incomplete or noisy measurements. Recent approaches employ diffusion models as powerful implicit priors for such…

Machine Learning · Computer Science 2025-11-27 Bilal Ahmed , Joseph G. Makin

Recent object detectors have achieved impressive accuracy in identifying objects seen during training. However, real-world deployment often introduces novel and unexpected objects, referred to as out-of-distribution (OOD) objects, posing…

Machine Learning · Computer Science 2025-11-20 Quang-Huy Nguyen , Jin Peng Zhou , Zhenzhen Liu , Khanh-Huyen Bui , Kilian Q. Weinberger , Wei-Lun Chao , Dung D. Le

Diffuse optical tomography (DOT) utilises near-infrared light for imaging spatially distributed optical parameters, typically the absorption and scattering coefficients. The image reconstruction problem of DOT is an ill-posed inverse…

Computational Physics · Physics 2021-12-15 Meghdoot Mozumder , Andreas Hauptmann , Ilkka Nissilä , Simon R. Arridge , Tanja Tarvainen

Out-of-distribution (OOD) detection is crucial for deploying robust machine learning models, especially in areas where security is critical. However, traditional OOD detection methods often fail to capture complex data distributions from…

Computer Vision and Pattern Recognition · Computer Science 2024-08-22 Armando Zhu , Jiabei Liu , Keqin Li , Shuying Dai , Bo Hong , Peng Zhao , Changsong Wei

Recent advancements in diffusion models have been effective in learning data priors for solving inverse problems. They leverage diffusion sampling steps for inducing a data prior while using a measurement guidance gradient at each step to…

Machine Learning · Computer Science 2025-04-02 Rayhan Zirvi , Bahareh Tolooshams , Anima Anandkumar

In the ever-evolving adversarial machine learning landscape, developing effective defenses against patch attacks has become a critical challenge, necessitating reliable solutions to safeguard real-world AI systems. Although diffusion models…

Computer Vision and Pattern Recognition · Computer Science 2024-11-15 Jia Fu , Xiao Zhang , Sepideh Pashami , Fatemeh Rahimian , Anders Holst

Out-of-distribution (OOD) detection is crucial for safely deploying automated medical image analysis systems, as abnormal patterns in images could hamper their performance. However, OOD detection in medical imaging remains an open…

Image and Video Processing · Electrical Eng. & Systems 2025-09-18 Evi M. C. Huijben , Sina Amirrajab , Josien P. W. Pluim

Diffusion models have been increasingly used as strong generative priors for solving inverse problems such as super-resolution in medical imaging. However, these approaches typically utilize a diffusion prior trained at a single scale,…

Image and Video Processing · Electrical Eng. & Systems 2026-02-02 Darshan Thaker , Mahmoud Mostapha , Radu Miron , Shihan Qiu , Mariappan Nadar

Diffusion models have made remarkable progress in solving various inverse problems, attributing to the generative modeling capability of the data manifold. Posterior sampling from the conditional score function enable the precious data…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Jinghao Zhang , Zizheng Yang , Qi Zhu , Feng Zhao

We present the first framework to solve linear inverse problems leveraging pre-trained latent diffusion models. Previously proposed algorithms (such as DPS and DDRM) only apply to pixel-space diffusion models. We theoretically analyze our…

Machine Learning · Computer Science 2023-07-04 Litu Rout , Negin Raoof , Giannis Daras , Constantine Caramanis , Alexandros G. Dimakis , Sanjay Shakkottai

Diffusion model has emerged as the \emph{de-facto} model for image generation, yet the heavy training overhead hinders its broader adoption in the research community. We observe that diffusion models are commonly trained to learn all…

Computer Vision and Pattern Recognition · Computer Science 2023-11-29 Jiachen Lei , Qinglong Wang , Peng Cheng , Zhongjie Ba , Zhan Qin , Zhibo Wang , Zhenguang Liu , Kui Ren

Recent developments in diffusion models have advanced conditioned image generation, yet they struggle with reconstructing out-of-distribution (OOD) images, such as unseen tumors in medical images, causing "image hallucination" and risking…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Seunghoi Kim , Chen Jin , Tom Diethe , Matteo Figini , Henry F. J. Tregidgo , Asher Mullokandov , Philip Teare , Daniel C. Alexander

We present the first diffusion-based framework that can learn an unknown distribution using only highly-corrupted samples. This problem arises in scientific applications where access to uncorrupted samples is impossible or expensive to…

Machine Learning · Computer Science 2023-05-31 Giannis Daras , Kulin Shah , Yuval Dagan , Aravind Gollakota , Alexandros G. Dimakis , Adam Klivans