English
Related papers

Related papers: Rao-Blackwellized Score Matching on Manifolds

200 papers

We consider the task of estimating a low-rank matrix from non-linear and noisy observations. We prove a strong universality result showing that Bayes-optimal performances are characterized by an equivalent Gaussian model with an effective…

Machine Learning · Statistics 2024-03-08 Pierre Mergny , Justin Ko , Florent Krzakala , Lenka Zdeborová

Although large language models (LLMs) have achieved great success in vast real-world applications, their vulnerabilities towards noisy inputs have significantly limited their uses, especially in high-stake environments. In these contexts,…

Computation and Language · Computer Science 2023-07-17 Zhen Zhang , Guanhua Zhang , Bairu Hou , Wenqi Fan , Qing Li , Sijia Liu , Yang Zhang , Shiyu Chang

Plug and play (P&P) algorithms iteratively apply highly optimized image denoisers to impose priors and solve computational image reconstruction problems, to great effect. However, in general the "effective noise", that is the difference…

Signal Processing · Electrical Eng. & Systems 2020-10-27 Christopher A. Metzler , Gordon Wetzstein

Deep noise suppressors (DNS) have become an attractive solution to remove background noise, reverberation, and distortions from speech and are widely used in telephony/voice applications. They are also occasionally prone to introducing…

Sound · Computer Science 2022-04-15 Abu Zaher Md Faridee , Hannes Gamper

Diffusion posterior sampling conditions diffusion priors on measurements, but data-consistency updates are typically scaled by hand-tuned guidance weights and can destabilize sampling under stiff, operator-dependent curvature. We replace…

Machine Learning · Computer Science 2026-05-28 Seunghyeok Shin , Minwoo Kim , Dabin Kim , Hongki Lim

Diffusion-weighted magnetic resonance imaging (DWI) is the only noninvasive method for quantifying microstructure and reconstructing white-matter pathways in the living human brain. Fluctuations from multiple sources create significant…

Machine Learning · Computer Science 2020-11-04 Shreyas Fadnavis , Joshua Batson , Eleftherios Garyfallidis

Holographic MIMO (HMIMO) is being increasingly recognized as a key enabling technology for 6G wireless systems through the deployment of an extremely large number of antennas within a compact space to fully exploit the potentials of the…

Signal Processing · Electrical Eng. & Systems 2024-06-18 Wentao Yu , Hengtao He , Xianghao Yu , Shenghui Song , Jun Zhang , Ross Murch , Khaled B. Letaief

Diffusion models have achieved state-of-the-art performance, demonstrating remarkable generalisation capabilities across diverse domains. However, the mechanisms underpinning these strong capabilities remain only partially understood. A…

Machine Learning · Computer Science 2025-10-03 Tyler Farghly , Peter Potaptchik , Samuel Howard , George Deligiannidis , Jakiw Pidstrigach

In this work, we focus on the alignment problem of diffusion models with a continuous reward function, which represents specific objectives for downstream tasks, such as increasing darkness or improving the aesthetics of images. The central…

Machine Learning · Computer Science 2024-10-03 Zhiwei Tang , Jiangweizhi Peng , Jiasheng Tang , Mingyi Hong , Fan Wang , Tsung-Hui Chang

Deep learning experiments by Cohen et al. [2021] using deterministic Gradient Descent (GD) revealed an Edge of Stability (EoS) phase when learning rate (LR) and sharpness (i.e., the largest eigenvalue of Hessian) no longer behave as in…

Machine Learning · Computer Science 2022-10-31 Sanjeev Arora , Zhiyuan Li , Abhishek Panigrahi

Exploring noise distributions beyond Gaussian in diffusion models remains an open challenge. While Gaussian-based models succeed within a unified SDE framework, recent studies suggest that heavy-tailed noise distributions, like…

Machine Learning · Computer Science 2025-06-18 Dario Shariatian , Umut Simsekli , Alain Durmus

We revisit the recently proposed ``self-Wiener" (SW) filtering method for robust deconvolution, and generalize it to the classical denoising problem. The resulting estimator, termed generalized SW (GSW) filtering, retains the nonlinear…

Signal Processing · Electrical Eng. & Systems 2026-03-31 Amir Weiss

In recent years, denoising diffusion models have become a crucial area of research due to their abundance in the rapidly expanding field of generative AI. While recent statistical advances have delivered explanations for the generation…

Statistics Theory · Mathematics 2026-03-04 Asbjørn Holk , Claudia Strauch , Lukas Trottner

Diffusion-based purification (DBP) methods aim to remove adversarial noise from the input sample by first injecting Gaussian noise through a forward diffusion process, and then recovering the clean example through a reverse generative…

Computer Vision and Pattern Recognition · Computer Science 2026-02-16 Yuhao Sun , Jiacheng Zhang , Zesheng Ye , Chaowei Xiao , Feng Liu

Diffusion models over discrete spaces have recently shown striking empirical success, yet their theoretical foundations remain incomplete. In this paper, we study the sampling efficiency of score-based discrete diffusion models under a…

Machine Learning · Computer Science 2026-02-17 Daniil Dmitriev , Zhihan Huang , Yuting Wei

There are two major routes to address the ubiquitous family of inverse problems appearing in signal and image processing, such as denoising or deblurring. A first route relies on Bayesian modeling, where prior probabilities are used to…

Statistics Theory · Mathematics 2026-03-24 Rémi Gribonval , Mila Nikolova

We make use of recent results from random matrix theory to identify a derived threshold, for isolating noise from image features. The procedure assumes the existence of a set of noisy images, where denoising can be carried out on individual…

Data Analysis, Statistics and Probability · Physics 2010-04-09 Gaurab Basu , Kaushik Ray , Prasanta K. Panigrahi

Denoising diffusions are state-of-the-art generative models exhibiting remarkable empirical performance. They work by diffusing the data distribution into a Gaussian distribution and then learning to reverse this noising process to obtain…

Machine Learning · Statistics 2024-02-20 Joe Benton , Yuyang Shi , Valentin De Bortoli , George Deligiannidis , Arnaud Doucet

We consider a patch-based learning approach defined in terms of neural networks to estimate spatially adaptive regularisation parameter maps for image denoising with weighted Total Variation (TV) and test it to situations when the noise…

Image and Video Processing · Electrical Eng. & Systems 2025-06-23 Claudio Fantasia , Luca Calatroni , Xavier Descombes , Rim Rekik

Many existing conditional score-based data generation methods utilize Bayes' theorem to decompose the gradients of a log posterior density into a mixture of scores. These methods facilitate the training procedure of conditional score…

Machine Learning · Computer Science 2022-03-29 Chen-Hao Chao , Wei-Fang Sun , Bo-Wun Cheng , Yi-Chen Lo , Chia-Che Chang , Yu-Lun Liu , Yu-Lin Chang , Chia-Ping Chen , Chun-Yi Lee