中文
相关论文

相关论文: Rao-Blackwellized Score Matching on Manifolds

200 篇论文

We consider the task of estimating a low-rank matrix from non-linear and noisy observations. We prove a strong universality result showing that Bayes-optimal performances are characterized by an equivalent Gaussian model with an effective…

机器学习 · 统计学 2024-03-08 Pierre Mergny , Justin Ko , Florent Krzakala , Lenka Zdeborová

Although large language models (LLMs) have achieved great success in vast real-world applications, their vulnerabilities towards noisy inputs have significantly limited their uses, especially in high-stake environments. In these contexts,…

计算与语言 · 计算机科学 2023-07-17 Zhen Zhang , Guanhua Zhang , Bairu Hou , Wenqi Fan , Qing Li , Sijia Liu , Yang Zhang , Shiyu Chang

Plug and play (P&P) algorithms iteratively apply highly optimized image denoisers to impose priors and solve computational image reconstruction problems, to great effect. However, in general the "effective noise", that is the difference…

信号处理 · 电气工程与系统科学 2020-10-27 Christopher A. Metzler , Gordon Wetzstein

Deep noise suppressors (DNS) have become an attractive solution to remove background noise, reverberation, and distortions from speech and are widely used in telephony/voice applications. They are also occasionally prone to introducing…

声音 · 计算机科学 2022-04-15 Abu Zaher Md Faridee , Hannes Gamper

Diffusion posterior sampling conditions diffusion priors on measurements, but data-consistency updates are typically scaled by hand-tuned guidance weights and can destabilize sampling under stiff, operator-dependent curvature. We replace…

机器学习 · 计算机科学 2026-05-28 Seunghyeok Shin , Minwoo Kim , Dabin Kim , Hongki Lim

Diffusion-weighted magnetic resonance imaging (DWI) is the only noninvasive method for quantifying microstructure and reconstructing white-matter pathways in the living human brain. Fluctuations from multiple sources create significant…

机器学习 · 计算机科学 2020-11-04 Shreyas Fadnavis , Joshua Batson , Eleftherios Garyfallidis

Holographic MIMO (HMIMO) is being increasingly recognized as a key enabling technology for 6G wireless systems through the deployment of an extremely large number of antennas within a compact space to fully exploit the potentials of the…

信号处理 · 电气工程与系统科学 2024-06-18 Wentao Yu , Hengtao He , Xianghao Yu , Shenghui Song , Jun Zhang , Ross Murch , Khaled B. Letaief

Diffusion models have achieved state-of-the-art performance, demonstrating remarkable generalisation capabilities across diverse domains. However, the mechanisms underpinning these strong capabilities remain only partially understood. A…

机器学习 · 计算机科学 2025-10-03 Tyler Farghly , Peter Potaptchik , Samuel Howard , George Deligiannidis , Jakiw Pidstrigach

In this work, we focus on the alignment problem of diffusion models with a continuous reward function, which represents specific objectives for downstream tasks, such as increasing darkness or improving the aesthetics of images. The central…

机器学习 · 计算机科学 2024-10-03 Zhiwei Tang , Jiangweizhi Peng , Jiasheng Tang , Mingyi Hong , Fan Wang , Tsung-Hui Chang

Deep learning experiments by Cohen et al. [2021] using deterministic Gradient Descent (GD) revealed an Edge of Stability (EoS) phase when learning rate (LR) and sharpness (i.e., the largest eigenvalue of Hessian) no longer behave as in…

机器学习 · 计算机科学 2022-10-31 Sanjeev Arora , Zhiyuan Li , Abhishek Panigrahi

Exploring noise distributions beyond Gaussian in diffusion models remains an open challenge. While Gaussian-based models succeed within a unified SDE framework, recent studies suggest that heavy-tailed noise distributions, like…

机器学习 · 计算机科学 2025-06-18 Dario Shariatian , Umut Simsekli , Alain Durmus

We revisit the recently proposed ``self-Wiener" (SW) filtering method for robust deconvolution, and generalize it to the classical denoising problem. The resulting estimator, termed generalized SW (GSW) filtering, retains the nonlinear…

信号处理 · 电气工程与系统科学 2026-03-31 Amir Weiss

In recent years, denoising diffusion models have become a crucial area of research due to their abundance in the rapidly expanding field of generative AI. While recent statistical advances have delivered explanations for the generation…

统计理论 · 数学 2026-03-04 Asbjørn Holk , Claudia Strauch , Lukas Trottner

Diffusion-based purification (DBP) methods aim to remove adversarial noise from the input sample by first injecting Gaussian noise through a forward diffusion process, and then recovering the clean example through a reverse generative…

计算机视觉与模式识别 · 计算机科学 2026-02-16 Yuhao Sun , Jiacheng Zhang , Zesheng Ye , Chaowei Xiao , Feng Liu

Diffusion models over discrete spaces have recently shown striking empirical success, yet their theoretical foundations remain incomplete. In this paper, we study the sampling efficiency of score-based discrete diffusion models under a…

机器学习 · 计算机科学 2026-02-17 Daniil Dmitriev , Zhihan Huang , Yuting Wei

There are two major routes to address the ubiquitous family of inverse problems appearing in signal and image processing, such as denoising or deblurring. A first route relies on Bayesian modeling, where prior probabilities are used to…

统计理论 · 数学 2026-03-24 Rémi Gribonval , Mila Nikolova

We make use of recent results from random matrix theory to identify a derived threshold, for isolating noise from image features. The procedure assumes the existence of a set of noisy images, where denoising can be carried out on individual…

数据分析、统计与概率 · 物理学 2010-04-09 Gaurab Basu , Kaushik Ray , Prasanta K. Panigrahi

Denoising diffusions are state-of-the-art generative models exhibiting remarkable empirical performance. They work by diffusing the data distribution into a Gaussian distribution and then learning to reverse this noising process to obtain…

机器学习 · 统计学 2024-02-20 Joe Benton , Yuyang Shi , Valentin De Bortoli , George Deligiannidis , Arnaud Doucet

We consider a patch-based learning approach defined in terms of neural networks to estimate spatially adaptive regularisation parameter maps for image denoising with weighted Total Variation (TV) and test it to situations when the noise…

图像与视频处理 · 电气工程与系统科学 2025-06-23 Claudio Fantasia , Luca Calatroni , Xavier Descombes , Rim Rekik

Many existing conditional score-based data generation methods utilize Bayes' theorem to decompose the gradients of a log posterior density into a mixture of scores. These methods facilitate the training procedure of conditional score…