English
Related papers

Related papers: Sampling Binary Data by Denoising through Score Fu…

200 papers

Here we consider the problem of denoising features associated to complex data, modeled as signals on a graph, via a smoothness prior. This is motivated in part by settings such as single-cell RNA where the data is very high-dimensional, but…

Machine Learning · Computer Science 2023-12-12 Sam Leone , Xingzhi Sun , Michael Perlmutter , Smita Krishnaswamy

This paper develops a new mathematical framework for denoising in blind two-dimensional (2D) super-resolution upon using the atomic norm. The framework denoises a signal that consists of a weighted sum of an unknown number of time-delayed…

Information Theory · Computer Science 2023-07-19 Mohamed A. Suliman , Wei Dai

Image noise modeling is a long-standing problem with many applications in computer vision. Early attempts that propose simple models, such as signal-independent additive white Gaussian noise or the heteroscedastic Gaussian noise model…

Image and Video Processing · Electrical Eng. & Systems 2022-06-03 Ali Maleky , Shayan Kousha , Michael S. Brown , Marcus A. Brubaker

Denoising diffusion models have recently emerged as the predominant paradigm for generative modelling on image domains. In addition, their extension to Riemannian manifolds has facilitated a range of applications across the natural…

Machine Learning · Computer Science 2023-11-10 Nic Fishman , Leo Klarner , Emile Mathieu , Michael Hutchinson , Valentin de Bortoli

In this work we introduce a novel stochastic algorithm dubbed SNIPS, which draws samples from the posterior distribution of any linear inverse problem, where the observation is assumed to be contaminated by additive white Gaussian noise.…

Image and Video Processing · Electrical Eng. & Systems 2021-11-11 Bahjat Kawar , Gregory Vaksman , Michael Elad

While deep learning offers powerful capabilities for scientific research, its application is often hindered by a lack of quantitative reliability. To address this, we introduce a probabilistic denoising framework that simultaneously…

Strongly Correlated Electrons · Physics 2026-05-11 Younsik Kim , Changyoung Kim

We present SURE-Score: an approach for learning score-based generative models using training samples corrupted by additive Gaussian noise. When a large training set of clean samples is available, solving inverse problems via score-based…

Machine Learning · Computer Science 2025-04-23 Asad Aali , Marius Arvinte , Sidharth Kumar , Jonathan I. Tamir

We propose a self-supervised learning model to denoise gravitational wave (GW) signals in the time series strain data without relying on waveform information. Denoising GW data is a crucial intermediate process for machine-learning-based…

General Relativity and Quantum Cosmology · Physics 2025-03-11 Yu-Chiung Lin , Albert K. H. Kong

Denoising diffusions are state-of-the-art generative models exhibiting remarkable empirical performance. They work by diffusing the data distribution into a Gaussian distribution and then learning to reverse this noising process to obtain…

Machine Learning · Statistics 2024-02-20 Joe Benton , Yuyang Shi , Valentin De Bortoli , George Deligiannidis , Arnaud Doucet

Diffusion models have achieved remarkable success in generating samples from unknown data distributions. Most popular stochastic differential equation-based diffusion models perturb the target distribution by adding Gaussian noise,…

Machine Learning · Statistics 2026-05-20 Wenpin Tang , Nizar Touzi , Zikun Zhang , Xun Yu Zhou

The Langevin algorithm is a classic method for sampling from a given pdf in a real space. In its basic version, it only requires knowledge of the gradient of the log-density, also called the score function. However, in deep learning, it is…

Machine Learning · Computer Science 2025-09-22 Aapo Hyvärinen

We consider the problem of decomposing a higher-order tensor with binary entries. Such data problems arise frequently in applications such as neuroimaging, recommendation system, topic modeling, and sensor network localization. We propose a…

Machine Learning · Statistics 2020-09-22 Miaoyan Wang , Lexin Li

Label noise - incorrect labels assigned to observations - can substantially degrade the performance of supervised classifiers. This paper proposes a label noise cleaning method based on Bernoulli random sampling. We show that the mean label…

Methodology · Statistics 2026-03-17 Yuxin Liu , Xiong Jin , Yang Han

We propose a novel self-supervised image blind denoising approach in which two neural networks jointly predict the clean signal and infer the noise distribution. Assuming that the noisy observations are independent conditionally to the…

Machine Learning · Computer Science 2021-02-17 Jean Ollion , Charles Ollion , Elisabeth Gassiat , Luc Lehéricy , Sylvain Le Corff

Denoising score matching (DSM) provides a way to learn data distributions by training a neural network to recover the score function, defined as the gradient of the log density, from noise-corrupted samples. Once trained, the score…

Machine Learning · Computer Science 2026-05-11 Victor Livernoche , Jie Zan , Reihaneh Rabbany

We formally map the problem of sampling from an unknown distribution with a density in $\mathbb{R}^d$ to the problem of learning and sampling a smoother density in $\mathbb{R}^{Md}$ obtained by convolution with a fixed factorial kernel: the…

Machine Learning · Statistics 2022-06-17 Saeed Saremi , Rupesh Kumar Srivastava

Sampling from unnormalized densities is analogous to the generative modeling problem, but the target distribution is defined by a known energy function instead of data samples. Because evaluating the energy function is often costly, a…

Machine Learning · Computer Science 2026-05-06 Aaron Havens , Brian Karrer , Neta Shaul

Many modern applications involve the acquisition of noisy modulo samples of a function $f$, with the goal being to recover estimates of the original samples of $f$. For a Lipschitz function $f:[0,1]^d \to \mathbb{R}$, suppose we are given…

Statistics Theory · Mathematics 2021-05-04 Michaël Fanuel , Hemant Tyagi

We consider continuous-time sparse stochastic processes from which we have only a finite number of noisy/noiseless samples. Our goal is to estimate the noiseless samples (denoising) and the signal in-between (interpolation problem). By…

Machine Learning · Computer Science 2015-06-11 Arash Amini , Ulugbek S. Kamilov , Emrah Bostan , Michael Unser

We propose a novel approach to video anomaly detection: we treat feature vectors extracted from videos as realizations of a random variable with a fixed distribution and model this distribution with a neural network. This lets us estimate…

Computer Vision and Pattern Recognition · Computer Science 2024-03-22 Jakub Micorek , Horst Possegger , Dominik Narnhofer , Horst Bischof , Mateusz Kozinski