English
Related papers

Related papers: Generalization error bound for denoising score mat…

200 papers

The multivariate linear regression model with shuffled data and additive Gaussian noise arises in various correspondence estimation and matching problems. Focusing on the denoising aspect of this problem, we provide a characterization the…

Machine Learning · Statistics 2017-04-26 Ashwin Pananjady , Martin J. Wainwright , Thomas A. Courtade

Confidence measures for the generalization error are crucial when small training samples are used to construct classifiers. A common approach is to estimate the generalization error by resampling and then assume the resampled estimator…

Machine Learning · Computer Science 2012-06-18 Eric B. Laber , Susan A. Murphy

We consider drawing statistical inferences based on data subject to non-Gaussian measurement error. Unlike most existing methods developed under the assumption of Gaussian measurement error, the proposed strategy exploits hypercomplex…

Methodology · Statistics 2025-05-06 Nicholas W. Woolsey , Xianzheng Huang

Denoising diffusion models are a popular class of generative models providing state-of-the-art results in many domains. One adds gradually noise to data using a diffusion to transform the data distribution into a Gaussian distribution.…

Machine Learning · Computer Science 2023-08-21 Francisco Vargas , Will Grathwohl , Arnaud Doucet

We study zero-shot conditional sampling with pretrained diffusion models for linear inverse problems, including inpainting and super-resolution. In these problems, the observation determines only part of the unknown signal. The remaining…

Machine Learning · Computer Science 2026-05-08 Ahmad Aghapour , Erhan Bayraktar , Asaf Cohen

We obtain a denoising loss bound of the recently proposed neural network based universal discrete denoiser, Neural DUDE, which can adaptively learn its parameters solely from the noise-corrupted data, by minimizing the \emph{empirical…

Machine Learning · Computer Science 2018-02-27 Taesup Moon

Score-based generative models achieve state-of-the-art sampling performance by denoising a distribution perturbed by Gaussian noise. In this paper, we focus on a single deterministic denoising step, and compare the optimal denoiser for the…

Machine Learning · Computer Science 2026-03-18 Eliot Beyler , Francis Bach

Many high-dimensional data sets suffer from hidden confounding which affects both the predictors and the response of interest. In such situations, standard regression methods or algorithms lead to biased estimates. This paper substantially…

Methodology · Statistics 2024-12-17 Cyrill Scheidegger , Zijian Guo , Peter Bühlmann

Although continuous density estimation has received abundant attention in the Bayesian nonparametrics literature, there is limited theory on multivariate mixed scale density estimation. In this note, we consider a general framework to…

Statistics Theory · Mathematics 2014-05-26 Antonio Canale , David B. Dunson

Over the past ten years, propensity score methods have made an important contribution to improving generalizations from studies that do not select samples randomly from a population of inference. However, these methods require assumptions…

Methodology · Statistics 2021-01-26 Wendy Chan

We derive a novel information-theoretic analysis of the generalization property of meta-learning algorithms. Concretely, our analysis proposes a generic understanding of both the conventional learning-to-learn framework and the modern…

Machine Learning · Computer Science 2021-12-13 Qi Chen , Changjian Shui , Mario Marchand

We present some results of geometric convergence of level sets for solutions of total variation denoising as the regularization parameter tends to zero. The common feature among them is that they make use of explicit constructions of…

Optimization and Control · Mathematics 2021-03-24 José A. Iglesias , Gwenael Mercier

Many existing conditional score-based data generation methods utilize Bayes' theorem to decompose the gradients of a log posterior density into a mixture of scores. These methods facilitate the training procedure of conditional score…

Machine Learning · Computer Science 2022-03-29 Chen-Hao Chao , Wei-Fang Sun , Bo-Wun Cheng , Yi-Chen Lo , Chia-Che Chang , Yu-Lun Liu , Yu-Lin Chang , Chia-Ping Chen , Chun-Yi Lee

Though achieving excellent performance in some cases, current unsupervised learning methods for single image denoising usually have constraints in applications. In this paper, we propose a new approach which is more general and applicable…

Computer Vision and Pattern Recognition · Computer Science 2023-04-18 Yutong Xie , Mingze Yuan , Bin Dong , Quanzheng Li

Bounds of the accuracy of the normal approximation to the distribution of a sum of independent random variables are improved under relaxed moment conditions, in particular, under the absence of moments of orders higher than the second.…

Probability · Mathematics 2015-07-06 V. Yu. Korolev , A. V. Dorofeeva

Algorithm unfolding or unrolling is the technique of constructing a deep neural network (DNN) from an iterative algorithm. Unrolled DNNs often provide better interpretability and superior empirical performance over standard DNNs in signal…

Machine Learning · Statistics 2024-02-21 Carter Lyons , Raghu G. Raj , Margaret Cheney

Compressed sensing with subsampled unitary matrices benefits from \emph{optimized} sampling schemes, which feature improved theoretical guarantees and empirical performance relative to uniform subsampling. We provide, in a first of its kind…

Machine Learning · Statistics 2025-04-03 Yaniv Plan , Matthew S. Scott , Xia Sheng , Ozgur Yilmaz

In this paper, the maximum spacing method is considered for multivariate observations. Nearest neighbour balls are used as a multidimensional analogue to univariate spacings. A class of information-type measures is used to generalize the…

Statistics Theory · Mathematics 2019-04-19 Kristi Kuljus , Bo Ranneby

In this work we study generalization guarantees for the metric learning problem, where the metric is induced by a neural network type embedding of the data. Specifically, we provide uniform generalization bounds for two regimes -- the…

Machine Learning · Computer Science 2021-02-09 Mark Kozdoba , Shie Mannor

While score-based generative models (SGMs) have achieved remarkable success in enormous image generation tasks, their mathematical foundations are still limited. In this paper, we analyze the approximation and generalization of SGMs in…

Machine Learning · Statistics 2024-02-26 Frank Cole , Yulong Lu