English
Related papers

Related papers: Predictive Distributions and the Transition from S…

200 papers

This work explores the theoretical and practical foundations of denoising diffusion probabilistic models (DDPMs) and score-based generative models, which leverage stochastic processes and Brownian motion to model complex data distributions.…

Machine Learning · Computer Science 2024-12-30 Jathin Korrapati , Tanish Baranwal , Rahul Shah

Neural networks and other machine learning models compute continuous representations, while humans communicate mostly through discrete symbols. Reconciling these two forms of communication is desirable for generating human-readable…

Machine Learning · Computer Science 2022-02-14 António Farinhas , Wilker Aziz , Vlad Niculae , André F. T. Martins

We consider inference for the mean and covariance functions of covariate adjusted functional data using Local Linear Kernel (LLK) estimators. By means of a double asymptotic, we differentiate between sparse and dense covariate adjusted…

Methodology · Statistics 2018-02-28 Dominik Liebl

Gaussian processes (GPs) are widely used in nonparametric regression, classification and spatio-temporal modeling, motivated in part by a rich literature on theoretical properties. However, a well known drawback of GPs that limits their use…

Methodology · Statistics 2011-06-29 Anjishnu Banerjee , David Dunson , Surya Tokdar

Topic sparsity refers to the observation that individual documents usually focus on several salient topics instead of covering a wide variety of topics, and a real topic adopts a narrow range of terms instead of a wide coverage of the…

Machine Learning · Computer Science 2018-11-29 Tianyi Lin , Zhiyue Hu , Xin Guo

Missing values are common in many real-life datasets. However, most of the current machine learning methods can not handle missing values. This means that they should be imputed beforehand. Gaussian Processes (GPs) are non-parametric models…

Functional data are typically modeled as sample paths of smooth stochastic processes in order to mitigate the fact that they are often observed discretely and noisily, occasionally irregularly and sparsely. The smoothness assumption is…

Methodology · Statistics 2021-12-23 Neda Mohammadi , Victor M. Panaretos

Given a single observation from a Gaussian distribution with unknown mean $\theta$, we design computationally efficient procedures that can approximately generate an observation from a different target distribution $Q_{\theta}$ uniformly…

Statistics Theory · Mathematics 2025-10-09 Mengqi Lou , Guy Bresler , Ashwin Pananjady

We introduce a universal diffusion-based downscaling framework that lifts deterministic low-resolution weather forecasts into probabilistic high-resolution predictions without any model-specific fine-tuning. A single conditional diffusion…

Machine Learning · Computer Science 2026-04-21 Roberto Molinaro , Niall Siegenheim , Henry Martin , Mark Frey , Niels Poulsen , Philipp Seitz , Marvin Vincent Gabler

The quantum statistical parton distributions approach proposed more than one decade ago is revisited by considering a larger set of recent and accurate Deep Inelastic Scattering experimental results. It enables us to improve the description…

High Energy Physics - Phenomenology · Physics 2015-12-09 Claude Bourrely , Jacques Soffer

This paper proposes using a sparse-structured multivariate Gaussian to provide a closed-form approximator for the output of probabilistic ensemble models used for dense image prediction tasks. This is achieved through a convolutional neural…

Computer Vision and Pattern Recognition · Computer Science 2022-03-30 Ivor J. A. Simpson , Sara Vicente , Neill D. F. Campbell

Gaussian processes are the leading class of distributions on random functions, but they suffer from well known issues including difficulty scaling and inflexibility with respect to certain shape constraints (such as nonnegativity). Here we…

Motivated by distributed machine learning settings such as Federated Learning, we consider the problem of fitting a statistical model across a distributed collection of heterogeneous data sets whose similarity structure is encoded by a…

Statistics Theory · Mathematics 2021-11-30 Dominic Richards , Sahand N. Negahban , Patrick Rebeschini

We study uniform consistency in nonparametric mixture models as well as closely related mixture of regression (also known as mixed regression) models, where the regression functions are allowed to be nonparametric and the error…

Statistics Theory · Mathematics 2022-12-29 Bryon Aragam , Ruiyi Yang

Gaussian processes are flexible function approximators, with inductive biases controlled by a covariance kernel. Learning the kernel is the key to representation learning and strong predictive performance. In this paper, we develop…

Machine Learning · Computer Science 2019-10-31 Gregory W. Benton , Wesley J. Maddox , Jayson P. Salkey , Julio Albinati , Andrew Gordon Wilson

A distributed inference scheme which uses bounded transmission functions over a Gaussian multiple access channel is considered. When the sensor measurements are decreasingly reliable as a function of the sensor index, the conditions on the…

Distributed, Parallel, and Cluster Computing · Computer Science 2015-06-16 Sivaraman Dasarathan , Cihan Tepedelenlioglu

The quantum statistical parton distributions approach proposed more than one decade ago is revisited by considering a larger set of recent and accurate Deep Inelastic Scattering experimental results. It enables us to improve the description…

High Energy Physics - Phenomenology · Physics 2015-10-22 Jacques Soffer , Claude Bourrely

It has been observed in numerous experiments, simulations, and various theoretical treatments that the spreading of particles can be modeled by the continuous-time random walk. We consider two well-known cases, i.e., Gaussian displacements…

Statistical Mechanics · Physics 2026-01-21 Wanli Wang , Kaixin Zhang , Yuda Cheng

Nonparametric regression for massive numbers of samples (n) and features (p) is an increasingly important problem. In big n settings, a common strategy is to partition the feature space, and then separately apply simple models to each…

Machine Learning · Statistics 2014-06-10 Rajarshi Guhaniyogi , David B. Dunson

The proposed approach extends the confidence posterior distribution to the semi-parametric empirical Bayes setting. Whereas the Bayesian posterior is defined in terms of a prior distribution conditional on the observed data, the confidence…

Methodology · Statistics 2012-05-02 David R. Bickel