English
Related papers

Related papers: On strict sub-Gaussianity, optimal proxy variance …

200 papers

The article presents a systematic study of the problem of conditioning a Gaussian random variable $\xi$ on nonlinear observations of the form $F \circ \phi(\xi)$ where $\phi: \mathcal{X} \to \mathbb{R}^N$ is a bounded linear operator and…

Machine Learning · Statistics 2024-05-24 Yifan Chen , Bamdad Hosseini , Houman Owhadi , Andrew M Stuart

We investigate the conditional distributions of two Banach space valued, jointly Gaussian random variables. In particular, we show that these conditional distributions are again Gaussian and that their means and covariances can be…

Probability · Mathematics 2025-02-25 Ingo Steinwart

An important tool to quantify the likeness of two probability measures are f-divergences, which have seen widespread application in statistics and information theory. An example is the total variation, which plays an exceptional role among…

Probability · Mathematics 2009-03-11 Jochen Bröcker

To quantify the dependence between two random vectors of possibly different dimensions, we propose to rely on the properties of the 2-Wasserstein distance. We first propose two coefficients that are based on the Wasserstein distance between…

Statistics Theory · Mathematics 2021-10-19 Gilles Mordant , Johan Segers

The goal in thinning is to summarize a dataset using a small set of representative points. Remarkably, sub-Gaussian thinning algorithms like Kernel Halving and Compress can match the quality of uniform subsampling while substantially…

Machine Learning · Statistics 2026-03-03 Annabelle Michael Carrell , Albert Gong , Abhishek Shetty , Raaz Dwivedi , Lester Mackey

For many important problems the quantity of interest is an unknown function of the parameters, which is a random vector with known statistics. Since the dependence of the output on this random vector is unknown, the challenge is to identify…

Machine Learning · Statistics 2021-04-28 Themistoklis P. Sapsis

The non-asymptotic analysis of Stochastic Gradient Descent (SGD) typically yields bounds that decompose into a bias term and a variance term. In this work, we focus on the bias component and study the extent to which SGD can match the…

Optimization and Control · Mathematics 2026-02-02 Daniel Cortild , Lucas Ketels , Juan Peypouquet , Guillaume Garrigos

Measures of the non-Gaussianity of a random field depend on how accurately one is able to measure the field. If a signal measured at a certain point is to be averaged with its surroundings, or coarse-grained, the magnitude of its…

Statistical Mechanics · Physics 2015-06-18 T. H. Beuman , A. M. Turner , V. Vitelli

Dependency networks (Heckerman et al., 2000) provide a flexible framework for modeling complex systems with many variables by combining independently learned local conditional distributions through pseudo-Gibbs sampling. Despite their…

Machine Learning · Computer Science 2026-04-02 Kazuya Takabatake , Shotaro Akaho

Given a stream of Bernoulli random variables, consider the problem of estimating the mean of the random variable within a specified relative error with a specified probability of failure. Until now, the Gamma Bernoulli Approximation Scheme…

Machine Learning · Computer Science 2022-10-25 Mark Huber

We introduce a new discrepancy score between two distributions that gives an indication on their similarity. While much research has been done to determine if two samples come from exactly the same distribution, much less research…

Machine Learning · Computer Science 2012-10-16 Maayan Harel , Shie Mannor

Gaussian random fields pervade all areas of science. However, it is often the departures from Gaussianity that carry the crucial signature of the nonlinear mechanisms at the heart of diverse phenomena, ranging from structure formation in…

Statistical Mechanics · Physics 2015-06-05 T. H. Beuman , A. M. Turner , V. Vitelli

We consider the problem of identifying the parameters of an unknown mixture of two arbitrary $d$-dimensional gaussians from a sequence of independent random samples. Our main results are upper and lower bounds giving a computationally…

Machine Learning · Computer Science 2015-05-19 Moritz Hardt , Eric Price

We consider the estimation problem for jointly stable random variables. Under two specific dependency models: a linear transformation of two independent stable variables and a sub-Gaussian symmetric $\alpha$-stable (S$\alpha$S) vector, we…

Information Theory · Computer Science 2026-01-15 Rayan Chouity , Charbel Hannoun , Jihad Fahs , Ibrahim Abou-Faycal

We consider general Gaussian latent tree models in which the observed variables are not restricted to be leaves of the tree. Extending related recent work, we give a full semi-algebraic description of the set of covariance matrices of any…

Statistics Theory · Mathematics 2018-10-30 Dennis Leung , Mathias Drton

We investigate the convergence of series of random variables with second exponential moments. We give sufficient conditions for the convergence of these series with respect to an exponential Orlicz norm and almost surely. Applying this…

Probability · Mathematics 2017-08-22 Fakhreddine Boukhari , Dounyazed Malti

Introducing inequality constraints in Gaussian process (GP) models can lead to more realistic uncertainties in learning a great variety of real-world problems. We consider the finite-dimensional Gaussian approach from Maatouk and Bay (2017)…

Machine Learning · Statistics 2021-11-04 Andrés F. López-Lopera , François Bachoc , Nicolas Durrande , Olivier Roustant

Let $X$ be a random variable with unknown mean and finite variance. We present a new estimator of the mean of $X$ that is robust with respect to the possible presence of outliers in the sample, provides tight sub-Gaussian deviation…

Statistics Theory · Mathematics 2022-01-03 Stanislav Minsker , Mohamed Ndaoud

We study when a given Gaussian random variable on a given probability space $(\Omega, {\cal{F}}, P) $ is equal almost surely to $\beta_{1}$ where $\beta $ is a Brownian motion defined on the same (or possibly extended) probability space. As…

Probability · Mathematics 2009-08-24 Ciprian Tudor

Skewness is often present in a wide range of spatial prediction problems, and modeling it in the spatial context remains a challenging problem. In this study a skew-Gaussian random field is considered. The skew-Gaussian random field is…

Methodology · Statistics 2014-02-06 Kjartan Rimstad , Henning Omre