English
Related papers

Related papers: Concentration Inequalities and Moment Bounds for S…

200 papers

This work studies finite sample approximations of the exact and entropic regularized Wasserstein distances between centered Gaussian processes and, more generally, covariance operators of functional random processes. We first show that…

Machine Learning · Statistics 2021-04-27 Minh Ha Quang

By the continuous mapping theorem, if a sequence of $d$-dimensional random vectors $(\mathbf{W}_n)_{n\geq1}$ converges in distribution to a multivariate normal random variable $\Sigma^{1/2}\mathbf{Z}$, then the sequence of random variables…

Probability · Mathematics 2020-03-18 Robert E. Gaunt

This paper studies the problem of estimating the covariance of a collection of vectors using only highly compressed measurements of each vector. An estimator based on back-projections of these compressive samples is proposed and analyzed. A…

Machine Learning · Statistics 2019-01-16 Martin Azizyan , Akshay Krishnamurthy , Aarti Singh

Let $U_1, \ldots, U_n$ be a collection of commuting measure preserving transformations on a probability space $(\Omega, \Sigma, \mu)$. Associated with these measure preserving transformations is the ergodic strong maximal operator $\mathsf…

Classical Analysis and ODEs · Mathematics 2016-12-05 Paul A. Hagelstein , Ioannis Parissis

This study aims at contributing to lower bounds for empirical compatibility constants or empirical restricted eigenvalues. This is of importance in compressed sensing and theory for $\ell_1$-regularized estimators. Let $X$ be an $n \times…

Statistics Theory · Mathematics 2014-11-11 Sara van de Geer , Alan Muro

The spectral shift function \xi_{L}(E) for a Schr\"odinger operator restricted to a finite cube of length L in multi-dimensional Euclidean space, with Dirichlet boundary conditions, counts the number of eigenvalues less than or equal to E…

Mathematical Physics · Physics 2013-02-25 Peter D. Hislop , Peter Müller

An infinite urn scheme is defined by a probability mass function $(p_j)_{j\geq1}$ over positive integers. A random allocation consists of a sample of $N$ independent drawings according to this probability distribution where $N$ may be…

Statistics Theory · Mathematics 2016-09-29 Anna Ben-Hamou , Stéphane Boucheron , Mesrob I. Ohannessian

Let $A$ be an $n\times n$ matrix with mutually independent centered Gaussian entries. Define \begin{align*} \sigma^*:=\max\limits_{i,j\leq n}\sqrt{{\mathbb E}\,|A_{i,j}|^2}, \quad \sigma:=\max\bigg(\max\limits_{j\leq n}\sqrt{{\mathbb…

Probability · Mathematics 2023-07-26 Konstantin Tikhomirov

Choosing models from a hypothesis space is a frequent task in approximation theory and inverse problems. Cross-validation is a classical tool in the learner's repertoire to compare the goodness of fit for different reconstruction models.…

Numerical Analysis · Mathematics 2022-02-24 Felix Bartel , Ralf Hielscher

Let $n$ be a sufficiently large natural number and let $B$ be an origin-symmetric convex body in $R^n$ in the $\ell$-position, and such that the normed space $(R^n,\|\cdot\|_B)$ admits a $1$-unconditional basis. Then for any…

Metric Geometry · Mathematics 2017-02-21 Konstantin Tikhomirov

Generalization under distribution shift remains a core challenge in modern machine learning, yet existing learning bound theory is limited to narrow, idealized settings and is non-estimable from samples. In this paper, we bridge the gap…

Machine Learning · Statistics 2025-08-25 Hongbo Chen , Li Charlie Xia

Many physical and mathematical models involve random fields in their input data. Examples are ordinary differential equations, partial differential equations and integro--differential equations with uncertainties in the coefficient…

Numerical Analysis · Mathematics 2021-12-07 Michael Griebel , Guanglian Li , Christian Rieger

Given a large set $U$ where each item $a\in U$ has weight $w(a)$, we want to estimate the total weight $W=\sum_{a\in U} w(a)$ to within factor of $1\pm\varepsilon$ with some constant probability $>1/2$. Since $n=|U|$ is large, we want to do…

Data Structures and Algorithms · Computer Science 2021-10-29 Lorenzo Beretta , Jakub Tětek

Given a positive operator-valued measure $\nu$ acting on the Borel sets of a locally compact Hausdorff space $X$, with outcomes in the algebra $\mathcal B(\mathcal H)$ of all bounded operators on a (possibly infinite-dimensional) Hilbert…

Functional Analysis · Mathematics 2022-01-31 Sarah Plosker , Christopher Ramsey

We consider upper bounds for the approximation error E|g(X)-g(\hat X)|^p, where X and \hat X are random variables such that \hat X is an approximation of X in the L_p-norm, and the function g belongs to certain function classes, which…

Probability · Mathematics 2007-12-24 Rainer Avikainen

We consider Gaussian measures $\mu, \tilde{\mu}$ on a separable Hilbert space, with fractional-order covariance operators $A^{-2\beta}$ resp. $\tilde{A}^{-2\tilde{\beta}}$, and derive necessary and sufficient conditions on $A, \tilde{A}$…

Probability · Mathematics 2023-07-19 David Bolin , Kristin Kirchner

We establish a strong law of large numbers and a central limit theorem in the Bures-Wasserstein space of covariance operators -- or equivalently centred Gaussian measures -- over a general separable Hilbert space. Specifically, we show that…

Probability · Mathematics 2024-11-05 Leonardo V. Santoro , Victor M. Panaretos

The Expectation Maximization (EM) algorithm is of key importance for inference in latent variable models including mixture of regressors and experts, missing observations. This paper introduces a novel EM algorithm, called…

Machine Learning · Computer Science 2020-12-04 Gersende Fort , Eric Moulines , Hoi-To Wai

Estimating high-dimensional covariance matrices is a key task across many fields. This paper explores the theoretical limits of distributed covariance estimation in a feature-split setting, where communication between agents is constrained.…

Machine Learning · Statistics 2025-07-24 Mohammad Reza Rahmani , Mohammad Hossein Yassaee , Mohammad Reza Aref

Averaged operators have played an important role in fixed point theory in Hilbert spaces. They emerged as a necessity to obtain solutions to fixed point problems where the underlying operator is not contractive and thus renders Banach fixed…

Functional Analysis · Mathematics 2025-03-11 Arian Berdellima