English
Related papers

Related papers: Exact bounds for some quadratic empirical processe…

200 papers

Let $\{X(t) : t \in [0, \infty) \}$ be a centered stationary Gaussian process. We study the exact asymptotics of $\pr (\sup_{s \in [0,T]} X(t) > u)$, as $u \to \infty$, where $T$ is an independent of \{X(t)\} nonnegative random variable. It…

Probability · Mathematics 2010-11-30 Marek Arendarczyk , Krzysztof Debicki

The main purpose of this paper is to investigate the strong approximation of the integrated empirical process. More precisely, we obtain the exact rate of the approximations by a sequence of weighted Brownian bridges and a weighted Kiefer…

Statistics Theory · Mathematics 2017-11-21 Sergio Alvarez-Andrade , Salim Bouzebda , Aimé Lachal

Gaussian universality results assert that the properties of many estimators remain unchanged when the input data are replaced by Gaussians. Such results have gained popularity in high-dimensional statistics and machine learning, as…

Probability · Mathematics 2025-12-03 Kevin Han Huang , Morgane Austern , Peter Orbanz

We establish higher-order nonasymptotic expansions for a difference between probability distributions of sums of i.i.d. random vectors in a Euclidean space. The derived bounds are uniform over two classes of sets: the set of all Euclidean…

Statistics Theory · Mathematics 2022-11-30 Mayya Zhilova

We derive a Gaussian approximation result for the maximum of a sum of random vectors under $(2+\iota)$-th moments. Our main theorem is abstract and nonasymptotic, and can be applied to a variety of statistical learning problems. The proof…

Statistics Theory · Mathematics 2019-05-28 Qiang Sun

We propose a novel sparse spectrum approximation of Gaussian process (GP) tailored for Bayesian optimization. Whilst the current sparse spectrum methods provide desired approximations for regression problems, it is observed that this…

Machine Learning · Computer Science 2020-06-09 Ang Yang , Cheng Li , Santu Rana , Sunil Gupta , Svetha Venkatesh

The self-consistent Gaussian approximation (SCGA) for classical spin systems described by a completely anisotropic D-component vector model is proposed, which takes into account fluctuations of the molecular field and thus is a next step…

Statistical Mechanics · Physics 2009-10-31 D. A. Garanin

We consider the semi-parametric estimation of a scale parameter of a one-dimensional Gaussian process with known smoothness. We suggest an estimator based on quadratic variations and on the moment method. We provide asymptotic…

Statistics Theory · Mathematics 2020-01-22 Jean-Marc Azaïs , François Bachoc , Agnès Lagnoux , Thi Mong Ngoc Nguyen

We study the problem of computationally efficient robust estimation of the covariance/scatter matrix of elliptical distributions -- that is, affine transformations of spherically symmetric distributions -- under the strong contamination…

Data Structures and Algorithms · Computer Science 2025-04-15 Gleb Novikov

In application areas where data generation is expensive, Gaussian processes are a preferred supervised learning model due to their high data-efficiency. Particularly in model-based control, Gaussian processes allow the derivation of…

Machine Learning · Computer Science 2021-01-15 Armin Lederer , Jonas Umlauft , Sandra Hirche

This note presents sharp inequalities for deviation probability of a general quadratic form of a random vector \(\xiv\) with finite exponential moments. The obtained deviation bounds are similar to the case of a Gaussian random vector. The…

Probability · Mathematics 2013-02-08 Vladimir Spokoiny

We establish asymptotically Gaussian fluctuations for functionals of a large class of spin models and strongly correlated random point fields, achieving near-optimal rates. For spin models, we demonstrate Gaussian asymptotics for the…

Probability · Mathematics 2025-09-16 Tien-Cuong Dinh , Subhroshekhar Ghosh , Hoang-Son Tran , Manh-Hung Tran

Gaussian processes (GPs) are widely-used tools in spatial statistics and machine learning and the formulae for the mean function and covariance kernel of a GP $T u$ that is the image of another GP $u$ under a linear transformation $T$…

Probability · Mathematics 2024-10-08 Tadashi Matsumoto , T. J. Sullivan

Gaussian Processes (GPs) are widely employed in control and learning because of their principled treatment of uncertainty. However, tracking uncertainty for iterative, multi-step predictions in general leads to an analytically intractable…

We present a new proof of the quantum Cramer-Rao bound for precision parameter estimation [1-3] and extend it to a more general class of measurement procedures. We analyze a generalized framework for parameter estimation that covers most…

Quantum Physics · Physics 2010-01-28 Garry Goldstein , Mikhail D. Lukin , Paola Cappellaro

Gaussian process regression (GPR) is a popular nonparametric Bayesian method that provides predictive uncertainty estimates and is widely used in safety-critical applications. While prior research has introduced various uncertainty bounds,…

Machine Learning · Computer Science 2025-12-05 Junyi Liu , Stanley Kok

We consider the problem $(\rm P)$ of exactly fitting an ellipsoid (centered at $0$) to $n$ standard Gaussian random vectors in $\mathbb{R}^d$, as $n, d \to \infty$ with $n / d^2 \to \alpha > 0$. This problem is conjectured to undergo a…

Probability · Mathematics 2025-08-21 Afonso S. Bandeira , Antoine Maillard

This paper derives non-asymptotic error bounds for nonlinear stochastic approximation algorithms in the Wasserstein-$p$ distance. To obtain explicit finite-sample guarantees for the last iterate, we develop a coupling argument that compares…

Machine Learning · Computer Science 2026-02-03 Seo Taek Kong , R. Srikant

Gaussian process (GP) regression is a powerful interpolation technique due to its flexibility in capturing non-linearity. In this paper, we provide a general framework for understanding the frequentist coverage of point-wise and…

Statistics Theory · Mathematics 2017-08-17 Yun Yang , Anirban Bhattacharya , Debdeep Pati

For a given normalized Gaussian symmetric matrix-valued process $Y^{(n)}$, we consider the process of its eigenvalues $\{(\lambda_{1}^{(n)}(t),\dots, \lambda_{n}^{(n)}(t)); t\ge 0\}$ as well as its corresponding process of empirical…

Probability · Mathematics 2018-01-09 Arturo Jaramillo , Juan Carlos Pardo , José Luis Pérez