English
Related papers

Related papers: Gaussian universality for approximately polynomial…

200 papers

We revisit extending the Kolmogorov-Smirnov distance between probability distributions to the multidimensional setting and make new arguments about the proper way to approach this generalization. Our proposed formulation maximizes the…

Computation · Statistics 2025-04-16 Peter Matthew Jacobs , Foad Namjoo , Jeff M. Phillips

In a recent paper the author obtained optimal bounds for the strong Gaussian approximation of sums of independent $\R^d$-valued random vectors with finite exponential moments. The results may be considered as generalizations of well-known…

Probability · Mathematics 2007-05-23 A. Yu. Zaitsev

The universality of the directed polymer model and the analogous KPZ equation is supported by numerical simulations using non-Gaussian random probability distributions in two, three and four dimensions. It is shown that although in the…

Disordered Systems and Neural Networks · Physics 2016-08-31 Ehud Perlsman , Shlomo Havlin

We consider the problem of approximating sums of high-dimensional stationary time series by Gaussian vectors, using the framework of functional dependence measure. The validity of the Gaussian approximation depends on the sample size $n$,…

Statistics Theory · Mathematics 2015-08-31 Danna Zhang , Wei Biao Wu

Graphical models are commonly used to represent conditional dependence relationships between variables. There are multiple methods available for exploring them from high-dimensional data, but almost all of them rely on the assumption that…

Machine Learning · Statistics 2020-04-22 Tianxi Li , Cheng Qian , Elizaveta Levina , Ji Zhu

This paper investigates the approximation of Gaussian random variables in Banach spaces, focusing on the high-probability bounds for the approximation of Gaussian random variables using finitely many observations. We derive non-asymptotic…

Statistics Theory · Mathematics 2025-08-28 Daniel Winkle , Ingo Steinwart , Bernard Haasdonk

In a general class of Bayesian nonparametric models, we prove that the posterior distribution can be asymptotically approximated by a Gaussian process. Our results apply to nonparametric exponential family that contains both Gaussian and…

Statistics Theory · Mathematics 2017-11-01 Zuofeng Shang , Guang Cheng

We consider the Schr\"odinger equation on the one dimensional torus with a general odd-power nonlinearity $p \geq 5$, which is known to be globally well-posed in the Sobolev space $H^\sigma(\mathbb{T})$, for every $\sigma \geq 1$, thanks to…

Analysis of PDEs · Mathematics 2025-10-10 Alexis Knezevitch

We investigate the sub-Gaussian property for almost surely bounded random variables. If sub-Gaussianity per se is de facto ensured by the bounded support of said random variables, then exciting research avenues remain open. Among these…

Probability · Mathematics 2019-07-16 Julyan Arbel , Olivier Marchal , Hien D. Nguyen

Random linear mappings are widely used in modern signal processing, compressed sensing and machine learning. These mappings may be used to embed the data into a significantly lower dimension while at the same time preserving useful…

Information Theory · Computer Science 2021-01-22 Halyun Jeong , Xiaowei Li , Yaniv Plan , Özgür Yılmaz

We consider the problem of Gaussian multiplier bootstrap procedures for the $k$th largest statistics and functions of the top $k$ order statistics, which are commonly encountered in high-dimensional statistical inference. Such a problem has…

Statistics Theory · Mathematics 2026-03-04 Yixi Ding , Qizhai Li , Yuke Shi , Liuquan Sun , Luobin Zhang

Analyzing neural network dynamics via stochastic gradient descent (SGD) is crucial to building theoretical foundations for deep learning. Previous work has analyzed structured inputs within the \textit{hidden manifold model}, often under…

Machine Learning · Statistics 2025-12-01 Jaeyong Bae , Hawoong Jeong

This study develops a non-asymptotic Gaussian approximation theory for distributions of M-estimators, which are defined as maximizers of empirical criterion functions. In existing mathematical statistics literature, numerous studies have…

Statistics Theory · Mathematics 2025-08-28 Masaaki Imaizumi , Taisuke Otsu

We consider the classification problem of a high-dimensional mixture of two Gaussians with general covariance matrices. Using the replica method from statistical physics, we investigate the asymptotic behavior of a general class of…

Machine Learning · Statistics 2024-10-29 Hanwen Huang , Peng Zeng

In this paper we develop non-asymptotic Gaussian approximation results for the sampling distribution of suprema of empirical processes when the indexing function class $\mathcal{F}_n$ varies with the sample size $n$ and may not be Donsker.…

Statistics Theory · Mathematics 2023-09-06 Alexander Giessing

Due to their flexibility, Gaussian processes (GPs) have been widely used in nonparametric function estimation. A prior information about the underlying function is often available. For instance, the physical system (computer model output)…

Methodology · Statistics 2017-11-21 Hassan Maatouk

There is a result of Diaconis and Freedman which says that, in a limiting sense, for large collections of high-dimensional data most one-dimensional projections of the data are approximately Gaussian. This paper gives quantitative versions…

Probability · Mathematics 2010-05-18 Elizabeth Meckes

We consider the problem of estimating small ball probabilities $\mathbb P\{f(G) \leqslant \delta \mathbb Ef(G)\}$ for sub-additive,positively homogeneous functions $f$ with respect to the Gaussian measure. We establish estimates that depend…

Functional Analysis · Mathematics 2021-07-29 Grigoris Paouris , Konstantin Tikhomirov , Petros Valettas

The goal of this paper is to characterize function distributions that deep learning can or cannot learn in poly-time. A universality result is proved for SGD-based deep learning and a non-universality result is proved for GD-based deep…

Machine Learning · Computer Science 2020-01-10 Emmanuel Abbe , Colin Sandon

We prove a universality theorem for learning with random features. Our result shows that, in terms of training and generalization errors, a random feature model with a nonlinear activation function is asymptotically equivalent to a…

Information Theory · Computer Science 2022-11-01 Hong Hu , Yue M. Lu