English
Related papers

Related papers: Subgaussian Tail Bounds via Stability Arguments

200 papers

Stochastic Gradient Descent (SGD) based methods have been widely used for training large-scale machine learning models that also generalize well in practice. Several explanations have been offered for this generalization performance, a…

Machine Learning · Computer Science 2021-02-11 Yikai Zhang , Wenjia Zhang , Sammy Bald , Vamsi Pingali , Chao Chen , Mayank Goswami

We provide a generalisation of Pinelis' Rademacher-Gaussian tail comparison to complex coefficients. We also establish uniform bounds on the probability that the magnitude of weighted sums of independent random vectors uniform on Euclidean…

Probability · Mathematics 2022-03-15 Giorgos Chasapis , Ruoyuan Liu , Tomasz Tkocz

The new field of adaptive data analysis seeks to provide algorithms and provable guarantees for models of machine learning that allow researchers to reuse their data, which normally falls outside of the usual statistical paradigm of static…

Machine Learning · Computer Science 2017-03-22 Sam Elder

Frequentist conditions for asymptotic suitability of Bayesian procedures focus on lower bounds for prior mass in Kullback-Leibler neighbourhoods of the data distribution. The goal of this paper is to investigate the flexibility in criteria…

Statistics Theory · Mathematics 2018-03-19 B. J. K. Kleijn , Y. Y. Zhao

The authors announce a general tail estimate, called a decoupling inequality, for a symmetrized sum of non-linear $k$-correlations of $n>k$ independent random variables.

Functional Analysis · Mathematics 2016-09-06 Victor H. de la Peña , Stephen J. Montgomery-Smith

We prove the first eigenvalue repulsion bound for sparse random matrices. As a consequence, we show that these matrices have simple spectrum, improving the range of sparsity and error probability from the work of the second author and Vu.…

Probability · Mathematics 2020-12-21 Patrick Lopatto , Kyle Luh

We present new information-theoretic generalization guarantees through the a novel construction of the "neighboring-hypothesis" matrix and a new family of stability notions termed sample-conditioned hypothesis (SCH) stability. Our approach…

Machine Learning · Statistics 2023-11-01 Ziqiao Wang , Yongyi Mao

Correcting for skewness can result in more accurate tail probability approximations in the central limit theorem for sums of independent random variables. In this paper, we extend the theory to sums of local statistics of independent random…

Probability · Mathematics 2019-04-05 Xiao Fang , Li Luo , Qi-Man Shao

We investigate the sub-Gaussian property for almost surely bounded random variables. If sub-Gaussianity per se is de facto ensured by the bounded support of said random variables, then exciting research avenues remain open. Among these…

Probability · Mathematics 2019-07-16 Julyan Arbel , Olivier Marchal , Hien D. Nguyen

Estimates are constructed for the deviation of the concentration functions of sums of independent random variables with finite variances from the folded normal distribution function without any assumptions concerning the existence of the…

Probability · Mathematics 2016-08-11 V. Yu. Korolev , A. V. Dorofeeva

Measures of tail dependence between random variables aim to numerically quantify the degree of association between their extreme realizations. Existing tail dependence coefficients (TDCs) are based on an asymptotic analysis of relevant…

Applications · Statistics 2021-06-11 Davide Lauria , Svetlozar T. Rachev , A. Alexandre Trindade

The purpose of this letter is to improve Hoeffding's lemma and consequently Hoeffding's tail bounds. The improvement pertains to left skewed zero mean random variables $X\in[a,b]$, where $a<0$ and $-a>b$. The proof of Hoeffding's improved…

Probability · Mathematics 2020-12-08 David Hertz

For a fixed positive integer $\;k,\;$ limit laws of linearly normalized $\;k$-th upper order statistics are well known. In this article, a comprehensive study of tail behaviours of limit laws of normalized $k$-th upper order statistics…

Probability · Mathematics 2015-12-11 Sreenivasan Ravi , Mandagere Chandrashekhar Manohar

Stable distributions are of fundamental importance in probability theory, yet their absolute continuity makes them unsuitable for modeling count data. A discrete analog of strict stability has been previously proposed by replacing scaling…

Statistics Theory · Mathematics 2025-09-09 F. William Townes

The stability of Bernstein's characterization of Gaussian distributions is extended to vectors by utilizing characteristic functions. Stability is used to develop a soft doubling argument that establishes the optimality of Gaussian vectors…

Information Theory · Computer Science 2023-08-15 Mohammad Mahdi Mahvari , Gerhard Kramer

Stochastic feedback systems give rise to a variety of notions of stability. The conditions for the stability of the median, mean, and variance stability conditions differ. These conditions can be stated explicitly for scalar discrete-time…

Systems and Control · Electrical Eng. & Systems 2019-12-19 Roy S. Smith , Bassam Bamieh

We describe Bayesian inference for the parameters of Gaussian models of bounded data protected by differential privacy. Using this setting, we demonstrate that analysts can and should take constraints imposed by the bounds into account when…

Methodology · Statistics 2024-10-18 Zeki Kazan , Jerome P. Reiter

In this paper, we introduce a notion of algorithmic stability called typical stability. When our goal is to release real-valued queries (statistics) computed over a dataset, this notion does not require the queries to be of bounded…

Machine Learning · Computer Science 2016-09-20 Raef Bassily , Yoav Freund

The extreme value dependence of regularly varying stationary time series can be described by the spectral tail process. Drees, Segers and Warchol [Extremes 18(3): 369--402, 2015] proposed estimators of the marginal distributions of this…

Statistics Theory · Mathematics 2019-07-23 Holger Drees , Miran Knezevic

Models for extreme values are generally derived from limit results, which are meant to be good enough approximations when applied to finite samples. Depending on the speed of convergence of the process underlying the data, these…

Statistics Theory · Mathematics 2019-02-20 Thomas Lugrin , Anthony C. Davison , Jonathan A. Tawn
‹ Prev 1 4 5 6 7 8 10 Next ›