English
Related papers

Related papers: A note on concentration inequality for vector-valu…

200 papers

Despite the ubiquitous use of stochastic optimization algorithms in machine learning, the precise impact of these algorithms and their dynamics on generalization performance in realistic non-convex settings is still poorly understood. While…

Machine Learning · Statistics 2022-07-12 Liam Hodgkinson , Umut Şimşekli , Rajiv Khanna , Michael W. Mahoney

Biggins [Uniform convergence of martingales in the branching random walk. {\em Ann. Probab.}, 20(1):137--151, 1992] proved local uniform convergence of additive martingales in $d$-dimensional supercritical branching random walks at complex…

Probability · Mathematics 2016-11-17 Konrad Kolesko , Matthias Meiners

In this paper, we prove a Sanov-type large deviation principle for the sequence of empirical measures of vectors chosen uniformly at random from an Orlicz ball. From this level-$2$ large deviation result, in a combination with Gibbs…

Probability · Mathematics 2021-11-09 Lorenz Fruehwirth , Joscha Prochno

New Vapnik and Chervonenkis type concentration inequalities are derived for the empirical distribution of an independent random sample. Focus is on the maximal deviation over classes of Borel sets within a low probability region. The…

Statistics Theory · Mathematics 2022-04-26 Stéphane Lhaut , Anne Sabourin , Johan Segers

This paper develops a general concentration inequality for the suprema of empirical processes with dependent data. The concentration inequality is obtained by combining generic chaining with a coupling-based strategy. Our framework…

Econometrics · Economics 2026-02-23 Chiara Amorino , Christian Brownlees , Ankita Ghosh

This work shows how exponential concentration inequalities for additive functionals of stochastic processes over a finite time interval can be derived from concentration inequalities for martingales. The approach is entirely probabilistic…

Probability · Mathematics 2020-07-14 Bob Pepin

We give upper and lower asymptotic bounds for the left tail and for the right tail of the continuous limiting QuickSort density f that are nearly matching in each tail. The bounds strengthen results from a paper of Svante Janson (2015)…

Probability · Mathematics 2018-08-03 James Allen Fill , Wei-Chun Hung

We study deviation of U-statistics when samples have heavy-tailed distribution so the kernel of the U-statistic does not have bounded exponential moments at any positive point. We obtain an exponential upper bound for the tail of the…

Probability · Mathematics 2023-01-30 Milad Bakhshizadeh

This paper introduces a flexible framework for the estimation of the conditional tail index of heavy tailed distributions. In this framework, the tail index is computed from an auxiliary linear regression model that facilitates estimation…

Econometrics · Economics 2024-09-23 João Nicolau , Paulo M. M. Rodrigues

We present a set of high-probability inequalities that control the concentration of weighted averages of multiple (possibly uncountably many) simultaneously evolving and interdependent martingales. Our results extend the PAC-Bayesian…

Machine Learning · Computer Science 2012-07-31 Yevgeny Seldin , François Laviolette , Nicolò Cesa-Bianchi , John Shawe-Taylor , Peter Auer

Using martingale methods, we provide bounds for the entropy of a probability measure on $\mathbb {R}^d$ with the right-hand side given in a certain integral form. As a corollary, in the one-dimensional case, we obtain a weighted log-Sobolev…

Probability · Mathematics 2015-03-19 Alexei Kulik , Taras Tymoshkevych

We prove deviation inequalities for sums of high-dimensional random matrices and operators with dependence and {\rc heavy tails}. Estimation of high-dimensional matrices is a concern for numerous modern applications. However, most results…

Statistics Theory · Mathematics 2025-06-26 Shogo Nakakita , Pierre Alquier , Masaaki Imaizumi

The analysis of extremal dependence in high dimensions has recently attracted considerable interest. Existing methodology primarily focuses on modeling and estimation of extremal dependence structures, often supported by concentration…

Statistics Theory · Mathematics 2026-04-02 Axel Bücher , Yeonjoon Choi , Katharina Effertz , Stanislav Volgushev

This article is devoted to the study of tail index estimation based on i.i.d. multivariate observations, drawn from a standard heavy-tailed distribution, i.e. of which 1-d Pareto-like marginals share the same tail index. A multivariate…

Statistics Theory · Mathematics 2014-04-10 Stéphan Clémençon , Antoine Dematteo

This paper extends the Concentration-Compactness Principle to Musielak-Orlicz spaces, working in both bounded and unbounded domains. We show that our results include important special cases like classical Orlicz spaces, variable exponent…

Analysis of PDEs · Mathematics 2025-09-16 Ala Eddine Bahrouni , Anouar Bahrouni

Matrix concentration inequalities give bounds for the spectral-norm deviation of a random matrix from its expected value. These results have a weak dimensional dependence that is sometimes, but not always, necessary. This paper identifies…

Probability · Mathematics 2016-08-05 Joel A. Tropp

We prove Bernstein-type matrix concentration inequalities for linear combinations with matrix coefficients of binary random variables satisfying certain $\ell_\infty$-independence assumptions, complementing recent results by Kaufman, Kyng…

Probability · Mathematics 2025-04-14 Radosław Adamczak , Ioannis Kavvadias

We study the tail bound of the emperical covariance of multivariate normal distribution. Following the work of (Gittens & Tropp, 2011), we provide a tail bound with a small constant.

Statistics Theory · Mathematics 2012-12-27 Shenghuo Zhu

We obtain general weak existence and stability results for stochastic convolution equations with jumps under mild regularity assumptions, allowing for non-Lipschitz coefficients and singular kernels. Our approach relies on weak convergence…

Probability · Mathematics 2021-12-22 Eduardo Abi Jaber , Christa Cuchiero , Martin Larsson , Sergio Pulido

When applying multivariate extreme value statistics to analyze tail risk in compound events defined by a multivariate random vector, one often assumes that all dimensions share the same extreme value index. While such an assumption can be…

Methodology · Statistics 2026-02-16 Liujun Chen , Chen Zhou