English
Related papers

Related papers: General Tail Bounds for Random Tensors Summation: …

200 papers

We formulate a uniform tail bound for empirical processes indexed by a class of functions, in terms of the individual deviations of the functions rather than the worst-case deviation in the considered class. The tail bound is established by…

Probability · Mathematics 2026-03-27 Sohail Bahmani

This article offers a comprehensive treatment of polynomial functional regression, culminating in the establishment of a novel finite sample bound. This bound encompasses various aspects, including general smoothness conditions, capacity…

Numerical Analysis · Mathematics 2024-05-08 Markus Holzleitner , Sergei Pereverzyev

In this paper, we study tail inequalities of the largest eigenvalue of a matrix infinitely divisible (i.d.) series, which is a finite sum of fixed matrices weighted by i.d. random variables. We obtain several types of tail inequalities,…

Information Theory · Computer Science 2022-05-31 Chao Zhang , Xianjie Gao , Min-Hsiu Hsieh , Hanyuan Hang , Dacheng Tao

Over the last 30 years, extensive work has been devoted to developing central limit theory for partial sums of subordinated long memory linear time series. A much less studied problem, motivated by questions that are ubiquitous in extreme…

Probability · Mathematics 2026-03-24 Ioan Scheffel , Marco Oesting , Gilles Stupfler

The T product operation between two three order tensors was invented around 2011 and it arises from many applications, such as signal processing, image feature extraction, machine learning, computer vision, and the multiview clustering…

Functional Analysis · Mathematics 2021-08-11 Shih Yu Chang , Yimin Wei

We re-examine a lower-tail upper bound for the random variable $$X=\prod_{i=1}^{\infty}\min\left\{\sum_{k=1}^iE_k,1\right\},$$ where $E_1,E_2,\ldots\stackrel{iid}\sim\text{Exp}(1)$. This bound has found use in root-finding and seed-finding…

Probability · Mathematics 2019-05-21 Sam Justice , N. D. Shyamalkumar

We give Hoeffding and Bernstein-type concentration inequalities for the largest eigenvalue of sums of random matrices arising from a Markov chain. We consider time-dependent matrix-valued functions on a general state space, generalizing…

Probability · Mathematics 2025-07-01 Joe Neeman , Bobby Shi , Rachel Ward

We obtain an uniform tail estimates for natural normed sums of independent random variables (r.v.) with regular varying tails of distributions. We give also many examples on order to show the exactness of offered estimates and discuss some…

Probability · Mathematics 2012-06-22 E. Ostrovsky , L. Sirota

We prove several trace inequalities that extend the Araki Lieb Thirring (ALT) inequality, Golden Thompson (GT) inequality and logarithmic trace inequality to arbitrary many tensors. Our approaches rely on complex interpolation theory as…

Mathematical Physics · Physics 2023-09-26 Shih Yu Chang

We consider a priori generalization bounds developed in terms of cross-validation estimates and the stability of learners. In particular, we first derive an exponential Efron-Stein type tail inequality for the concentration of a general…

Machine Learning · Statistics 2017-06-20 Karim Abou-Moustafa , Csaba Szepesvari

We prove limit theorems for sums of randomly chosen random variables conditioned on the summands. We consider several versions of the corner growth setting, including specific cases of dependence amongst the summands and summands with heavy…

Probability · Mathematics 2022-07-01 David Grzybowski

Concentration inequalities form an essential toolkit in the study of high dimensional (HD) statistical methods. Most of the relevant statistics literature in this regard is based on sub-Gaussian or sub-exponential tail assumptions. In this…

Statistics Theory · Mathematics 2023-01-09 Arun Kumar Kuchibhotla , Abhishek Chakrabortty

Chebyshev's inequality provides an upper bound on the tail probability of a random variable based on its mean and variance. While tight, the inequality has been criticized for only being attained by pathological distributions that abuse the…

Optimization and Control · Mathematics 2020-10-16 Ernst Roos , Ruud Brekelmans , Wouter van Eekelen , Dick den Hertog , Johan van Leeuwaarden

Following the recent work of Jiang and Lin (Linear Algebra Appl. 585 (2020) 45--49), we present more results (bounds) on Harnack type inequalities for matrices in terms of majorization (i.e., in partial products) of eigenvalues and singular…

Functional Analysis · Mathematics 2019-12-09 Chaojun Yang , Fuzhen Zhang

We establish maximal concentration bounds for the iterates generated by stochastic approximation algorithms with general step sizes, where the noise has a finite-state Markovian component plus a Martingale-difference component. When the…

Probability · Mathematics 2026-05-21 Shubhada Agrawal , Siva Theja Maguluri , Martin Zubeldia

We prove tail estimates for variables $\sum_i f(X_i)$, where $(X_i)_i$ is the trajectory of a random walk on an undirected graph (or, equivalently, a reversible Markov chain). The estimates are in terms of the maximum of the function $f$,…

Probability · Mathematics 2007-12-25 Roy Wagner

We theoretically and experimentally investigate tensor-based regression and classification. Our focus is regularization with various tensor norms, including the overlapped trace norm, the latent trace norm, and the scaled latent trace norm.…

Machine Learning · Computer Science 2015-09-08 Kishan Wimalawarne , Ryota Tomioka , Masashi Sugiyama

``Localization'' has proven to be a valuable tool in the Statistical Learning literature as it allows sharp risk bounds in terms of the problem geometry. Localized bounds seem to be much less exploited in the Stochastic Optimization…

Optimization and Control · Mathematics 2023-03-30 Roberto I. Oliveira , Philip Thompson

The probability that the sum of independent, centered, identically distributed, heavy-tailed random variables achieves a very large value is asymptotically equal to the probability that there exists a single summand equalling that value. We…

Probability · Mathematics 2024-02-15 Quirin Vogel

We investigate the use of optimization to compute bounds for extremal performance measures. This approach takes a non-parametric viewpoint that aims to alleviate the issue of model misspecification possibly encountered by conventional…

Methodology · Statistics 2017-11-03 Clementine Mottet , Henry Lam