English
Related papers

Related papers: Tail Bounds for Tensor-valued Random Process

200 papers

In this paper, we consider a stochastic system described by a differential equation admitting a spatially varying random coefficient. The differential equation has been employed to model various static physics systems such as elastic…

Probability · Mathematics 2013-09-18 Jingchen Liu , Xiang Zhou

This paper addresses the advancement of probability tail bound analysis, a crucial statistical tool for assessing the probability of large deviations of random variables from their expected values. Traditional tail bounds, such as Markov's,…

Probability · Mathematics 2024-08-22 Shih-Yu Chang

We investigate a way of comparing and classifying tails of random variables. Our approach extends the notion of classical indices, such as exponential and moment indices, which are widely used measuring heaviness of tail functions. A…

Probability · Mathematics 2013-10-07 Jaakko Lehtomaa

We consider non-convex stochastic optimization using first-order algorithms for which the gradient estimates may have heavy tails. We show that a combination of gradient clipping, momentum, and normalized gradient descent yields convergence…

Machine Learning · Computer Science 2021-11-10 Ashok Cutkosky , Harsh Mehta

We present a very general chaining method which allows one to control the supremum of the empirical process $\sup_{h \in H} |N^{-1}\sum_{i=1}^N h^2(X_i)-\E h^2|$ in rather general situations. We use this method to establish two main…

Probability · Mathematics 2011-08-22 Shahar Mendelson , Grigoris Paouris

We consider multivariate extreme value statistics for independent but nonidentically distributed random vectors. In particular, the data may have varying tail copulas and also heteroscedastic marginal distributions. Assuming smoothly…

Statistics Theory · Mathematics 2026-04-14 John H. J. Einmahl , Chen Zhou

We construct a new tail bound for the sum of independent random variables for situations in which the expected value of the sum is known and each random variable lies within a specified interval, which may be different for each variable.…

Probability · Mathematics 2025-03-25 Jackson Loper , Jeffrey Regier

We review several competing chaining methods to estimate the supremum, the diameter of the range or the modulus of continuity of a stochastic process in terms of tail bounds of their two-dimensional distributions. Then we show how they can…

Probability · Mathematics 2008-04-09 Michael Scheutzow

This paper describes the construction of a lower bound for the tails of general random variables, using solely knowledge of their moment generating function. The tilting procedure used allows for the construction of lower bounds that are…

Probability · Mathematics 2007-06-13 Ted Theodosopoulos

Programs with randomization constructs is an active research topic, especially after the recent introduction of martingale-based analysis methods for their termination and runtimes. Unlike most of the existing works that focus on proving…

Logic in Computer Science · Computer Science 2019-02-18 Satoshi Kura , Natsuki Urabe , Ichiro Hasuo

We establish sharp tail asymptotics for component-wise extreme values of bivariate Gaussian random vectors with arbitrary correlation between the components. We consider two scaling regimes for the tail event in which we demonstrate the…

Probability · Mathematics 2019-03-28 Remco van der Hofstad , Harsha Honnappa

In this paper we propose a framework that enables the study of large deviations for point processes based on stationary sequences with regularly varying tails. This framework allows us to keep track not of the magnitude of the extreme…

Probability · Mathematics 2009-08-21 Henrik Hult , Gennady Samorodnitsky

We consider a multivariate distributional recursion of sum-type as arising in the probabilistic analysis of algorithms and random trees. We prove an upper tail bound for the solution using Chernoff's bounding technique by estimating the…

Probability · Mathematics 2011-06-21 Goetz Olaf Munsonius

We investigate maxima of linear processes with i.i.d. heavy-tailed innovations and random coefficients. Using the point process approach we derive functional convergence of the partial maxima stochastic process in the space of…

Probability · Mathematics 2021-10-05 Danijel Krizmanić

In this paper, we provide novel optimal (or near optimal) convergence rates for a clipped version of the stochastic subgradient method. We consider nonsmooth convex problems over possibly unbounded domains, under heavy-tailed noise that…

Optimization and Control · Mathematics 2025-04-21 Daniela Angela Parletta , Andrea Paudice , Saverio Salzo

We consider two independent random variables with the given tail asymptotic (e.g. power or exponential). We find tail asymptotic for their sum and product. This is done by some cumbersome but purely technical computations and requires the…

Probability · Mathematics 2013-05-09 Andrey Sarantsev

The sums and maxima of non-stationary random length sequences of regularly varying random variables may have the same tail and extremal indices, Markovich and Rodionov (2020). The main constraint is that there exists a unique series in a…

Probability · Mathematics 2021-10-11 Natalia Markovich

The Tensor-Train (TT) format is a highly compact low-rank representation for high-dimensional tensors. TT is particularly useful when representing approximations to the solutions of certain types of parametrized partial differential…

Given a finite collection of stochastic alternatives, we study the problem of sequentially allocating a fixed sampling budget to identify the optimal alternative with a high probability, where the optimal alternative is defined as the one…

Methodology · Statistics 2025-03-11 Dohyun Ahn , Taeho Kim

We obtain some optimal inequalities on tail probabilities for sums of independent bounded random variables. Our main result completes an upper bound on tail probabilities due to Talagrand by giving a one-term asymptotic expansion for large…

Probability · Mathematics 2017-08-03 Xiequan Fan , Ion Grama , Quansheng Liu