English
Related papers

Related papers: Lower tails via relative entropy

200 papers

We explore the use of higher-order tail area approximations for Bayesian simulation. These approximations give rise to an alternative simulation scheme to MCMC for Bayesian computation of marginal posterior distributions for a scalar…

Computation · Statistics 2014-05-23 Erlis Ruli , Nicola Sartori , Laura Ventura

This work introduces the minimax Laplace transform method, a modification of the cumulant-based matrix Laplace transform method developed in "User-friendly tail bounds for sums of random matrices" (arXiv:1004.4389v6) that yields both upper…

Probability · Mathematics 2011-07-22 Alex Gittens , Joel A. Tropp

While the convergence behaviors of stochastic gradient methods are well understood \emph{in expectation}, there still exist many gaps in the understanding of their convergence with \emph{high probability}, where the convergence rate has a…

Optimization and Control · Mathematics 2023-04-04 Ta Duy Nguyen , Thien Hang Nguyen , Alina Ene , Huy Le Nguyen

This article is devoted to the study of tail index estimation based on i.i.d. multivariate observations, drawn from a standard heavy-tailed distribution, i.e. of which 1-d Pareto-like marginals share the same tail index. A multivariate…

Statistics Theory · Mathematics 2014-04-10 Stéphan Clémençon , Antoine Dematteo

The entropy of random graph ensembles has gained widespread attention in the field of graph theory and network science. We consider microcanonical ensembles of simple graphs with prescribed degree sequences. We demonstrate that the…

Statistical Mechanics · Physics 2023-08-28 Tatsuro Kawamoto

Concentration inequalities for subgraph counts in random geometric graphs built over Poisson point processes are proved. The estimates give upper bounds for the probabilities $\mathbb{P}(N\geq M +r)$ and $\mathbb{P}(N\leq M - r)$ where $M$…

Probability · Mathematics 2015-04-29 Sascha Bachmann , Matthias Reitzner

Using terminologies of information geometry, we derive upper and lower bounds of the tail probability of the sample mean. Employing these bounds, we obtain upper and lower bounds of the minimum error probability of the 2nd kind of error…

Statistics Theory · Mathematics 2024-09-10 Shun Watanabe , Masahito Hayashi

Standard statistical analysis is unable to provide reliable confidence intervals on expectation values of probability distributions that do not satisfy the conditions of the central limit theorem. We present a regression-based estimator of…

Data Analysis, Statistics and Probability · Physics 2019-06-24 Pablo Lopez Rios , Gareth J. Conduit

We prove upper bounds on the transition probabilities of random walks with i.i.d. random conductances with a polynomial lower tail near $0$. We consider both constant and variable speed models. Our estimates are sharp. As a consequence, we…

Probability · Mathematics 2015-06-30 Omar Boukhadra , Takashi Kumagai , Pierre Mathieu

This paper considers limit theorems associated with subgraph counts in the age-dependent random connection model. First, we identify regimes where the count of sub-trees converges weakly to a stable random variable under suitable…

Probability · Mathematics 2024-09-10 Christian Hirsch , Takashi Owada

In this paper we consider the problem of estimating the joint upper and lower tail large deviations of the edge eigenvalues of an Erd\H{o}s-R\'enyi random graph $\mathcal{G}_{n,p}$, in the regime of $p$ where the edge of the spectrum is no…

Probability · Mathematics 2020-04-02 Bhaswar B. Bhattacharya , Sohom Bhattacharya , Shirshendu Ganguly

We show that if pn >> log n, the binomial random graph G_{n,p} has an approximate Hamilton decomposition. More precisely, we show that in this range G_{n,p} contains a set of edge-disjoint Hamilton cycles covering almost all of its edges.…

Combinatorics · Mathematics 2013-07-05 Fiachra Knox , Daniela Kühn , Deryk Osthus

This paper describes the construction of a lower bound for the tails of general random variables, using solely knowledge of their moment generating function. The tilting procedure used allows for the construction of lower bounds that are…

Probability · Mathematics 2007-06-13 Ted Theodosopoulos

We establish new tail estimates for order statistics and for the Euclidean norms of projections of an isotropic log-concave random vector. More generally, we prove tail estimates for the norms of projections of sums of independent…

We study the relative entropy of the empirical probability vector with respect to the true probability vector in multinomial sampling of $k$ categories, which, when multiplied by sample size $n$, is also the log-likelihood ratio statistic.…

Statistics Theory · Mathematics 2022-12-06 F. Richard Guo , Thomas S. Richardson

We obtain first decay rates of probabilities of tails of multivariate polynomials built on independent random variables with heavy tails. Then we derive stable limit theorems for nonconventional sums of the form $\sum_{Nt\geq n\geq…

Probability · Mathematics 2015-09-08 Yuri Kifer , S. R. S. Varadhan

We obtain decay rates of probabilities of tails of polynomials in several independent random variables with heavy tails and derive stable limit theorems for nonconventional sums of such polynomials

Probability · Mathematics 2016-08-26 Yuri Kifer , S. R. S. Varadhan

Given a fixed graph H, what is the (exponentially small) probability that the number X_H of copies of H in the binomial random graph G_{n,p} is at least twice its mean? Studied intensively since the mid 1990s, this so-called infamous upper…

Probability · Mathematics 2019-12-09 Matas Šileikis , Lutz Warnke

We deduce in this paper the sufficient conditions for weak convergence of centered and normed deviation of the u-statistics with values in the space of the real valued continuous function defined on some compact metric space. We obtain also…

Statistics Theory · Mathematics 2016-08-12 E. Ostrovsky , L. Sirota

In recent years, various notions of capacity and complexity have been proposed for characterizing the generalization properties of stochastic gradient descent (SGD) in deep learning. Some of the popular notions that correlate well with the…

Optimization and Control · Mathematics 2021-06-15 Mert Gurbuzbalaban , Umut Şimşekli , Lingjiong Zhu