English
Related papers

Related papers: New-Type Hoeffding's Inequalities and Application …

200 papers

We give an extension of Hoeffding's inequality to the case of supermartingales with differences bounded from above. Our inequality strengthens or extends the inequalities of Freedman, Bernstein, Prohorov, Bennett and Nagaev.

Probability · Mathematics 2013-11-20 Xiequan Fan , Ion Grama , Quansheng Liu

Concentration inequalities are indispensable tools for studying the generalization capacity of learning models. Hoeffding's and McDiarmid's inequalities are commonly used, giving bounds independent of the data distribution. Although this…

Machine Learning · Statistics 2017-02-21 Xinxing Wu , Junping Zhang

In this work, we study the convergence \emph{in high probability} of clipped gradient methods when the noise distribution has heavy tails, ie., with bounded $p$th moments, for some $1<p\le2$. Prior works in this setting follow the same…

Optimization and Control · Mathematics 2023-04-05 Ta Duy Nguyen , Alina Ene , Huy L. Nguyen

The aim of this paper is to propose new Rosenthal-type inequalities for moments of order higher than 2 of the maximum of partial sums of stationary sequences including martingales and their generalizations. As in the recent results by…

Probability · Mathematics 2013-03-19 Florence Merlevède , Magda Peligrad

This paper studies Hoeffding's inequality for Markov chains under the generalized concentrability condition defined via integral probability metric (IPM). The generalized concentrability condition establishes a framework that interpolates…

Machine Learning · Statistics 2023-10-06 Hao Chen , Abhishek Gupta , Yin Sun , Ness Shroff

Incomplete U-statistics have been proposed to accelerate computation. They use only a subset of the subsamples required for kernel evaluations by complete U-statistics. This paper gives a finite sample bound in the style of Bernstein's…

Statistics Theory · Mathematics 2022-07-08 Andreas Maurer

The Horvitz-Thompson (HT) estimator is widely used in survey sampling. However, the variance of the HT estimator becomes large when the inclusion probabilities are highly heterogeneous. To overcome this shortcoming, in this paper, a…

Methodology · Statistics 2018-04-13 Xianpeng Zong , Rong Zhu , Guohua Zou

Many major works in social science employ matching to make causal conclusions, but different matches on the same data may produce different treatment effect estimates, even when they achieve similar balance or minimize the same loss…

Applications · Statistics 2023-03-23 Marco Morucci , Cynthia Rudin

Discrimination in machine learning often arises along multiple dimensions (a.k.a. protected attributes); it is then desirable to ensure \emph{intersectional fairness} -- i.e., that no subgroup is discriminated against. It is known that…

Machine Learning · Statistics 2023-06-27 Mathieu Molina , Patrick Loiseau

We improve the rate function of McDiarmid's inequality for Hamming distance. In particular, applying our result to the separately Lipschitz functions of independent random variables, we also refine the convergence rate function of…

Probability · Mathematics 2016-11-15 Xiequan Fan

Sums of independent, bounded random variables concentrate around their expectation approximately as well a Gaussian of the same variance. Well known results of this form include the Bernstein, Hoeffding, and Chernoff inequalities and many…

Discrete Mathematics · Computer Science 2017-04-25 Thomas Steinke , Jonathan Ullman

In the literature, the left-side of Hermite--Hadamard's inequality is called a midpoint type inequality. In this article, we obtain new integral inequalities of midpoint type for Riemann--Liouville fractional integrals of convex functions…

General Mathematics · Mathematics 2020-05-05 Pshtiwan Othman Mohammed

This paper surveys some of our recent progress on Hardy-type inequa\-lities which consist of a well-known topic in Harmonic Analysis. In the first section, we recall the original probabilistic motivation dealing with the stability speed in…

Probability · Mathematics 2014-12-02 Mu-Fa Chen

Freedman's inequality is a martingale counterpart to Bernstein's inequality. This result shows that the large-deviation behavior of a martingale is controlled by the predictable quadratic variation and a uniform upper bound for the…

Probability · Mathematics 2015-03-17 Joel A. Tropp

This paper extends classical probabilistic results to the broader class of demimartingales and demisubmartingales. We establish variants of Doob's-type optional sampling theorem under minimal structural conditions on stopping times, relying…

Probability · Mathematics 2025-07-24 Milto Hadjikyriakou , B. L. S Prakasa Rao

Two kinds of novel generalizations of Nesbitt's inequality are explored in various cases regarding dimensions and parameters in this article. Some other cases are also discussed elaborately by using the semiconcave-semiconvex theorem. The…

General Mathematics · Mathematics 2025-04-02 Junfeng Zhang , Jintao Wang

We investigate the application of the Adaptive Multilevel Splitting algorithm for the estimation of tail probabilities of solutions of Stochastic Differential Equations evaluated at a given time, and of associated temporal averages. We…

Probability · Mathematics 2019-03-27 Charles-Edouard Bréhier , Tony Lelièvre

This article proposes a new method of truncated estimation to estimate the tail index $\alpha$ of the extremely heavy-tailed distribution with infinite mean or variance. We not only present two truncated estimators $\hat{\alpha}$ and…

Statistics Theory · Mathematics 2022-09-13 F. Q. Tang , D. Han

The use of expectiles in risk management has recently gathered remarkable momentum due to their excellent axiomatic and probabilistic properties. In particular, the class of elicitable law-invariant coherent risk measures only consists of…

Statistics Theory · Mathematics 2023-03-21 Abdelaati Daouia , Simone A. Padoan , Gilles Stupfler

The aim of this paper is to establish Hoeffding and Bernstein type concentration inequalities for weighted sums of exchangeable random variables. A special case is the i.i.d. setting, where random variables are sampled independently from…

Statistics Theory · Mathematics 2025-08-11 Rina Foygel Barber