English
Related papers

Related papers: Risk Bounds for Infinitely Divisible Distribution

200 papers

This article proposes a novel test for the martingale difference hypothesis based on the martingale difference divergence function, a recently developed dependence measure suitable for measuring the degree of conditional mean dependence of…

Applications · Statistics 2023-11-10 Luca Mattia Rolla

This paper presents uniform-in-time finite-sample bounds for regularized linear regression with vector-valued outputs and conditionally zero-mean subgaussian noise. By revisiting classical self-normalized martingale arguments, we obtain…

Statistics Theory · Mathematics 2026-03-20 Léo Simpson , Katrin Baumgärtner , Johannes Köhler , Moritz Diehl

Viewing a two time scale stochastic approximation scheme as a noisy discretization of a singularly perturbed differential equation, we obtain a concentration bound for its iterates that captures its behavior with quantifiable high…

Optimization and Control · Mathematics 2018-06-29 Vivek S. Borkar , Sarath Pattathil

In this paper, we study tail inequalities of the largest eigenvalue of a matrix infinitely divisible (i.d.) series, which is a finite sum of fixed matrices weighted by i.d. random variables. We obtain several types of tail inequalities,…

Information Theory · Computer Science 2022-05-31 Chao Zhang , Xianjie Gao , Min-Hsiu Hsieh , Hanyuan Hang , Dacheng Tao

We establish the limiting spectral distribution of Kendall's correlation matrices in the moderate high-dimensional regime where the dimension grows slower than the sample size. Our framework allows observations to be independent but not…

Statistics Theory · Mathematics 2026-03-10 Raunak Shevade , Monika Bhattacharjee

We consider the asymptotic behavior of posterior distributions and Bayes estimators based on observations which are required to be neither independent nor identically distributed. We give general results on the rate of convergence of the…

Statistics Theory · Mathematics 2009-09-29 Subhashis Ghosal , Aad van der Vaart

This paper extends standard results from learning theory with independent data to sequences of dependent data. Contrary to most of the literature, we do not rely on mixing arguments or sequential measures of complexity and derive uniform…

Machine Learning · Computer Science 2023-03-22 Fabien Lauer

We state some inequalities for m-divisible and infinite divisible characteristic functions. Basing on them we propose a statistical test for a distribution to be infinitely divisible. Keywords: infinite divisible distributions; statistical…

Probability · Mathematics 2019-04-17 Lev B. Klebanov , Ashot V. Kakosyan , Irina V. Volchenkova

This paper proposes to unify fading distributions by modeling the magnitude-squared of the instantaneous channel gain as an infinitely divisible random variable. A random variable is said to be infinitely divisible, if it can be written as…

Information Theory · Computer Science 2015-08-21 Adithya Rajan , Cihan Tepedelenlioglu , Ruochen Zeng

Model selection is often performed by empirical risk minimization. The quality of selection in a given situation can be assessed by risk bounds, which require assumptions both on the margin and the tails of the losses used. Starting with…

Statistics Theory · Mathematics 2008-12-18 Charles Mitchell , Sara van de Geer

A general device is proposed, which provides for extension of exponential inequalities for sums of independent real-valued random variables to those for martingales in the 2-smooth Banach spaces. This is used to obtain optimum bounds of the…

Probability · Mathematics 2012-12-11 Iosif Pinelis

In this paper, we consider $m$ independent random rectangular matrices whose entries are independent and identically distributed standard complex Gaussian random variables and assume the product of the $m$ rectangular matrices is an $n$ by…

Probability · Mathematics 2021-04-08 Yongcheng Qi , Hongru Zhao

The application of machine learning models can be significantly impeded by the occurrence of distributional shifts, as the assumption of homogeneity between the population of training and testing samples in machine learning and statistics…

Machine Learning · Statistics 2023-06-06 Wenlu Tang , Zicheng Liu

We study extremal statistics and return intervals in stationary long-range correlated sequences for which the underlying probability density function is bounded and uniform. The extremal statistics we consider e.g., maximum relative to…

Statistical Mechanics · Physics 2015-05-13 N. R. Moloney , J. Davidsen

Domain generalization (DG) aims to learn predictive models that can generalize to unseen domains. Most existing DG approaches focus on learning domain-invariant representations under the assumption of conditional distribution shift (i.e.,…

Machine Learning · Computer Science 2026-02-03 Jewon Yeom , Kyubyung Chae , Hyunggyu Lim , Yoonna Oh , Dongyoon Yang , Taesup Kim

We study the joint laws of a continuous, uniformly integrable martingale, its maximum, and its minimum. In particular, we give explicit martingale inequalities which provide upper and lower bounds on the joint exit probabilities of a…

Probability · Mathematics 2015-03-31 Alexander M. G. Cox , Jan Obłój

We study the problem of bounding path-dependent expectations (within any finite time horizon $d$) over the class of discrete-time martingales whose marginal distributions lie within a prescribed tolerance of a given collection of benchmark…

Probability · Mathematics 2021-12-01 Zhengqing Zhou , Jose Blanchet , Peter W. Glynn

We analyze the practices of reservoir computing in the framework of statistical learning theory. In particular, we derive finite sample upper bounds for the generalization error committed by specific families of reservoir computing systems…

Machine Learning · Computer Science 2019-10-31 Lukas Gonon , Lyudmila Grigoryeva , Juan-Pablo Ortega

This paper considers a distributionally robust chance constraint model with a general ambiguity set. We show that a sample based approximation of this model converges under suitable sufficient conditions. We also show that upper and lower…

Optimization and Control · Mathematics 2025-01-17 Jiaqi Lei , Sanjay Mehrotra

This paper derives new bounds on the difference of the entropies of two discrete random variables in terms of the local and total variation distances between their probability mass functions. The derivation of the bounds relies on maximal…

Information Theory · Computer Science 2016-11-17 Igal Sason