English
Related papers

Related papers: Bounding the expectation of the supremum of empiri…

200 papers

Given a bounded class of functions G and independent random variables X1, . . . , Xn, we provide an upper bound for the expectation of the supremum of the empirical process over elements of G having a small variance. Our bound applies in…

Probability · Mathematics 2015-09-08 Yannick Baraud

We introduce a maximal inequality for a local empirical process under strongly mixing data. Local empirical processes are defined as the (local) averages $\frac{1}{nh}\sum_{i=1}^n \mathbf{1}\{x - h \leq X_i \leq x+h\}f(Z_i)$, where $f$…

Econometrics · Economics 2023-07-06 Luis Alvarez , Cristine Pinto

The expected supremum of a Gaussian process indexed by the image of an index set under a function class is bounded in terms of separate properties of the index set and the function class. The bound is relevant to the estimation of nonlinear…

Machine Learning · Computer Science 2014-11-12 Andreas Maurer

We study the empirical process indexed by F^2=\{f^2 : f \in F\}, where F is a class of mean-zero functions on a probability space. We present a sharp bound on the supremum of that process which depends on the \psi_1 diameter of the class F…

Functional Analysis · Mathematics 2010-05-06 Shahar Mendelson

We obtain an upper bound on the expected supremum of a Bernoulli process indexed by the image of an index set under a uniformly Lipschitz function class in terms of properties of the index set and the function class, extending an earlier…

Probability · Mathematics 2023-05-12 Yifeng Chu , Maxim Raginsky

It is common to model a deterministic response function, such as the output of a computer experiment, as a Gaussian process with a Mat\'ern covariance kernel. The smoothness parameter of a Mat\'ern kernel determines many important…

Statistics Theory · Mathematics 2023-11-28 Toni Karvonen

For time series with high temporal correlation, the empirical process converges rather slowly to its limiting distribution. Many statistics in change-point analysis, goodness-of-fit testing and uncertainty quantification admit a…

Statistics Theory · Mathematics 2025-05-26 Annika Betken , Marie-Christine Düker

Empirical process theory for i.i.d. observations has emerged as a ubiquitous tool for understanding the generalization properties of various statistical problems. However, in many applications where the data exhibit temporal dependencies…

Statistics Theory · Mathematics 2024-01-18 Nabarun Deb , Debarghya Mukherjee

We consider non-convex stochastic optimization using first-order algorithms for which the gradient estimates may have heavy tails. We show that a combination of gradient clipping, momentum, and normalized gradient descent yields convergence…

Machine Learning · Computer Science 2021-11-10 Ashok Cutkosky , Harsh Mehta

We study two empirical process of special structure: firstly, the centred multiplier process indexed by a class $F$, $f \to \left|\sum_{i=1}^N (\xi_i f(X_i) - \E \xi f)\right|$, where the i.i.d. multipliers $(\xi_i)_{i=1}^N$ need not be…

Probability · Mathematics 2015-10-05 Shahar Mendelson

Let $\mathcal{F}$ be a class of measurable functions $f:S\mapsto [0,1]$ defined on a probability space $(S,\mathcal{A},P)$. Given a sample (X_1,...,X_n) of i.i.d. random variables taking values in S with common distribution P, let P_n…

Statistics Theory · Mathematics 2011-11-10 Vladimir Koltchinskii

In this paper, we develop a general machinery for finding explicit uniform probability and moment bounds on sub-additive positive functionals of random processes. Using the developed general technique, we derive uniform bounds on the…

Probability · Mathematics 2012-02-09 Alexander Goldenshluger , Oleg Lepski

For a L\'evy process $X$ on a finite time interval consider the probability that it exceeds some fixed threshold $x>0$ while staying below $x$ at the points of a regular grid. We establish exact asymptotic behavior of this probability as…

Probability · Mathematics 2022-01-05 Krzysztof Bisewski , Jevgenijs Ivanovs

We provide some non asymptotic bounds, with explicit constants, that measure the rate of convergence, in expected Wasserstein distance, of the empirical measure associated to an i.i.d. $N$-sample of a given probability distribution on…

Probability · Mathematics 2023-03-15 Nicolas Fournier

We discuss the method of bounding suprema of canonical processes based on the inclusion of their index set into a convex hull of a well-controlled set of points. While the upper bound is immediate, the reverse estimate was established to…

Probability · Mathematics 2024-05-24 Rafał Latała

Recently, several strong limit theorems for the oscillation moduli of the empirical process have been given in the iid-case. We show that, with very slight differences, those strong results are also obtained for some representation of the…

Methodology · Statistics 2014-07-01 Gane Samb Lo

In order to circumvent statistical and computational hardness results in sequential decision-making, recent work has considered smoothed online learning, where the distribution of data at each time is assumed to have bounded likeliehood…

Machine Learning · Statistics 2024-02-26 Adam Block , Alexander Rakhlin , Abhishek Shetty

We consider the behavior of spatial point processes when subjected to a class of linear transformations indexed by a variable T. It was shown in Ellis [Adv. in Appl. Probab. 18 (1986) 646-659] that, under mild assumptions, the transformed…

Probability · Mathematics 2007-05-23 Dominic Schuhmacher

A class of distance measures on probabilities -- the integral probability metrics (IPMs) -- is addressed: these include the Wasserstein distance, Dudley metric, and Maximum Mean Discrepancy. IPMs have thus far mostly been used in more…

Information Theory · Computer Science 2009-10-13 Bharath K. Sriperumbudur , Kenji Fukumizu , Arthur Gretton , Bernhard Schölkopf , Gert R. G. Lanckriet

In this paper we develop non-asymptotic Gaussian approximation results for the sampling distribution of suprema of empirical processes when the indexing function class $\mathcal{F}_n$ varies with the sample size $n$ and may not be Donsker.…

Statistics Theory · Mathematics 2023-09-06 Alexander Giessing
‹ Prev 1 2 3 10 Next ›