English
Related papers

Related papers: Jackknife multiplier bootstrap: finite sample appr…

200 papers

Resampling methods are especially well-suited to inference with estimators that provide only "black-box'' access. Jackknife is a form of resampling, widely used for bias correction and variance estimation, that is well-understood under…

Statistics Theory · Mathematics 2024-11-06 Licong Lin , Fangzhou Su , Wenlong Mou , Peng Ding , Martin Wainwright

We study the bootstrap for the maxima of the sums of independent random variables, a problem of high relevance to many applications in modern statistics. Since the consistency of bootstrap was justified by Gaussian approximation in…

Statistics Theory · Mathematics 2020-08-03 Hang Deng

This article derives quantitative limit theorems for multivariate Poisson and Poisson process approximations. Employing the solution of Stein's equation for Poisson random variables, we obtain an explicit bound for the multivariate Poisson…

Probability · Mathematics 2021-06-01 Federico Pianoforte , Riccardo Turin

We study the problem of distributional approximations to high-dimensional non-degenerate $U$-statistics with random kernels of diverging orders. Infinite-order $U$-statistics (IOUS) are a useful tool for constructing simultaneous prediction…

Statistics Theory · Mathematics 2019-12-11 Yanglei Song , Xiaohui Chen , Kengo Kato

Optimal feedback control with implicit Hamiltonians poses a fundamental challenge for learning-based value function methods due to the absence of closed-form optimal control laws. Recent work~\cite{gelphman2025end} introduced an implicit…

Optimization and Control · Mathematics 2026-04-28 Eric Gelphman , Deepanshu Verma , Nicole Tianjiao Yang , Stanley Osher , Samy Wu Fung

Bootstrap for nonlinear statistics like U-statistics of dependent data has been studied by several authors. This is typically done by producing a bootstrap version of the sample and plugging it into the statistic. We suggest an alternative…

Statistics Theory · Mathematics 2015-05-28 Olimjon Sh. Sharipov , Johannes Tewes , Martin Wendler

The asymptotic validity of a resampling method for two sequential processes constructed from non-degenerate $U$-statistics is established under mixing conditions. The resampling schemes, referred to as {\em dependent multiplier bootstraps},…

Statistics Theory · Mathematics 2015-05-29 Axel Bücher , Ivan Kojadinovic

Hierarchical Bayesian Poisson regression models (HBPRMs) provide a flexible modeling approach of the relationship between predictors and count response variables. The applications of HBPRMs to large-scale datasets require efficient…

Machine Learning · Computer Science 2024-07-03 Jin-Zhu Yu , Hiba Baroud

We consider the problem of quantifying uncertainty for the estimation error of the leading eigenvector from Oja's algorithm for streaming principal component analysis, where the data are generated IID from some unknown distribution. By…

Statistics Theory · Mathematics 2022-05-23 Robert Lunde , Purnamrita Sarkar , Rachel Ward

In this paper, we refine the Berry-Esseen bounds for the multivariate normal approximation of Polyak-Ruppert averaged iterates arising from the linear stochastic approximation (LSA) algorithm with decreasing step size. We consider the…

Machine Learning · Statistics 2025-10-15 Bogdan Butyrin , Eric Moulines , Alexey Naumov , Sergey Samsonov , Qi-Man Shao , Zhuo-Song Zhang

We study boundary non-crossing probabilities $$ P_{f,u} := \mathrm P\big(\forall t\in \mathbb T\ X_t + f(t)\le u(t)\big) $$ for continuous centered Gaussian process $X$ indexed by some arbitrary compact separable metric space $\mathbb T$.…

Probability · Mathematics 2020-03-16 Enkelejd Hashorva , Yuliya Mishura , Georgiy Shevchenko

The study of time-inhomogeneous Markov jump processes is a traditional topic within probability theory that has recently attracted substantial attention in various applications. However, their flexibility also incurs a substantial…

Probability · Mathematics 2023-11-03 Martin Bladt , Oscar Peralta

Covariance matrix estimation, a classical statistical topic, poses significant challenges when the sample size is comparable to or smaller than the number of features. In this paper, we frame covariance matrix estimation as a compound…

Methodology · Statistics 2025-03-04 Huqin Xin , Sihai Dave Zhao

This paper deals with the quantitative normal approximation of non-linear functionals of Poisson random measures, where the quality is measured by the Kolmogorov distance. Combining Stein's method with the Malliavin calculus of variations…

Probability · Mathematics 2014-10-30 Peter Eichelsbacher , Christoph Thaele

Introducing inequality constraints in Gaussian process (GP) models can lead to more realistic uncertainties in learning a great variety of real-world problems. We consider the finite-dimensional Gaussian approach from Maatouk and Bay (2017)…

Machine Learning · Statistics 2021-11-04 Andrés F. López-Lopera , François Bachoc , Nicolas Durrande , Olivier Roustant

Upper Confidence Bound (UCB) method is arguably the most celebrated one used in online decision making with partial information feedback. Existing techniques for constructing confidence bounds are typically built upon various concentration…

Machine Learning · Statistics 2019-11-01 Botao Hao , Yasin Abbasi-Yadkori , Zheng Wen , Guang Cheng

One reason why standard formulations of the central limit theorems are not applicable in high-dimensional and non-stationary regimes is the lack of a suitable limit object. Instead, suitable distributional approximations can be used, where…

Statistics Theory · Mathematics 2024-12-20 Fabian Mies

We present a new approach to the bootstrap for chains of infinite order taking values on a finite alphabet. It is based on a sequential Bootstrap Central Limit Theorem for the sequence of canonical Markov approximations of the chain of…

Probability · Mathematics 2007-05-23 P. Collet , D. Duarte , A. Galves

The use of Gaussian processes (GPs) is supported by efficient sampling algorithms, a rich methodological literature, and strong theoretical grounding. However, due to their prohibitive computation and storage demands, the use of exact GPs…

Statistics Theory · Mathematics 2022-07-27 Kelly R. Moran , Matthew W. Wheeler

The widespread use of Markov Chain Monte Carlo (MCMC) methods for high-dimensional applications has motivated research into the scalability of these algorithms with respect to the dimension of the problem. Despite this, numerous problems…

Computation · Statistics 2024-10-21 Ardjen Pengel , Jun Yang , Zhou Zhou