English
Related papers

Related papers: Order-Explicit Linearization of High-Dimensional $…

200 papers

We develop Gaussian approximations for high-dimensional vectors formed by second-order $U$- and $V$-statistics whose kernels depend on sample size under independent but not identically distributed (i.n.i.d.) sampling. Our results hold…

Statistics Theory · Mathematics 2026-05-26 Shunsuke Imai

We derive a consistency result, in the $L_1$-sense, for incomplete U-statistics in the non-standard case where the kernel at hand has infinite second-order moments. Assuming that the kernel has finite moments of order $p(\geq 1)$, we obtain…

Statistics Theory · Mathematics 2021-12-30 Alexander Dürre , Davy Paindaveine

We study the problem of distributional approximations to high-dimensional non-degenerate $U$-statistics with random kernels of diverging orders. Infinite-order $U$-statistics (IOUS) are a useful tool for constructing simultaneous prediction…

Statistics Theory · Mathematics 2019-12-11 Yanglei Song , Xiaohui Chen , Kengo Kato

We prove a convergence theorem for U-statistics of degree two, where the data dimension $d$ is allowed to scale with sample size $n$. We find that the limiting distribution of a U-statistic undergoes a phase transition from the…

Statistics Theory · Mathematics 2023-07-04 Kevin H. Huang , Xing Liu , Andrew B. Duncan , Axel Gandy

Motivated by small bandwidth asymptotics for kernel-based semiparametric estimators in econometrics, this paper establishes Gaussian approximation results for high-dimensional fixed-order $U$-statistics whose kernels depend on the sample…

Statistics Theory · Mathematics 2025-10-15 Shunsuke Imai , Yuta Koike

We consider in this paper the problem of sampling a high-dimensional probability distribution $\pi$ having a density with respect to the Lebesgue measure on $\mathbb{R}^d$, known up to a normalization constant $x \mapsto \pi(x)=…

Statistics Theory · Mathematics 2018-07-17 Alain Durmus , Eric Moulines

Extreme U-statistics arise when the kernel of a U-statistic has a high degree but depends only on its arguments through a small number of top order statistics. As the kernel degree of the U-statistic grows to infinity with the sample size,…

Statistics Theory · Mathematics 2023-01-09 Jochem Oorschot , Johan Segers , Chen Zhou

We study deviation of U-statistics when samples have heavy-tailed distribution so the kernel of the U-statistic does not have bounded exponential moments at any positive point. We obtain an exponential upper bound for the tail of the…

Probability · Mathematics 2023-01-30 Milad Bakhshizadeh

We prove ratio-consistency of the jackknife variance estimator, and certain variants, for a broad class of generalized U-statistics whose variance is asymptotically dominated by their H\'ajek projection, with the classical fixed-order case…

Statistics Theory · Mathematics 2025-09-17 Jakob R. Juergens

Diffusion generative models have emerged as powerful tools for producing synthetic data from an empirically observed distribution. A common approach involves simulating the time-reversal of an Ornstein-Uhlenbeck (OU) process initialized at…

Machine Learning · Statistics 2025-12-02 Valentin de Bortoli , Romuald Elie , Anna Kazeykina , Zhenjie Ren , Jiacheng Zhang

Infinite-order U-statistics (IOUS) has been used extensively on subbagging ensemble learning algorithms such as random forests to quantify its uncertainty. While normality results of IOUS have been studied extensively, its variance…

Machine Learning · Statistics 2023-02-16 Tianning Xu , Ruoqing Zhu , Xiaofeng Shao

We establish a strong Gaussian approximation for high-dimensional non-degenerate U-statistics with diverging dimension. Under mild assumptions, we construct, on a sufficiently rich probability space, a Gaussian process that uniformly…

Statistics Theory · Mathematics 2026-03-12 Weijia Li , Leheng Cai , Qirui Hu

We consider a class of statistical inverse problems involving the estimation of a regression operator from a Polish space to a separable Hilbert space, where the target lies in a vector-valued reproducing kernel Hilbert space induced by an…

Machine Learning · Statistics 2026-04-28 Jia-Qi Yang , Lei Shi

This paper studies the Gaussian and bootstrap approximations for the probabilities of a non-degenerate U-statistic belonging to the hyperrectangles in $\mathbb{R}^d$ when the dimension $d$ is large. A two-step Gaussian approximation…

Statistics Theory · Mathematics 2017-07-11 Xiaohui Chen

This survey will appear as a chapter of the forthcoming book [19]. A U-statistic of order $k$ with kernel $f:\X^k \to \R^d$ over a Poisson process is defined in \cite{ReiSch11} as$$ \sum\_{x\_1, \dots , x\_k \in \eta^k\_{\neq}} f(x\_1,…

Probability · Mathematics 2015-03-27 Raphaël Lachèze-Rey , Matthias Reitzner

In this paper, we establish an exponential inequality for U-statistics of i.i.d. data, varying kernel and taking values in a separable Hilbert space. The bound are expressed as a sum of an exponential term plus an other one involving the…

Probability · Mathematics 2024-09-19 Davide Giraudo

Incomplete U-statistics have been proposed to accelerate computation. They use only a subset of the subsamples required for kernel evaluations by complete U-statistics. This paper gives a finite sample bound in the style of Bernstein's…

Statistics Theory · Mathematics 2022-07-08 Andreas Maurer

In many contemporary statistical and machine learning methods, one needs to optimize an objective function that depends on the discrepancy between two probability distributions. The discrepancy can be referred to as a metric for…

Machine Learning · Computer Science 2025-02-11 Yijin Ni , Xiaoming Huo

In this paper, we considier the limiting distribution of the maximum interpoint Euclidean distance $M_n=\max _{1 \leq i<j \leq n}\left\|\boldsymbol{X}_i-\boldsymbol{X}_j\right\|$, where $\boldsymbol{X}_1, \boldsymbol{X}_2, \ldots,…

Probability · Mathematics 2023-12-19 Guowei Yan , Long Feng

This paper studies Kernel Density Estimation for a high-dimensional distribution $\rho(x)$. Traditional approaches have focused on the limit of large number of data points $n$ and fixed dimension $d$. We analyze instead the regime where…

Machine Learning · Computer Science 2024-10-21 Giulio Biroli , Marc Mézard
‹ Prev 1 2 3 10 Next ›