English
Related papers

Related papers: Sharp failure rates for the bootstrap particle fil…

200 papers

We derive closed-form expressions for the Bayes optimal decision boundaries in binary classification of high dimensional overlapping Gaussian mixture model (GMM) data, and show how they depend on the eigenstructure of the class covariances,…

Machine Learning · Statistics 2024-05-29 Khen Cohen , Noam Levi , Yaron Oz

Identifying the number of factors in a high-dimensional factor model has attracted much attention in recent years and a general solution to the problem is still lacking. A promising ratio estimator based on the singular values of the lagged…

Methodology · Statistics 2018-01-23 Zeng Li , Qinwen Wang , Jianfeng Yao

In this paper we study the joint distributional convergence of the largest eigenvalues of the sample covariance matrix of a $p$-dimensional time series with iid entries when $p$ converges to infinity together with the sample size $n$. We…

Probability · Mathematics 2016-08-26 Johannes Heiny , Thomas Mikosch

The discovery of particle filtering methods has enabled the use of nonlinear filtering in a wide array of applications. Unfortunately, the approximation error of particle filters typically grows exponentially in the dimension of the…

Statistics Theory · Mathematics 2015-09-10 Patrick Rebeschini , Ramon van Handel

Weight sharing, equivariance, and local filters, as in convolutional neural networks, are believed to contribute to the sample efficiency of neural networks. However, it is not clear how each one of these design choices contributes to the…

Machine Learning · Computer Science 2025-01-27 Arash Behboodi , Gabriele Cesa

In this paper, we characterize the asymptotic and large scale behavior of the eigenvalues of wavelet random matrices in high dimensions. We assume that possibly non-Gaussian, finite-variance $p$-variate measurements are made of a…

Statistics Theory · Mathematics 2024-06-11 Patrice Abry , B. Cooper Boniece , Gustavo Didier , Herwig Wendt

This article reviews and studies the properties of Bayesian quadrature weights, which strongly affect stability and robustness of the quadrature rule. Specifically, we investigate conditions that are needed to guarantee that the weights are…

Statistics Theory · Mathematics 2019-08-05 Toni Karvonen , Motonobu Kanagawa , Simo Särkkä

We propose a new sampling-based approach for approximate inference in filtering problems. Instead of approximating conditional distributions with a finite set of states, as done in particle filters, our approach approximates the…

Machine Learning · Computer Science 2020-03-03 Xuan Su , Wee Sun Lee , Zhen Zhang

We establish a central limit theorem for (a sequence of) multivariate martingales which dimension potentially grows with the length $n$ of the martingale. A consequence of the results are Gaussian couplings and a multiplier bootstrap for…

Statistics Theory · Mathematics 2018-09-11 Alexandre Belloni , Roberto I. Oliveira

We study the efficient learnability of high-dimensional Gaussian mixtures in the outlier-robust setting, where a small constant fraction of the data is adversarially corrupted. We resolve the polynomial learnability of this problem when the…

Data Structures and Algorithms · Computer Science 2020-05-14 Ilias Diakonikolas , Samuel B. Hopkins , Daniel Kane , Sushrut Karmalkar

This paper studies the Gaussian and bootstrap approximations for the probabilities of a non-degenerate U-statistic belonging to the hyperrectangles in $\mathbb{R}^d$ when the dimension $d$ is large. A two-step Gaussian approximation…

Statistics Theory · Mathematics 2017-07-11 Xiaohui Chen

The use of Gaussian processes (GPs) is supported by efficient sampling algorithms, a rich methodological literature, and strong theoretical grounding. However, due to their prohibitive computation and storage demands, the use of exact GPs…

Statistics Theory · Mathematics 2022-07-27 Kelly R. Moran , Matthew W. Wheeler

We investigate the maximal size of distinguished submatrices of a Gaussian random matrix. Of interest are submatrices whose entries have average greater than or equal to a positive constant, and submatrices whose entries are well-fit by a…

Statistics Theory · Mathematics 2010-09-06 Xing Sun , Andrew B. Nobel

Motivated by statistical inference problems in high-dimensional time series data analysis, we first derive non-asymptotic error bounds for Gaussian approximations of sums of high-dimensional dependent random vectors on hyper-rectangles,…

Statistics Theory · Mathematics 2024-06-05 Jinyuan Chang , Xiaohui Chen , Mingcong Wu

We use confocal microscopy to study a random close packed sample of colloidal particles. We introduce an algorithm to estimate the size of each particle. Taking into account their sizes, we compute the compressibility of the sample as a…

Soft Condensed Matter · Physics 2011-12-08 Rei Kurita , Eric R. Weeks

Theoretical results for importance sampling rely on the existence of certain moments of the importance weights, which are the ratios between the proposal and target densities. In particular, a finite variance ensures square root convergence…

Methodology · Statistics 2013-07-31 Michael K. Pitt , Minh-Ngoc Tran , Marcel Scharth , Robert Kohn

The ability to quantify distinctness of a cluster structure is fundamental for certain simulation studies, in particular for those comparing performance of different classification algorithms. The intrinsic integral measure based on the…

Statistics Theory · Mathematics 2014-07-29 Ewa Nowakowska , Jacek Koronacki , Stan Lipovetsky

We investigate covariance shrinkage for Hotelling's $T^2$ in the regime where the data dimension $p$ and the sample size $n$ grow in a fixed ratio -- without assuming that the population covariance matrix is spiked or well-conditioned. When…

Statistics Theory · Mathematics 2025-06-13 Benjamin D. Robinson , Van Latimer

Embedding-based representations in Euclidean space $\mathbb{R}^d$ are a cornerstone of modern machine learning, where a major goal is to use the \emph{smallest dimension} that faithfully captures data relations. In this work, we prove sharp…

Data Structures and Algorithms · Computer Science 2026-05-06 Dionysis Arvanitakis , Vaggos Chatziafratis , Yiyuan Luo

This paper studies the impact of bootstrap procedure on the eigenvalue distributions of the sample covariance matrix under a high-dimensional factor structure. We provide asymptotic distributions for the top eigenvalues of bootstrapped…

Statistics Theory · Mathematics 2023-11-21 Long Yu , Peng Zhao , Wang Zhou