English
Related papers

Related papers: Concentration inequalities for high-dimensional li…

200 papers

We derive concentration inequalities for functions of the empirical measure of large random matrices with infinitely divisible entries and, in particular, stable ones. We also give concentration results for some other functionals of these…

Probability · Mathematics 2007-06-13 Christian Houdré , Hua Xu

This paper provides the relevant literature with a complete toolkit for conducting robust estimation and inference about the parameters of interest involved in a high-dimensional panel data framework. Specifically, (1) we allow for…

Econometrics · Economics 2025-02-13 Jiti Gao , Fei Liu , Bin Peng , Yayi Yan

In this report, we aim to exemplify concentration inequalities and provide easy to understand proofs for it. Our focus is on the inequalities which are helpful in the design and analysis of machine learning algorithms.

Probability · Mathematics 2019-10-08 Kumar Abhishek , Sneha Maheshwari , Sujit Gujar

We explore the applications of our previously established likelihood-ratio method for deriving concentration inequalities for a wide variety of univariate and multivariate distributions. New concentration inequalities for various…

Statistics Theory · Mathematics 2014-09-23 Xinjia Chen

We give a concentration inequality based on the premise that random variables take values within a particular region. The concentration inequality guarantees that, for any sequence of correlated random variables, the difference between the…

Probability · Mathematics 2020-02-21 Go Kato

Kernel methods are successful approaches for different machine learning problems. This success is mainly rooted in using feature maps and kernel matrices. Some methods rely on the eigenvalues/eigenvectors of the kernel matrix, while for…

Machine Learning · Computer Science 2012-02-20 Nima Reyhani , Hideitsu Hino , Ricardo Vigario

We derive concentration inequalities for maxima of empirical processes associated with Poisson point processes. The proofs are based on a careful application of Ledoux's entropy method. We demonstrate the utility of the obtained…

Probability · Mathematics 2018-07-19 Martin Kroll

Stochastic iterative methods are useful in a variety of large-scale numerical linear algebraic, machine learning, and statistical problems, in part due to their low-memory footprint. They are frequently used in a variety of applications,…

Numerical Analysis · Mathematics 2025-11-27 Toby Anderson , Max Collins , Jamie Haddock , Jackie Lok , Elizaveta Rebrova

We examine the concentration of uniform generalization errors around their expectation in binary linear classification problems via an isoperimetric argument. In particular, we establish Poincar\'{e} and log-Sobolev inequalities for the…

Machine Learning · Statistics 2025-06-27 Shogo Nakakita

The goal of this paper is to obtain expectation bounds for the deviation of large sample autocovariance matrices from their means under weak data dependence. While the accuracy of covariance matrix estimation corresponding to independent…

Statistics Theory · Mathematics 2019-05-27 Fang Han , Yicheng Li

We extend the theory of concentration inequalities to simple random tensors with heavy-tailed coefficients. Specifically, we consider the class of sub-Weibull distributions $\mathcal{S}_\alpha$ for $\alpha \in [1, 2]$. We establish…

Mathematical Finance · Quantitative Finance 2026-03-11 Yunfan Zhao

We consider a time-varying first-order autoregressive model with irregular innovations, where we assume that the coefficient function is H\"{o}lder continuous. To estimate this function, we use a quasi-maximum likelihood based approach. A…

Statistics Theory · Mathematics 2023-02-28 Hanna Gruber , Moritz Jirak

Motivated by differential co-expression analysis in genomics, we consider in this paper estimation and testing of high-dimensional differential correlation matrices. An adaptive thresholding procedure is introduced and theoretical…

Methodology · Statistics 2015-10-22 T. Tony Cai , Anru Zhang

Recent development in high-dimensional statistical inference has necessitated concentration inequalities for a broader range of random variables. We focus on sub-Weibull random variables, which extend sub-Gaussian or sub-exponential random…

Statistics Theory · Mathematics 2023-02-28 Heejong Bong , Arun Kumar Kuchibhotla

Building on the inequalities for homogeneous tetrahedral polynomials in independent Gaussian variables due to R. Lata{\l}a we provide a concentration inequality for non-necessarily Lipschitz functions $f\colon \R^n \to \R$ with bounded…

Probability · Mathematics 2013-04-09 Radosław Adamczak , Paweł Wolff

In many contemporary statistical and machine learning methods, one needs to optimize an objective function that depends on the discrepancy between two probability distributions. The discrepancy can be referred to as a metric for…

Machine Learning · Computer Science 2025-02-11 Yijin Ni , Xiaoming Huo

Fueled in part by recent applications in neuroscience, the multivariate Hawkes process has become a popular tool for modeling the network of interactions among high-dimensional point process data. While evaluating the uncertainty of the…

Machine Learning · Statistics 2020-07-16 Xu Wang , Mladen Kolar , Ali Shojaie

High-dimensional vector autoregressive (VAR) models are important tools for the analysis of multivariate time series. This paper focuses on high-dimensional time series and on the different regularized estimation procedures proposed for…

Machine Learning · Statistics 2020-06-11 Jonas Krampe , Efstathios Paparoditis

High-dimensional time series data appear in many scientific areas in the current data-rich environment. Analysis of such data poses new challenges to data analysts because of not only the complicated dynamic dependence between the series,…

Methodology · Statistics 2022-06-22 Di Wang , Ruey S. Tsay

This work aims at estimating inverse autocovariance matrices of long memory processes admitting a linear representation. A modified Cholesky decomposition is used in conjunction with an increasing order autoregressive model to achieve this…

Statistics Theory · Mathematics 2016-03-18 Ching-Kang Ing , Hai-Tang Chiou , Meihui Guo