English
Related papers

Related papers: Concentration inequalities for high-dimensional li…

200 papers

We study low-rank matrix regression in settings where matrix-valued predictors and scalar responses are observed across multiple individuals. Rather than assuming a fully homogeneous coefficient matrices across individuals, we accommodate…

Methodology · Statistics 2025-10-28 Di Wang , Xiaoyu Zhang , Guodong Li , Wenyang Zhang

We present a set of high-probability inequalities that control the concentration of weighted averages of multiple (possibly uncountably many) simultaneously evolving and interdependent martingales. Our results extend the PAC-Bayesian…

Machine Learning · Computer Science 2012-07-31 Yevgeny Seldin , François Laviolette , Nicolò Cesa-Bianchi , John Shawe-Taylor , Peter Auer

We derive new comparison inequalities between weak and strong moments of norms of random vectors with optimal (up to an universal factor) constants. We discuss applications to the concentration of log-concave random vectors and bounds on…

Probability · Mathematics 2021-06-08 Rafał Latała , Piotr Nayar

In this work we investigate the generic properties of a stochastic linear model in the regime of high-dimensionality. We consider in particular the Vector AutoRegressive model (VAR) and the multivariate Hawkes process. We analyze both…

Statistical Mechanics · Physics 2015-06-11 Iacopo Mastromatteo , Emmanuel Bacry , Jean-François Muzy

The variance--covariance matrix plays a central role in the inferential theories of high-dimensional factor models in finance and economics. Popular regularization methods of directly exploiting sparsity are not directly applicable to many…

Methodology · Statistics 2012-03-15 Jianqing Fan , Yuan Liao , Martina Mincheva

We develop a new framework for deriving time-uniform concentration bounds for the output of stochastic sequential algorithms satisfying certain recursive inequalities akin to those defining the almost-supermartingale processes introduced by…

Statistics Theory · Mathematics 2025-11-25 Tuan Pham , Alessandro Rinaldo , Purnamrita Sarkar

Our goal is to estimate causal interactions in multivariate time series. Using vector autoregressive (VAR) models, these can be defined based on non-vanishing coefficients belonging to respective time-lagged instances. As in most cases a…

Methodology · Statistics 2010-08-13 Stefan Haufe , Guido Nolte , Klaus-Robert Mueller , Nicole Kraemer

In the context of interacting particle systems, we study the influence of the action of the semigroup on the concentration property of Lipschitz functions. As an application, this gives a new approach to estimate the relaxation speed to…

Probability · Mathematics 2015-06-30 Jean René Chazottes , Pierre Collet , Frank Redig

Motivated by statistical analysis of latent factor models for high-frequency financial data, we develop sharp upper bounds for the spectral norm of the realized covariance matrix of a high-dimensional It\^o semimartingale with possibly…

Statistics Theory · Mathematics 2023-10-11 Yuta Koike

We show that the mixing times of random walks on compact groups can be used to obtain concentration inequalities for the respective Haar measures. As an application, we derive a concentration inequality for the empirical distribution of…

Probability · Mathematics 2007-05-23 Sourav Chatterjee

Vector autoregressive (VAR) models are widely used for causal discovery and forecasting in multivariate time series analysis. In the high-dimensional setting, which is increasingly common in fields such as neuroscience and econometrics,…

We prove a concentration inequality for sequential dynamical systems of the unit interval enjoying an exponential loss of memory in the BV norm, and we investigate several of its consequences. In particular, this covers compositions of…

Dynamical Systems · Mathematics 2015-02-10 Romain Aimino , Jérôme Rousseau

The paper addresses parametric inequality systems described by polynomial functions in finite dimensions, where state-dependent infinite parameter sets are given by finitely many polynomial inequalities and equalities. Such systems can be…

Optimization and Control · Mathematics 2015-09-15 G. Li , B. S. Mordukhovich , T. T. A. Nghia , T. S. Pham

We establish upper bounds for tails of order statistics of isotropic log-concave vectors and apply them to derive a concentration of l_r norms of such vectors.

Probability · Mathematics 2014-09-19 Rafał Latała

This paper gives new concentration inequalities for the spectral norm of a wide class of matrix martingales in continuous time. These results extend previously established Freedman and Bernstein inequalities for series of random matrices to…

Probability · Mathematics 2016-10-28 Emmanuel Bacry , Stéphane Gaïffas , Jean-François Muzy

Matrix concentration inequalities provide information about the probability that a random matrix is close to its expectation with respect to the $l_2$ operator norm. This paper uses semigroup methods to derive sharp nonlinear matrix…

Probability · Mathematics 2021-01-08 De Huang , Joel A. Tropp

This paper studies inference in linear models with a high-dimensional parameter matrix that can be well-approximated by a ``spiked low-rank matrix.'' A spiked low-rank matrix has rank that grows slowly compared to its dimensions and nonzero…

Statistics Theory · Mathematics 2023-01-04 Victor Chernozhukov , Christian Hansen , Yuan Liao , Yinchu Zhu

In this paper we study the concentration properties for the eigenvalues of kernel matrices, which are central objects in a wide range of kernel methods and, more recently, in network analysis. We present a set of concentration inequalities…

Machine Learning · Statistics 2020-10-27 Ernesto Araya Valdivia

Seemingly unrelated linear regression models are introduced in which the distribution of the errors is a finite mixture of Gaussian components. Identifiability conditions are provided. The score vector and the Hessian matrix are derived.…

Methodology · Statistics 2014-03-18 Giuliano Galimberti , Elena Scardovi , Gabriele Soffritti

We prove nonasymptotic matrix concentration inequalities for the spectral norm of (sub)gaussian random matrices with centered independent entries that capture fluctuations at the Tracy-Widom scale. This considerably improves previous bounds…

Probability · Mathematics 2025-03-21 Tatiana Brailovskaya , Ramon van Handel