中文
相关论文

相关论文: Sparse Hanson-Wright inequalities for subgaussian …

200 篇论文

This paper considers the penalized least squares estimator with arbitrary convex penalty. When the observation noise is Gaussian, we show that the prediction error is a subgaussian random variable concentrated around its median. We apply…

统计理论 · 数学 2016-09-22 Pierre C. Bellec , Alexandre B. Tsybakov

This paper gives a review of concentration inequalities which are widely employed in non-asymptotical analyses of mathematical statistics in a wide range of settings, from distribution-free to distribution-dependent, from sub-Gaussian to…

统计理论 · 数学 2025-02-24 Huiming Zhang , Song Xi Chen

The paper re-analyzes a version of the celebrated Johnson-Lindenstrauss Lemma, in which matrices are subjected to constraints that naturally emerge from neuroscience applications: a) sparsity and b) sign-consistency. This particular variant…

统计理论 · 数学 2020-08-21 Maciej Skorski

We consider estimation of a sparse parameter vector that determines the covariance matrix of a Gaussian random vector via a sparse expansion into known "basis matrices". Using the theory of reproducing kernel Hilbert spaces, we derive lower…

信息论 · 计算机科学 2011-01-21 Alexander Jung , Sebastian Schmutzhard , Franz Hlawatsch , Alfred O. Hero

Finite sample properties of random covariance-type matrices have been the subject of much research. In this paper we focus on the "lower tail" of such a matrix, and prove that it is subgaussian under a simple fourth moment assumption on the…

概率论 · 数学 2013-12-11 Roberto Imbuzeiro Oliveira

We tackle estimating sparse coefficients in a linear regression when the covariates are sampled from an $L$-subexponential random vector. This vector belongs to a class of distributions that exhibit heavier tails than Gaussian random…

统计理论 · 数学 2024-02-07 Takeyuki Sasai

We develop a unified approach to bounding the largest and smallest singular values of an inhomogeneous random rectangular matrix, based on the non-backtracking operator and the Ihara-Bass formula for general random Hermitian matrices with a…

概率论 · 数学 2024-12-13 Ioana Dumitriu , Yizhe Zhu

Let $A$ be an isotropic, sub-gaussian $m \times n$ matrix. We prove that the process $Z_x := \|Ax\|_2 - \sqrt m \|x\|_2$ has sub-gaussian increments. Using this, we show that for any bounded set $T \subseteq \mathbb{R}^n$, the deviation of…

概率论 · 数学 2016-06-08 Christopher Liaw , Abbas Mehrabian , Yaniv Plan , Roman Vershynin

We introduce a novel Bayesian approach for both covariate selection and sparse precision matrix estimation in the context of high-dimensional Gaussian graphical models involving multiple responses. Our approach provides a sparse estimation…

统计方法学 · 统计学 2024-09-25 Anwesha Chakravarti , Naveen N. Narishetty , Feng Liang

In this article we consider Wigner matrices $X_N$ with variance profiles (also called Wigner-type matrices) which are of the form $X_N(i,j) = \sigma(i/N,j/N) a_{i,j} / \sqrt{N}$ where $\sigma$ is a symmetric real positive function of…

概率论 · 数学 2023-03-01 Jonathan Husson

Recovery of the sparsity pattern (or support) of an unknown sparse vector from a small number of noisy linear measurements is an important problem in compressed sensing. In this paper, the high-dimensional setting is considered. It is shown…

信息论 · 计算机科学 2013-02-06 Galen Reeves , Michael Gastpar

Let $A, B$ be positive definite $n\times n$ matrices. We present several reverse Heinz type inequalities, in particular \begin{align*} \|AX+XB\|_2^2+ 2(\nu-1) \|AX-XB\|_2^2\leq \|A^{\nu}XB^{1-\nu}+A^{1-\nu}XB^{\nu}\|_2^2, \end{align*} where…

泛函分析 · 数学 2015-11-09 Mojtaba Bakherad , Mohammad Sal Moslehian

We study a new class of codes for lossy compression with the squared-error distortion criterion, designed using the statistical framework of high-dimensional linear regression. Codewords are linear combinations of subsets of columns of a…

信息论 · 计算机科学 2015-12-21 Ramji Venkataramanan , Antony Joseph , Sekhar Tatikonda

A continuous-time regression model with a jointly strictly sub-Gaussian random noise is considered in the paper. Upper exponential bounds for probabilities of large deviations of the least squares estimator for the regression parameter are…

概率论 · 数学 2018-06-12 Alexander V. Ivanov , Igor V. Orlovskyi

Many theoretical results on estimation of high dimensional time series require specifying an underlying data generating model (DGM). Instead, along the footsteps of~\cite{wong2017lasso}, this paper relies only on (strict) stationarity and $…

机器学习 · 统计学 2018-02-06 Kam Chung Wong , Zifan Li , Ambuj Tewari

We propose methodology for estimation of sparse precision matrices and statistical inference for their low-dimensional parameters in a high-dimensional setting where the number of parameters $p$ can be much larger than the sample size. We…

统计理论 · 数学 2016-07-21 Jana Janková , Sara van de Geer

We prove the equivalent of the Baik, Ben Arous, P\'ech\'e (2004) phenomenon for a novel, doubly sparse model where both the Wigner noise matrix and signal vector(s) are sparse. Specifically, we consider a deformed sub-Gaussian sparse Wigner…

概率论 · 数学 2026-03-16 Ioana Dumitriu , JD Flynn , Zhichao Wang

The eigenvalue density for members of the Gaussian orthogonal and unitary ensembles follows the Wigner semi-circle law. If the Gaussian entries are all shifted by a constant amount c/Sqrt(2N), where N is the size of the matrix, in the large…

数学物理 · 物理学 2009-04-21 Kevin E. Bassler , Peter J. Forrester , Norman E. Frankel

We consider the model {eqnarray*}y=X\theta^*+\xi, Z=X+\Xi,{eqnarray*} where the random vector $y\in\mathbb{R}^n$ and the random $n\times p$ matrix $Z$ are observed, the $n\times p$ matrix $X$ is unknown, $\Xi$ is an $n\times p$ random noise…

统计理论 · 数学 2010-11-11 Mathieu Rosenbaum , Alexandre B. Tsybakov

Many theoretical results for the lasso require the samples to be iid. Recent work has provided guarantees for the lasso assuming that the time series is generated by a sparse Vector Auto-Regressive (VAR) model with Gaussian innovations.…

统计理论 · 数学 2019-03-22 Kam Chung Wong , Zifan Li , Ambuj Tewari