English
Related papers

Related papers: A note on the improved sparse Hanson-Wright inequa…

200 papers

A concentration result for quadratic form of independent subgaussian random variables is derived. If the moments of the random variables satisfy a "Bernstein condition", then the variance term of the Hanson-Wright inequality can be…

Statistics Theory · Mathematics 2019-01-28 Pierre C Bellec

This paper aims at achieving a simultaneously sparse and low-rank estimator from the semidefinite population covariance matrices. We first benefit from a convex optimization which develops $l_1$-norm penalty to encourage the sparsity and…

Statistics Theory · Mathematics 2014-08-08 Shenglong Zhou , Naihua Xiu , Ziyan Luo , Lingchen Kong

For each $ d \geq 2$, the Hilbert transform with a polynomial oscillation as below satisfies a $ (1, r )$ sparse bound, for all $ r>1$ $$ H _{ \ast } f (x) = \sup _{\epsilon } \Bigl\lvert \int_{|y| > \epsilon} f (x-y) \frac { e ^{2 \pi i y…

Classical Analysis and ODEs · Mathematics 2017-06-19 Ben Krause , Michael T. Lacey

In this paper, we obtain a $p$-th moment bound for the suprema of a log-concave-tailed nonhomogeneous chaos process, which is optimal in some special cases. A crucial ingredient of the proof is a novel decoupling inequality, which may be of…

Probability · Mathematics 2024-05-14 Guozheng Dai , Zhonggen Su , Vladimir Ulyanov , Hanchao Wang

We present precise multilevel exponential concentration inequalities for polynomials in Ising models satisfying the Dobrushin condition. The estimates have the same form as two-sided tail estimates for polynomials in Gaussian variables due…

Probability · Mathematics 2019-06-18 Radosław Adamczak , Michał Kotowski , Bartłomiej Polaczyk , Michał Strzelecki

Even though power-law or close-to-power-law degree distributions are ubiquitously observed in a great variety of large real networks, the mathematically satisfactory treatment of random power-law graphs satisfying basic statistical…

Probability · Mathematics 2023-11-09 Pim van der Hoorn , Gabor Lippner , Dmitri Krioukov

An increasing number of applications is concerned with recovering a sparse matrix from noisy observations. In this paper, we consider the setting where each row of the unknown matrix is sparse. We establish minimax optimal rates of…

Statistics Theory · Mathematics 2015-09-02 O. Klopp , A. B. Tsybakov

Inhomogeneous random matrices with non-trivial variance profiles determined by symmetric stochastic matrices and with independent sub-Gaussian entries up to Hermitian symmetry, encompass a wide range of important models, including sparse…

Probability · Mathematics 2026-02-24 Ruohan Geng , Dang-Zheng Liu , Guangyi Zou

This paper fortifies the recently introduced hierarchical-optimization recursive least squares (HO-RLS) against outliers which contaminate infrequently linear-regression models. Outliers are modeled as nuisance variables and are estimated…

Machine Learning · Computer Science 2019-10-15 Konstantinos Slavakis , Sinjini Banerjee

Based on a new atomic norm, we propose a new convex formulation for sparse matrix factorization problems in which the number of nonzero elements of the factors is assumed fixed and known. The formulation counts sparse PCA with multiple…

Machine Learning · Statistics 2014-12-05 Emile Richard , Guillaume Obozinski , Jean-Philippe Vert

Recovery of the sparsity pattern (or support) of an unknown sparse vector from a small number of noisy linear measurements is an important problem in compressed sensing. In this paper, the high-dimensional setting is considered. It is shown…

Information Theory · Computer Science 2013-02-06 Galen Reeves , Michael Gastpar

Given a sample covariance matrix, we solve a maximum likelihood problem penalized by the number of nonzero coefficients in the inverse covariance matrix. Our objective is to find a sparse representation of the sample data and to highlight…

Optimization and Control · Mathematics 2007-06-13 Alexandre d'Aspremont , Onureena Banerjee , Laurent El Ghaoui

Random projections or sketching are widely used in many algorithmic and learning contexts. Here we study the performance of iterative Hessian sketch for least-squares problems. By leveraging and extending recent results from random matrix…

Optimization and Control · Mathematics 2020-10-26 Jonathan Lacotte , Sifan Liu , Edgar Dobriban , Mert Pilanci

The recent work of \cite{CRT,DonohoPol} rigorously proved (in a large dimensional and statistical context) that if the number of equations (measurements in the compressed sensing terminology) in the system is proportional to the length of…

Information Theory · Computer Science 2013-04-02 Mihailo Stojnic

In this paper, we describe a new algorithm that approximates the extreme eigenvalue/eigenvector pairs of a symmetric matrix. The proposed algorithm can be viewed as an extension of the Jacobi eigenvalue method for symmetric matrices…

Numerical Analysis · Mathematics 2025-09-16 Cristian Rusu

The present paper concerns large covariance matrix estimation via composite minimization under the assumption of low rank plus sparse structure. In this approach, the low rank plus sparse decomposition of the covariance matrix is recovered…

Methodology · Statistics 2019-12-16 Matteo Farnè , Angela Montanari

In high-dimensional linear regression, the goal pursued here is to estimate an unknown regression function using linear combinations of a suitable set of covariates. One of the key assumptions for the success of any statistical procedure in…

Statistics Theory · Mathematics 2015-03-13 Philippe Rigollet , Alexandre Tsybakov

So-called sparse estimators arise in the context of model fitting, when one a priori assumes that only a few (unknown) model parameters deviate from zero. Sparsity constraints can be useful when the estimation problem is under-determined,…

Machine Learning · Statistics 2017-03-22 Jean Daunizeau

In this paper, we consider the $\alpha\| \cdot\|_{\ell_1}-\beta\| \cdot\|_{\ell_2}$ sparsity regularization with parameter $\alpha\geq\beta\geq0$ for nonlinear ill-posed inverse problems. We investigate the well-posedness of the…

Numerical Analysis · Mathematics 2020-07-23 Liang Ding , Weimin Han

We prove sharp weak type weighted estimates for a class of sparse operators that includes majorants of standard $\alpha$-fractional singular integrals, fractional integral operators, Marcinkiewicz integral operators, and square functions.…

Analysis of PDEs · Mathematics 2018-04-26 Qianjun He , Dunyan Yan