English
Related papers

Related papers: From Graphical Lasso to Atomic Norms: High-Dimensi…

200 papers

We describe a probabilistic, {\it sublinear} runtime, measurement-optimal system for model-based sparse recovery problems through dimensionality reducing, {\em dense} random matrices. Specifically, we obtain a linear sketch $u\in \R^M$ of a…

Information Theory · Computer Science 2012-06-22 Anastasios Kyrillidis , Volkan Cevher

When a series of (related) linear models has to be estimated it is often appropriate to combine the different data-sets to construct more efficient estimators. We use $\ell_1$-penalized estimators like the Lasso or the Adaptive Lasso which…

Statistics Theory · Mathematics 2007-12-18 Lukas Meier , Peter Bühlmann

The graphical lasso (glasso) is an $l_1$ penalised likelihood estimator for a Gaussian precision matrix. A benefit of the glasso is that it exists even when the sample covariance matrix is not positive definite but only positive…

Statistics Theory · Mathematics 2025-05-27 Jack Storror Carter

Atomic norm minimization is a convex optimization framework to recover point sources from a subset of their low-pass observations, or equivalently the underlying frequencies of a spectrally-sparse signal. When the amplitudes of the sources…

Information Theory · Computer Science 2021-02-24 Maxime Ferreira Da Costa , Yuejie Chi

The traditional sparse modeling approach, when applied to inverse problems with large data such as images, essentially assumes a sparse model for small overlapping data patches. While producing state-of-the-art results, this methodology is…

Information Theory · Computer Science 2017-02-14 Dmitry Batenkov , Yaniv Romano , Michael Elad

We discuss a general notion of "sparsity structure" and associated recoveries of a sparse signal from its linear image of reduced dimension possibly corrupted with noise. Our approach allows for unified treatment of (a) the "usual sparsity"…

Optimization and Control · Mathematics 2016-11-26 Anatoli Juditsky , Fatma Kilinc Karzan , Arkadi Nemirovski

We study the problem of signal estimation from non-linear observations when the signal belongs to a low-dimensional set buried in a high-dimensional space. A rough heuristic often used in practice postulates that non-linear observations may…

Information Theory · Computer Science 2015-11-17 Yaniv Plan , Roman Vershynin

The line spectral estimation problem consists in recovering the frequencies of a complex valued time signal that is assumed to be sparse in the spectral domain from its discrete observations. Unlike the gridding required by the classical…

Information Theory · Computer Science 2021-10-18 Maxime Ferreira Da Costa , Wei Dai

We propose a new estimator for the high-dimensional linear regression model with observation error in the design where the number of coefficients is potentially larger than the sample size. The main novelty of our procedure is that the…

Methodology · Statistics 2019-09-09 Alexandre Belloni , Abhishek Kaul , Mathieu Rosenbaum

Lasso-type estimators are routinely used to estimate high-dimensional time series models. The theoretical guarantees established for these estimators typically require the penalty level to be chosen in a suitable fashion often depending on…

Gaussian graphical models represent the underlying graph structure of conditional dependence between random variables which can be determined using their partial correlation or precision matrix. In a high-dimensional setting, the precision…

Applications · Statistics 2016-05-24 Adria Caballe , Natalia Bochkina , Claus Mayer

We consider estimation of undirected Gaussian graphical models and inverse covariances in high-dimensional scenarios by penalizing the corresponding precision matrix. While single $L_1$ (Graphical Lasso) and $L_2$ (Graphical Ridge)…

Methodology · Statistics 2021-01-07 Solt Kovács , Tobias Ruckstuhl , Helena Obrist , Peter Bühlmann

Nowadays, analysing data from different classes or over a temporal grid has attracted a great deal of interest. As a result, various multiple graphical models for learning a collection of graphical models simultaneously have been derived by…

Optimization and Control · Mathematics 2021-04-23 Ning Zhang , Yangjing Zhang , Defeng Sun , Kim-Chuan Toh

Using a multiplicative reparametrization, I show that a subclass of $L_q$ penalties with $q\leq 1$ can be expressed as sums of $L_2$ penalties. It follows that the lasso and other norm-penalized regression estimates may be obtained using a…

Computation · Statistics 2017-05-22 Peter D. Hoff

Penalized (or regularized) regression, as represented by Lasso and its variants, has become a standard technique for analyzing high-dimensional data when the number of variables substantially exceeds the sample size. The performance of…

Methodology · Statistics 2019-08-13 Yunan Wu , Lan Wang

Least squares fitting is in general not useful for high-dimensional linear models, in which the number of predictors is of the same or even larger order of magnitude than the number of samples. Theory developed in recent years has coined a…

Statistics Theory · Mathematics 2014-02-13 Martin Slawski , Matthias Hein

This paper studies sparse super-resolution in arbitrary dimensions. More precisely, it develops a theoretical analysis of support recovery for the so-called BLASSO method, which is an off-the-grid generalisation of l1 regularization (also…

Numerical Analysis · Mathematics 2017-09-12 Clarice Poon , Gabriel Peyré

The low-degree polynomial framework has emerged as a powerful tool for providing evidence of statistical-computational gaps in high-dimensional inference. For detection problems, the standard approach bounds the low-degree advantage through…

Statistics Theory · Mathematics 2026-04-21 Zhangsong Li

High-dimensional statistical learning (HDSL) has wide applications in data analysis, operations research, and decision-making. Despite the availability of multiple theoretical frameworks, most existing HDSL schemes stipulate the following…

Statistics Theory · Mathematics 2021-10-25 Hongcheng Liu , Yinyu Ye , Hung Yi Lee

High-dimensional statistical inference deals with models in which the the number of parameters p is comparable to or larger than the sample size n. Since it is usually impossible to obtain consistent procedures unless $p/n\rightarrow0$, a…

Statistics Theory · Mathematics 2013-03-13 Sahand N. Negahban , Pradeep Ravikumar , Martin J. Wainwright , Bin Yu
‹ Prev 1 3 4 5 6 7 10 Next ›