English
Related papers

Related papers: LASSO Methods for Gaussian Instrumental Variables …

200 papers

We consider the problem of sparse signal recovery from noisy measurements. Many of frequently used recovery methods rely on some sort of tuning depending on either noise or signal parameters. If no estimates for either of them are…

Information Theory · Computer Science 2020-10-20 Hendrik Bernd Petersen , Peter Jung

We model and study the problem of localizing a set of sparse forcing inputs for linear dynamical systems from noisy measurements when the initial state is unknown. This problem is of particular relevance to detecting forced oscillations in…

Optimization and Control · Mathematics 2022-01-21 Rajasekhar Anguluri , Lalitha Sankar , Oliver Kosut

Studies investigating the causal effects of spatially varying exposures on outcomes often rely on observational and spatially indexed data. A prevalent challenge is unmeasured spatial confounding, where an unobserved spatially varying…

Methodology · Statistics 2025-11-19 Sophie M. Woodward , Mauricio Tec , Francesca Dominici

When the model is not known and parameter testing or interval estimation is conducted after model selection, it is necessary to consider selective inference. This paper discusses this issue in the context of sparse estimation. Firstly, we…

Methodology · Statistics 2023-10-12 Joe Suzuki

In high dimensional settings, sparse structures are crucial for efficiency, both in term of memory, computation and performance. It is customary to consider $\ell_1$ penalty to enforce sparsity in such scenarios. Sparsity enforcing methods,…

Machine Learning · Statistics 2017-11-22 Eugene Ndiaye , Olivier Fercoq , Alexandre Gramfort , Vincent Leclère , Joseph Salmon

Instrumental variable (IV) methods are becoming increasingly popular as they seem to offer the only viable way to overcome the problem of unobserved confounding in observational studies. However, some attention has to be paid to the…

Methodology · Statistics 2010-11-03 Vanessa Didelez , Sha Meng , Nuala A. Sheehan

This paper studies the statistical properties of the group Lasso estimator for high dimensional sparse quantile regression models where the number of explanatory variables (or the number of groups of explanatory variables) is possibly much…

Methodology · Statistics 2011-03-28 Kengo Kato

In this paper, we consider the problem of recovering a sparse signal from noisy linear measurements using the so called LASSO formulation. We assume a correlated Gaussian design matrix with additive Gaussian noise. We precisely analyze the…

Statistics Theory · Mathematics 2020-09-18 Ayed M. Alrashdi , Houssem Sifaou , Abla Kammoun , Mohamed-Slim Alouini , Tareq Y. Al-Naffouri

We study the problem of variable selection in convex nonparametric least squares (CNLS). Whereas the least absolute shrinkage and selection operator (Lasso) is a popular technique for least squares, its variable selection performance is…

Methodology · Statistics 2025-10-31 Zhiqiang Liao , Zhaonan Qu

We consider the estimation and inference in a system of high-dimensional regression equations allowing for temporal and cross-sectional dependency in covariates and error processes, covering rather general forms of weak temporal dependence.…

Econometrics · Economics 2020-05-18 Victor Chernozhukov , Wolfgang K. Härdle , Chen Huang , Weining Wang

This paper studies high-dimensional regression models with lasso when data is sampled under multi-way clustering. First, we establish convergence rates for the lasso and post-lasso estimators. Second, we propose a novel inference method…

Econometrics · Economics 2019-08-22 Harold D. Chiang , Yuya Sasaki

We propose methodology for statistical inference for low-dimensional parameters of sparse precision matrices in a high-dimensional setting. Our method leads to a non-sparse estimator of the precision matrix whose entries have a Gaussian…

Statistics Theory · Mathematics 2015-08-13 Jana Jankova , Sara van de Geer

Sparse linear discriminant analysis via penalized optimal scoring is a successful tool for classification in high-dimensional settings. While the variable selection consistency of sparse optimal scoring has been established, the…

Statistics Theory · Mathematics 2021-04-01 Irina Gaynanova

This paper addresses identification of sparse linear and noise-driven continuous-time state-space systems, i.e., the right-hand sides in the dynamical equations depend only on a subset of the states. The key assumption in this study, is…

Systems and Control · Computer Science 2018-04-18 Zuogong Yue , Johan Thunberg , Lennart Ljung , Jorge Goncalves

In this paper, we study problem of estimating a sparse regression vector with correct support in the presence of outlier samples. The inconsistency of lasso-type methods is well known in this scenario. We propose a combinatorial version of…

Machine Learning · Computer Science 2023-06-23 Adarsh Barik , Jean Honorio

Modern statistical learning algorithms are capable of amazing flexibility, but struggle with interpretability. One possible solution is sparsity: making inference such that many of the parameters are estimated as being identically 0, which…

Methodology · Statistics 2023-05-15 Nathan Wycoff , Ali Arab , Katharine M. Donato , Lisa O. Singh

The recent availability of huge, many-dimensional data sets, like those arising from genome-wide association studies (GWAS), provides many opportunities for strengthening causal inference. One popular approach is to utilize these…

Machine Learning · Statistics 2020-12-21 Ioan Gabriel Bucur , Tom Claassen , Tom Heskes

Selecting key variables from high-dimensional data is increasingly important in the era of big data. Sparse regression serves as a powerful tool for this purpose by promoting model simplicity and explainability. In this work, we revisit a…

Machine Learning · Computer Science 2025-09-09 Hyungjoon Soh , Dongha Lee , Vipul Periwal , Junghyo Jo

The use of Gaussian process models is typically limited to datasets with a few tens of thousands of observations due to their complexity and memory footprint. The two most commonly used methods to overcome this limitation are 1) the…

Machine Learning · Statistics 2020-01-16 Vincent Adam , Stefanos Eleftheriadis , Nicolas Durrande , Artem Artemev , James Hensman

This paper proposes feasible asymptotically efficient estimators for a certain class of Gaussian noises with self-similar and stationary properties, which includes the fractional Gaussian noise, under high frequency observations. In this…

Statistics Theory · Mathematics 2016-11-23 Masaaki Fukasawa , Tetsuya Takabatake