English
Related papers

Related papers: Spacing Test for Fused Lasso

200 papers

In spite of the wealth of literature on the theoretical properties of the Lasso, there is very little known when the value of the tuning parameter is chosen using the data, even though this is what actually happens in practice. We give a…

Statistics Theory · Mathematics 2016-09-02 Sourav Chatterjee , Jafar Jafarov

The {\it Linear Point} (LP), defined as the midpoint between the BAO peak and the associated left dip of the two-point correlation function (2PCF), $\xi(s)$, is proposed as a new standard ruler which is insensitive to nonlinear effects. In…

Cosmology and Nongalactic Astrophysics · Physics 2023-08-02 Mengfan He , Cheng Zhao , Huanyuan Shan

The Lasso is a very well known penalized regression model, which adds an $L_{1}$ penalty with parameter $\lambda_{1}$ on the coefficients to the squared error loss function. The Fused Lasso extends this model by also putting an $L_{1}$…

Computation · Statistics 2009-10-06 Holger Hoefling

We theoretically analyze the model selection consistency of least absolute shrinkage and selection operator (Lasso), both with and without post-thresholding, for high-dimensional Ising models. For random regular (RR) graphs of size $p$ with…

Machine Learning · Statistics 2023-02-20 Xiangming Meng , Tomoyuki Obuchi , Yoshiyuki Kabashima

This paper examines LASSO, a widely-used $L_{1}$-penalized regression method, in high dimensional linear predictive regressions, particularly when the number of potential predictors exceeds the sample size and numerous unit root regressors…

Econometrics · Economics 2024-01-17 Ziwei Mei , Zhentao Shi

The L1 regularization (Lasso) has proven to be a versatile tool to select relevant features and estimate the model coefficients simultaneously and has been widely used in many research areas such as genomes studies, finance, and biomedical…

Machine Learning · Statistics 2019-05-21 Songshan Yang , Jiawei Wen , Xiang Zhan , Daniel Kifer

Penalized regression models such as the Lasso have proved useful for variable selection in many fields - especially for situations with high-dimensional data where the numbers of predictors far exceeds the number of observations. These…

Methodology · Statistics 2014-03-19 Kasper Brink-Jensen , Claus Thorn Ekstrøm

In exciting new work, Bertsimas et al. (2016) showed that the classical best subset selection problem in regression modeling can be formulated as a mixed integer optimization (MIO) problem. Using recent advances in MIO algorithms, they…

Methodology · Statistics 2017-08-01 Trevor Hastie , Robert Tibshirani , Ryan J. Tibshirani

We present a new method for post-selection inference for L1 (lasso)-penalized likelihood models, including generalized regression models. Our approach generalizes the post-selection framework presented in Lee et al (2014). The method…

Methodology · Statistics 2016-10-17 Jonathan Taylor , Robert Tibshirani

Applying standard statistical methods after model selection may yield inefficient estimators and hypothesis tests that fail to achieve nominal type-I error rates. The main issue is the fact that the post-selection distribution of the data…

Methodology · Statistics 2019-05-23 Amit Meir , Mathias Drton

Lasso is a popular and efficient approach to simultaneous estimation and variable selection in high-dimensional regression models. In this paper, a robust LAD-lasso method for multiple outcomes is presented that addresses the challenges of…

Methodology · Statistics 2022-12-02 Jyrki Möttönen , Tero Lähderanta , Janne Salonen , Mikko J. Sillanpää

We develop a general approach to valid inference after model selection. At the core of our framework is a result that characterizes the distribution of a post-selection estimator conditioned on the selection event. We specialize the…

Statistics Theory · Mathematics 2016-05-04 Jason D. Lee , Dennis L. Sun , Yuekai Sun , Jonathan E. Taylor

We study regularized estimation in high-dimensional longitudinal classification problems, using the lasso and fused lasso regularizers. The constructed coefficient estimates are piecewise constant across the time dimension in the…

Among the most popular variable selection procedures in high-dimensional regression, Lasso provides a solution path to rank the variables and determines a cut-off position on the path to select variables and estimate coefficients. In this…

Methodology · Statistics 2018-06-19 X. Jessie Jeng , Huimin Peng , Wenbin Lu

We introduced least absolute shrinkage and selection operator (lasso) in obtaining periodic signals in unevenly spaced time-series data. A very simple formulation with a combination of a large set of sine and cosine functions has been shown…

Instrumentation and Methods for Astrophysics · Physics 2015-06-05 Taichi Kato , Makoto Uemura

In high dimensional settings, sparse structures are crucial for efficiency, both in term of memory, computation and performance. It is customary to consider $\ell_1$ penalty to enforce sparsity in such scenarios. Sparsity enforcing methods,…

Machine Learning · Statistics 2017-11-22 Eugene Ndiaye , Olivier Fercoq , Alexandre Gramfort , Vincent Leclère , Joseph Salmon

We propose a two step algorithm based on $\ell_1/\ell_0$ regularization for the detection and estimation of parameters of a high dimensional change point regression model and provide the corresponding rates of convergence for the change…

Methodology · Statistics 2019-01-18 Abhishek Kaul , Venkata K. Jandhyala , Stergios B. Fotopoulos

The uncertainty quantification and error control of classifiers are crucial in many high-consequence decision-making scenarios. We propose a selective classification framework that provides an indecision option for any observations that…

Methodology · Statistics 2022-10-11 Bowen Gang , Yuantao Shi , Wenguang Sun

In this paper, the fused graphical lasso (FGL) method is used to estimate multiple precision matrices from multiple populations simultaneously. The lasso penalty in the FGL model is a restraint on sparsity of precision matrices, and a…

Statistics Theory · Mathematics 2023-03-03 Qiuyan Zhang , Zhidong Bai , Lingrui Li , Hu Yang

The Lasso is a prominent algorithm for variable selection. However, its instability in the presence of correlated variables in the high-dimensional setting is well-documented. Although previous research has attempted to address this issue…

Methodology · Statistics 2025-05-28 Mahdi Nouraie , Connor Smith , Samuel Muller