English
Related papers

Related papers: Spacing Test for Fused Lasso

200 papers

We consider the problem of predicting an outcome variable using $p$ covariates that are measured on $n$ independent observations, in the setting in which flexible and interpretable fits are desirable. We propose the fused lasso additive…

Methodology · Statistics 2014-09-19 Ashley Petersen , Daniela Witten , Noah Simon

This work studies the total variation regularized $\ell_2$ estimator (fused lasso) in the setting of a change point detection problem. Compared with existing works that focus on the sum of squared estimation errors, we give bound on the…

Statistics Theory · Mathematics 2019-01-07 Teng Zhang

When the model is not known and parameter testing or interval estimation is conducted after model selection, it is necessary to consider selective inference. This paper discusses this issue in the context of sparse estimation. Firstly, we…

Methodology · Statistics 2023-10-12 Joe Suzuki

Feature selection has been proven a powerful preprocessing step for high-dimensional data analysis. However, most state-of-the-art methods tend to overlook the structural correlation information between pairwise samples, which may…

Machine Learning · Computer Science 2019-07-02 Lu Bai , Lixin Cui , Yue Wang , Philip S. Yu , Edwin R. Hancock

In this paper we introduce and study fused lasso nearly-isotonic signal approximation, which is a combination of fused lasso and generalized nearly-isotonic regression. We show how these three estimators relate to each other, derive…

Statistics Theory · Mathematics 2022-11-22 Vladimir Pastukhov

We introduce an iterative method to solve problems in small-strain non-linear elasticity, termed ``Phase-Space Iterations'' (PSIs). The method is inspired by recent work in data-driven computational mechanics, which reformulated the classic…

Numerical Analysis · Mathematics 2024-11-26 Gaëtan Cortes , Nur Cristian Sangiorgio , Joaquin Garcia-Suarez

The Lasso is one of the most important approaches for parameter estimation and variable selection in high dimensional linear regression. At the heart of its success is the attractive rate of convergence result even when $p$, the dimension…

Statistics Theory · Mathematics 2019-08-09 Junlong Zhao , Chenlei Leng

In this article we investigate consistency of selection in regression models via the popular Lasso method. Here we depart from the traditional linear regression assumption and consider approximations of the regression function $f$ with…

Statistics Theory · Mathematics 2008-12-18 Florentina Bunea

A simultaneous change-point detection and estimation in a piece-wise constant model is a common task in modern statistics. If, in addition, the whole estimation can be performed automatically, in just one single step without going through…

Statistics Theory · Mathematics 2019-01-16 Gabriela Ciuperca , Matúš Maciak

The Lasso has been widely used as a method for variable selection, valued for its simplicity and empirical performance. However, Lasso's selection stability deteriorates in the presence of correlated predictors. Several approaches have been…

Methodology · Statistics 2025-11-05 Mahdi Nouraie , Houying Zhu , Samuel Muller

We study the problem of variable selection in convex nonparametric least squares (CNLS). Whereas the least absolute shrinkage and selection operator (Lasso) is a popular technique for least squares, its variable selection performance is…

Methodology · Statistics 2025-10-31 Zhiqiang Liao , Zhaonan Qu

This paper addresses the issue of detecting change-points in multivariate time series. The proposed approach differs from existing counterparts by making only weak assumptions on both the change-points structure across series, and the…

Methodology · Statistics 2014-07-14 Flore Harlé , Florent Chatelain , Cédric Gouy-Pailler , Sophie Achard

In the sparse linear regression setting, we consider testing the significance of the predictor variable that enters the current lasso model, in the sequence of models visited along the lasso solution path. We propose a simple test statistic…

Statistics Theory · Mathematics 2014-05-27 Richard Lockhart , Jonathan Taylor , Ryan J. Tibshirani , Robert Tibshirani

We investigate multiple testing and variable selection using the Least Angle Regression (LARS) algorithm in high dimensions under the assumption of Gaussian noise. LARS is known to produce a piecewise affine solution path with change points…

Statistics Theory · Mathematics 2022-05-05 J. -M. Azaïs , Y. De Castro

Lasso is a celebrated method for variable selection in linear models, but it faces challenges when the variables are moderately or strongly correlated. This motivates alternative approaches such as using a non-convex penalty, adding a ridge…

Statistics Theory · Mathematics 2022-03-30 Zheng Tracy Ke , Longlin Wang

We propose new inference tools for forward stepwise regression, least angle regression, and the lasso. Assuming a Gaussian model for the observation vector y, we first describe a general scheme to perform valid inference after any selection…

Methodology · Statistics 2015-10-13 Ryan J. Tibshirani , Jonathan Taylor , Richard Lockhart , Robert Tibshirani

In recent years, change point detection for high dimensional data has become increasingly important in many scientific fields. Most literature develop a variety of separate methods designed for specified models (e.g. mean shift model,…

Methodology · Statistics 2022-07-20 Yue Bai , Abolfazl Safikhani

We show how perceptual embeddings of the visual system can be constructed at inference-time with no training data or deep neural network features. Our perceptual embeddings are solutions to a weighted least squares (WLS) problem, defined at…

Computer Vision and Pattern Recognition · Computer Science 2023-10-11 Daniel Severo , Lucas Theis , Johannes Ballé

This paper studies well-posedness and parameter sensitivity of the Square Root LASSO (SR-LASSO), an optimization model for recovering sparse solutions to linear inverse problems in finite dimension. An advantage of the SR-LASSO (e.g., over…

Optimization and Control · Mathematics 2024-04-01 Aaron Berk , Simone Brugiapaglia , Tim Hoheisel

Estimation of structure, such as in variable selection, graphical modelling or cluster analysis is notoriously difficult, especially for high-dimensional data. We introduce stability selection. It is based on subsampling in combination with…

Methodology · Statistics 2009-05-16 Nicolai Meinshausen , Peter Buehlmann