中文
相关论文

相关论文: The Generalized Lasso Problem and Uniqueness

200 篇论文

We consider high-dimensional generalized linear models with Lipschitz loss functions, and prove a nonasymptotic oracle inequality for the empirical risk minimizer with Lasso penalty. The penalty is based on the coefficients in the linear…

统计理论 · 数学 2008-12-18 Sara A. van de Geer

We consider efficient implementations of the generalized lasso dual path algorithm of Tibshirani and Taylor (2011). We first describe a generic approach that covers any penalty matrix D and any (full column rank) matrix X of predictor…

统计计算 · 统计学 2014-11-04 Taylor Arnold , Ryan Tibshirani

In high-dimensional statistical inference, sparsity regularizations have shown advantages in consistency and convergence rates for coefficient estimation. We consider a generalized version of Sparse-Group Lasso which captures both…

机器学习 · 统计学 2020-08-12 Xinyu Zhang

The elastic net penalty is frequently employed in high-dimensional statistics for parameter regression and variable selection. It is particularly beneficial compared to lasso when the number of predictors greatly surpasses the number of…

机器学习 · 统计学 2024-12-06 Yanyun Ding , Zhenghua Yao , Peili Li , Yunhai Xiao

We study sparse linear regression over a network of agents, modeled as an undirected graph (with no centralized node). The estimation problem is formulated as the minimization of the sum of the local LASSO loss functions plus a quadratic…

机器学习 · 计算机科学 2023-06-23 Yao Ji , Gesualdo Scutari , Ying Sun , Harsha Honnappa

This work performs a non-asymptotic analysis of the generalized Lasso under the assumption of sub-exponential data. Our main results continue recent research on the benchmark case of (sub-)Gaussian sample distributions and thereby explore…

统计理论 · 数学 2023-01-18 Martin Genzel , Christian Kipp

We present a new approach to solve the sparse approximation or best subset selection problem, namely find a $k$-sparse vector ${\bf x}\in\mathbb{R}^d$ that minimizes the $\ell_2$ residual $\lVert A{\bf x}-{\bf y} \rVert_2$. We consider a…

机器学习 · 计算机科学 2021-06-21 Tal Amir , Ronen Basri , Boaz Nadler

We introduce a new theory of generalised solutions which applies to fully nonlinear PDE systems of any order and allows for merely measurable maps as solutions. This approach bypasses the standard problems arising by the application of…

偏微分方程分析 · 数学 2017-02-21 Nikos Katzourakis

We consider the problem of learning a coefficient vector x_0\in R^N from noisy linear observation y=Ax_0+w \in R^n. In many contexts (ranging from model selection to image processing) it is desirable to construct a sparse estimator x'. In…

统计理论 · 数学 2015-12-16 Mohsen Bayati , Andrea Montanari

We study the problem of signal estimation from non-linear observations when the signal belongs to a low-dimensional set buried in a high-dimensional space. A rough heuristic often used in practice postulates that non-linear observations may…

信息论 · 计算机科学 2015-11-17 Yaniv Plan , Roman Vershynin

Popular regularizers with non-differentiable penalties, such as Lasso, Elastic Net, Generalized Lasso, or SLOPE, reduce the dimension of the parameter space by inducing sparsity or clustering in the estimators' coordinates. In this paper,…

统计理论 · 数学 2025-01-03 Ivan Hejný , Jonas Wallin , Małgorzata Bogdan , Michał Kos

We consider the problem of estimating a time-varying sparse precision matrix, which is assumed to evolve in a piece-wise constant manner. Building upon the Group Fused LASSO and LASSO penalty functions, we estimate both the network…

统计理论 · 数学 2024-10-08 Ying Lin , Benjamin Poignard , Ting Kei Pong , Akiko Takeda

We study the estimation capacity of the generalized Lasso, i.e., least squares minimization combined with a (convex) structural constraint. While Lasso-type estimators were originally designed for noisy linear regression problems, it has…

统计理论 · 数学 2019-09-12 Martin Genzel , Gitta Kutyniok

The Lasso is a very well known penalized regression model, which adds an $L_{1}$ penalty with parameter $\lambda_{1}$ on the coefficients to the squared error loss function. The Fused Lasso extends this model by also putting an $L_{1}$…

统计计算 · 统计学 2009-10-06 Holger Hoefling

This work addresses the issue of large covariance matrix estimation in high-dimensional statistical analysis. Recently, improved iterative algorithms with positive-definite guarantee have been developed. However, these algorithms cannot be…

信息论 · 计算机科学 2016-07-29 Fei Wen , Yuan Yang , Peilin Liu , Robert C. Qiu

Penalized regression methods, most notably the lasso, are a popular approach to analyzing high-dimensional data. An attractive property of the lasso is that it naturally performs variable selection. An important area of concern, however, is…

统计方法学 · 统计学 2026-05-13 Ryan Miller , Patrick Breheny

We derive expressions for the finite-sample distribution of the Lasso estimator in the context of a linear regression model in low as well as in high dimensions by exploiting the structure of the optimization problem defining the estimator.…

统计理论 · 数学 2020-02-25 Karl Ewald , Ulrike Schneider

This paper examines LASSO, a widely-used $L_{1}$-penalized regression method, in high dimensional linear predictive regressions, particularly when the number of potential predictors exceeds the sample size and numerous unit root regressors…

计量经济学 · 经济学 2024-01-17 Ziwei Mei , Zhentao Shi

We propose a generalized debiased Lasso estimator based on a stability principle. When a single column of the design matrix is perturbed, the estimator admits a simple update formula that can be computed from the original solution. Under…

统计理论 · 数学 2026-04-14 Jingbo Liu

We study the complexity of the entire regularization path for least squares regression with 1-norm penalty, known as the Lasso. Every regression parameter in the Lasso changes linearly as a function of the regularization value. The number…

数据结构与算法 · 计算机科学 2018-06-11 Yuanzhi Li , Yoram Singer