English
Related papers

Related papers: Lasso, fractional norm and structured sparse estim…

200 papers

We address the problem of estimating a sparse low-rank matrix from its noisy observation. We propose an objective function consisting of a data-fidelity term and two parameterized non-convex penalty functions. Further, we show how to set…

Optimization and Control · Mathematics 2017-04-13 Ankit Parekh , Ivan W. Selesnick

We propose a new penalized method for variable selection and estimation that explicitly incorporates the correlation patterns among predictors. This method is based on a combination of the minimax concave penalty and Laplacian quadratic…

Statistics Theory · Mathematics 2011-12-16 Jian Huang , Shuangge Ma , Hongzhe Li , Cun-Hui Zhang

We introduce a sparse estimation in the ordinary kriging for functional data. The functional kriging predicts a feature given as a function at a location where the data are not observed by a linear combination of data observed at other…

Methodology · Statistics 2025-10-28 Hidetoshi Matsui , Yuya Yamakawa

This paper proposes a new interpretation of sparse penalties such as the elastic-net and the group-lasso. Beyond providing a new viewpoint on these penalization schemes, our approach results in a unified optimization strategy. Our…

Machine Learning · Statistics 2017-07-20 Yves Grandvalet , Julien Chiquet , Christophe Ambroise

The aim of this paper is to provide a comprehensive introduction for the study of L1-penalized estimators in the context of dependent observations. We define a general $\ell_{1}$-penalized estimator for solving problems of stochastic…

Statistics Theory · Mathematics 2011-08-10 Pierre Alquier , Paul Doukhan

Model selection and sparse recovery are two important problems for which many regularization methods have been proposed. We study the properties of regularization methods in both problems under the unified framework of regularized least…

Statistics Theory · Mathematics 2009-09-03 Jinchi Lv , Yingying Fan

The estimation of a precision matrix is a crucial problem in various research fields, particularly when working with high dimensional data. In such settings, the most common approach is to use the penalized maximum likelihood. The…

Methodology · Statistics 2025-01-10 Vahe Avagyan

We propose a two-stage penalized least squares method to build large systems of structural equations based on the instrumental variables view of the classical two-stage least squares method. We show that, with large numbers of endogenous…

Methodology · Statistics 2018-07-31 Chen Chen , Min Ren , Min Zhang , Dabao Zhang

We propose a new algorithm for estimating NARMAX models with $L_1$ regularization for models represented as a linear combination of basis functions. Due to the $L_1$-norm penalty the Lasso estimation tends to produce some coefficients that…

Systems and Control · Computer Science 2018-02-27 Antônio H. Ribeiro , Luis A. Aguirre

We study the Cox models with semiparametric relative risk, which can be partially linear with one nonparametric component, or multiple additive or nonadditive nonparametric components. A penalized partial likelihood procedure is proposed to…

Statistics Theory · Mathematics 2010-10-20 Pang Du , Shuangge Ma , Hua Liang

Confounding can lead to spurious associations. Typically, one must observe confounders in order to adjust for them, but in high-dimensional settings, recent research has shown that it becomes possible to adjust even for unobserved…

Methodology · Statistics 2025-10-07 Yujing Lu , Patrick Breheny

The least squares problem with L1-regularized regressors, called Lasso, is a widely used approach in optimization problems where sparsity of the regressors is desired. This formulation is fundamental for many applications in signal…

Optimization and Control · Mathematics 2021-04-26 Andreea B. Alexandru , Anastasios Tsiamis , George J. Pappas

Mixtures of matrix Gaussian distributions provide a probabilistic framework for clustering continuous matrix-variate data, which are becoming increasingly prevalent in various fields. Despite its widespread adoption and successful…

Computation · Statistics 2023-07-21 Andrea Cappozzo , Alessandro Casa , Michael Fop

This paper presents a novel projection-based adaptive algorithm for sparse signal and system identification. The sequentially observed data are used to generate an equivalent sequence of closed convex sets, namely hyperslabs. Each hyperslab…

Information Theory · Computer Science 2015-10-28 Yannis Kopsinis , Konstantinos Slavakis , Sergios Theodoridis

We propose a sparse regression method based on the non-concave penalized density power divergence loss function which is robust against infinitesimal contamination in very high dimensionality. Present methods of sparse and robust regression…

Methodology · Statistics 2021-05-18 Abhik Ghosh , Subhabrata Majumdar

In this paper, we consider the Group Lasso estimator of the covariance matrix of a stochastic process corrupted by an additive noise. We propose to estimate the covariance matrix in a high-dimensional setting under the assumption that the…

Statistics Theory · Mathematics 2011-10-26 Jérémie Bigot , Rolando Biscay , Jean-Michel Loubes , Lilian Muniz Alvarez

Sparse linear regression is a central problem in high-dimensional statistics. We study the correlated random design setting, where the covariates are drawn from a multivariate Gaussian $N(0,\Sigma)$, and we seek an estimator with small…

Data Structures and Algorithms · Computer Science 2023-05-29 Jonathan Kelner , Frederic Koehler , Raghu Meka , Dhruv Rohatgi

This article is about estimation and inference methods for high dimensional sparse (HDS) regression models in econometrics. High dimensional sparse models arise in situations where many regressors (or series terms) are available and the…

Methodology · Statistics 2017-10-05 Alexandre Belloni , Victor Chernozhukov , Christian Hansen

In this paper, we propose a new method for estimation and constructing confidence intervals for low-dimensional components in a high-dimensional model. The proposed estimator, called Constrained Lasso (CLasso) estimator, is obtained by…

Methodology · Statistics 2017-04-19 Yun Yang

This work addresses the robust reconstruction problem of a sparse signal from compressed measurements. We propose a robust formulation for sparse reconstruction which employs the $\ell_1$-norm as the loss function for the residual error and…

Information Theory · Computer Science 2017-03-30 Fei Wen , Yuan Yang , Ling Pei , Wenxian Yu , Peilin Liu
‹ Prev 1 8 9 10 Next ›