中文
相关论文

相关论文: Vanilla Lasso for sparse classification under sing…

200 篇论文

In this note, we propose to use sparse methods (e.g. LASSO, Post-LASSO, sqrt-LASSO, and Post-sqrt-LASSO) to form first-stage predictions and estimate optimal instruments in linear instrumental variables (IV) models with many instruments in…

统计方法学 · 统计学 2017-10-05 Alexandre Belloni , Victor Chernozhukov , Christian Hansen

This article investigates uncertainty quantification of the generalized linear lasso~(GLL), a popular variable selection method in high-dimensional regression settings. In many fields of study, researchers use data-driven methods to select…

统计理论 · 数学 2023-07-11 Quentin Duchemin , Yohann de Castro

We study the problem of variable selection in convex nonparametric least squares (CNLS). Whereas the least absolute shrinkage and selection operator (Lasso) is a popular technique for least squares, its variable selection performance is…

统计方法学 · 统计学 2025-10-31 Zhiqiang Liao , Zhaonan Qu

The Vector AutoRegressive (VAR) model is fundamental to the study of multivariate time series. Although VAR models are intensively investigated by many researchers, practitioners often show more interest in analyzing VARX models that…

机器学习 · 统计学 2017-11-13 Ines Wilms , Sumanta Basu , Jacob Bien , David S. Matteson

Sparse regularization such as $\ell_1$ regularization is a quite powerful and widely used strategy for high dimensional learning problems. The effectiveness of sparse regularization has been supported practically and theoretically by…

机器学习 · 统计学 2018-02-23 Masaaki Takada , Taiji Suzuki , Hironori Fujisawa

So-called sparse estimators arise in the context of model fitting, when one a priori assumes that only a few (unknown) model parameters deviate from zero. Sparsity constraints can be useful when the estimation problem is under-determined,…

机器学习 · 统计学 2017-03-22 Jean Daunizeau

The lasso and related sparsity inducing algorithms have been the target of substantial theoretical and applied research. Correspondingly, many results are known about their behavior for a fixed or optimally chosen tuning parameter specified…

统计理论 · 数学 2016-06-23 Darren Homrighausen , Daniel J. McDonald

This note studies a method for the efficient estimation of a finite number of unknown parameters from linear equations, which are perturbed by Gaussian noise. In case the unknown parameters have only few nonzero entries, the proposed…

系统与控制 · 计算机科学 2014-05-27 Liang Dai , Kristiaan Pelckmans

Scoring systems are classification models that only require users to add, subtract and multiply a few meaningful numbers to make a prediction. These models are often used because they are practical and interpretable. In this paper, we…

机器学习 · 统计学 2014-04-14 Berk Ustun , Stefano Tracà , Cynthia Rudin

Sparsity-inducing penalties are useful tools for variable selection and they are also effective for regression settings where the data are functions. We consider the problem of selecting not only variables but also decision boundaries in…

统计方法学 · 统计学 2020-06-01 Hidetoshi Matsui

Sparse linear regression is one of the most basic questions in machine learning and statistics. Here, we are given as input a design matrix $X \in \mathbb{R}^{N \times d}$ and measurements or labels ${y} \in \mathbb{R}^N$ where ${y} = {X}…

机器学习 · 计算机科学 2025-11-11 Gautam Chandrasekaran , Raghu Meka , Konstantinos Stavropoulos

In high-dimensional statistical inference in which the number of parameters to be estimated is larger than that of the holding data, regularized linear estimation techniques are widely used. These techniques have, however, some drawbacks.…

统计方法学 · 统计学 2025-08-06 Takashi Takahashi , Yoshiyuki Kabashima

This work proposes a research problem of finding sparse solution of undetermined Linear system with some applications. Two approaches how to solve the compressive sensing problem: using l_1 approach , the l_q approach with 0 < q < 1.…

最优化与控制 · 数学 2017-02-24 Maddullah Almerdasy

High dimensional vector autoregressive (VAR) models require a large number of parameters to be estimated and may suffer of inferential problems. We propose a new Bayesian nonparametric (BNP) Lasso prior (BNP-Lasso) for high-dimensional VAR…

经济学 · 定量金融 2018-10-30 Monica Billio , Roberto Casarin , Luca Rossini

We propose a new fast algorithm to estimate any sparse generalized linear model with convex or non-convex separable penalties. Our algorithm is able to solve problems with millions of samples and features in seconds, by relying on…

We consider the problems of estimation and selection of parameters endowed with a known group structure, when the groups are assumed to be sign-coherent, that is, gathering either nonnegative, nonpositive or null parameters. To tackle this…

统计方法学 · 统计学 2015-03-19 Julien Chiquet , Yves Grandvalet , Camille Charbonnier

We consider the problem of estimating a low-dimensional parameter in high-dimensional linear regression. Constructing an approximately unbiased estimate of the parameter of interest is a crucial step towards performing statistical…

统计理论 · 数学 2021-07-30 Michael Celentano , Andrea Montanari

Sparse linear inverse problems appear in a variety of settings, but often the noise contaminating observations cannot accurately be described as bounded by or arising from a Gaussian distribution. Poisson observations in particular are a…

This paper develops an approach to inference in a linear regression model when the number of potential explanatory variables is larger than the sample size. The approach treats each regression coefficient in turn as the interest parameter,…

统计方法学 · 统计学 2022-11-14 Heather S. Battey , Nancy Reid

The sparse group lasso is a high-dimensional regression technique that is useful for problems whose predictors have a naturally grouped structure and where sparsity is encouraged at both the group and individual predictor level. In this…

统计方法学 · 统计学 2025-01-10 Xiaoxuan Liang , Aaron Cohen , Anibal Solón Heinsfeld , Franco Pestilli , Daniel J. McDonald