中文
相关论文

相关论文: Asymptotic Properties of Lasso+mLS and Lasso+Ridge…

200 篇论文

We propose to address the common problem of linear estimation in linear statistical models by using a model selection approach via penalization. Depending then on the framework in which the linear statistical model is considered namely the…

统计理论 · 数学 2009-09-11 Ikhlef Bechar

For high-dimensional omics data, sparsity-inducing regularization methods such as the Lasso are widely used and often yield strong predictive performance, even in settings when the assumption of sparsity is likely violated. We demonstrate…

统计方法学 · 统计学 2025-02-13 Andrea Bratsberg , Magne Thoresen , Jelle J. Goeman

We consider the problem of variables selection and estimation in linear regression model in situations where the number of parameters diverges with the sample size. We propose the adaptive Generalized Ridge-Lasso (\mbox{AdaGril}) which is…

统计方法学 · 统计学 2013-02-27 Mohammed El Anbari , Abdallah Mkhadri

In this paper, we introduce ``UniLasso'' -- a novel statistical method for sparse regression. This two-stage approach preserves the signs of the univariate coefficients and leverages their magnitude. Both of these properties are attractive…

统计方法学 · 统计学 2025-06-26 Sourav Chatterjee , Trevor Hastie , Robert Tibshirani

We consider the problem of fitting the parameters of a high-dimensional linear regression model. In the regime where the number of parameters $p$ is comparable to or exceeds the sample size $n$, a successful approach uses an…

统计理论 · 数学 2013-11-04 Adel Javanmard , Andrea Montanari

We propose a self-tuning $\sqrt{\mathrm {Lasso}}$ method that simultaneously resolves three important practical problems in high-dimensional regression analysis, namely it handles the unknown scale, heteroscedasticity and (drastic)…

统计方法学 · 统计学 2014-05-27 Alexandre Belloni , Victor Chernozhukov , Lie Wang

Regularized regression approaches such as the Lasso have been widely adopted for constructing sparse linear models in high-dimensional datasets. A complexity in fitting these models is the tuning of the parameters which control the level of…

统计方法学 · 统计学 2019-03-12 Ellis Patrick , Samuel Mueller

A great deal of interest has recently focused on conducting inference on the parameters in a high-dimensional linear model. In this paper, we consider a simple and very na\"{i}ve two-step procedure for this task, in which we (i) fit a lasso…

统计方法学 · 统计学 2020-07-02 Sen Zhao , Daniela Witten , Ali Shojaie

A recently proposed SLOPE estimator (arXiv:1407.3824) has been shown to adaptively achieve the minimax $\ell_2$ estimation rate under high-dimensional sparse linear regression models (arXiv:1503.08393). Such minimax optimality holds in the…

机器学习 · 统计学 2021-09-24 Shuaiwen Wang , Haolei Weng , Arian Maleki

This paper studies the statistical properties of the group Lasso estimator for high dimensional sparse quantile regression models where the number of explanatory variables (or the number of groups of explanatory variables) is possibly much…

统计方法学 · 统计学 2011-03-28 Kengo Kato

We consider selection of random predictors for high-dimensional regression problem with binary response for a general loss function. Important special case is when the binary model is semiparametric and the response function is misspecified…

统计理论 · 数学 2020-02-19 Mariusz Kubkowski , Jan Mielniczuk

Supervised learning by extreme learning machines resp. neural networks with random weights is studied under a non-stationary spatial-temporal sampling design which especially addresses settings where an autonomous object moving in a…

机器学习 · 统计学 2021-09-02 Ansgar Steland

In this paper we study the asymptotic normality in high-dimensional linear regression. We focus on the case where the covariance matrix of the regression variables has a KMS structure, in asymptotic settings where the number of predictors,…

统计理论 · 数学 2022-05-17 Saulius Jokubaitis , Remigijus Leipus

Sparse linear regression is a central problem in high-dimensional statistics. We study the correlated random design setting, where the covariates are drawn from a multivariate Gaussian $N(0,\Sigma)$, and we seek an estimator with small…

数据结构与算法 · 计算机科学 2023-05-29 Jonathan Kelner , Frederic Koehler , Raghu Meka , Dhruv Rohatgi

We study the large sample properties of sparse M-estimators in the presence of pseudo-observations. Our framework covers a broad class of semi-parametric copula models, for which the marginal distributions are unknown and replaced by their…

统计理论 · 数学 2023-06-01 Jean-David Fermanian , Benjamin Poignard

In this paper, we review state-of-the-art methods for feature selection in statistics with an application-oriented eye. Indeed, sparsity is a valuable property and the profusion of research on the topic might have provided little guidance…

统计方法学 · 统计学 2021-11-08 Dimitris Bertsimas , Jean Pauphilet , Bart Van Parys

Sparse linear regression methods including the well-known LASSO and the Dantzig selector have become ubiquitous in the engineering practice, including in medical imaging. Among other tasks, they have been successfully applied for the…

信号处理 · 电气工程与系统科学 2023-01-03 Anna Pidnebesna , Iveta Fajnerova , Jiri Horacek , Jaroslav Hlinka

We study the asymptotic properties of the SCAD-penalized least squares estimator in sparse, high-dimensional, linear regression models when the number of covariates may increase with the sample size. We are particularly interested in the…

统计理论 · 数学 2007-09-12 Jian Huang , Huiliang Xie

We consider the problem of nonparametric regression when the covariate is $d$-dimensional, where $d \geq 1$. In this paper we introduce and study two nonparametric least squares estimators (LSEs) in this setting---the entirely monotonic LSE…

统计理论 · 数学 2020-06-11 Billy Fang , Adityanand Guntuboyina , Bodhisattva Sen

Sparse linear regression, which entails finding a sparse solution to an underdetermined system of linear equations, can formally be expressed as an $l_0$-constrained least-squares problem. The Orthogonal Least-Squares (OLS) algorithm…

机器学习 · 统计学 2016-08-01 Abolfazl Hashemi , Haris Vikalo