中文
相关论文

相关论文: Accuracy and stability of solar variable selection…

200 篇论文

We propose a Distributionally Robust Optimization (DRO) formulation with a Wasserstein-based uncertainty set for selecting grouped variables under perturbations on the data for both linear regression and classification problems. The…

机器学习 · 统计学 2020-06-12 Ruidi Chen , Ioannis Ch. Paschalidis

Recent work has focused on the problem of conducting linear regression when the number of covariates is very large, potentially greater than the sample size. To facilitate this, one useful tool is to assume that the model can be well…

统计方法学 · 统计学 2011-11-21 Zhou Fang

This paper investigates the high-dimensional linear regression with highly correlated covariates. In this setup, the traditional sparsity assumption on the regression coefficients often fails to hold, and consequently many model selection…

统计方法学 · 统计学 2019-03-26 Jianqing Fan , Bai Jiang , Qiang Sun

We study the limitations of the well known LASSO regression as a variable selector when there exists dependence structures among covariates. We analyze both the classic situation with $n\geq p$ and the high dimensional framework with $p>n$.…

Cellwise outliers are widespread in data and traditional robust methods may fail when applied to datasets under such contamination. We propose a variable selection procedure, that uses a pairwise robust estimator to obtain an initial…

统计方法学 · 统计学 2023-09-06 Peng Su , Garth Tarr , Samuel Muller

Explanatory variables in a predictive regression typically exhibit low signal strength and various degrees of persistence. Variable selection in such a context is of great importance. In this paper, we explore the pitfalls and possibilities…

计量经济学 · 经济学 2021-02-16 Ji Hyung Lee , Zhentao Shi , Zhan Gao

High-dimensional regression often suffers from heavy-tailed noise and outliers, which can severely undermine the reliability of least-squares based methods. To improve robustness, we adopt a non-smooth Wilcoxon score based rank objective…

机器学习 · 统计学 2026-01-29 Meixia Lin , Meijiao Shi , Yunhai Xiao , Qian Zhang

Data irregularity in cancer genomics studies has been widely observed in the form of outliers and heavy-tailed distributions in the complex traits. In the past decade, robust variable selection methods have emerged as powerful alternatives…

统计方法学 · 统计学 2024-05-14 Yuwen Liu , Jie Ren , Shuangge Ma , Cen Wu

In many high dimensional classification or regression problems set in a biological context, the complete identification of the set of informative features is often as important as predictive accuracy, since this can provide mechanistic…

机器学习 · 计算机科学 2020-03-02 Yuxin Sun , Benny Chain , Samuel Kaski , John Shawe-Taylor

Distributionally robust stochastic optimization (DRSO) is a framework for decision-making problems under certainty, which finds solutions that perform well for a chosen set of probability distributions. Many different approaches for…

最优化与控制 · 数学 2017-01-17 Rui Gao , Anton J. Kleywegt

Among the most popular variable selection procedures in high-dimensional regression, Lasso provides a solution path to rank the variables and determines a cut-off position on the path to select variables and estimate coefficients. In this…

统计方法学 · 统计学 2018-06-19 X. Jessie Jeng , Huimin Peng , Wenbin Lu

Reproducibility is imperative for any scientific discovery. More often than not, modern scientific findings rely on statistical analysis of high-dimensional data. At a minimum, reproducibility manifests itself in stability of statistical…

统计理论 · 数学 2013-10-02 Bin Yu

This paper studies model selection consistency for high dimensional sparse regression when data exhibits both cross-sectional and serial dependency. Most commonly-used model selection methods fail to consistently recover the true model when…

统计方法学 · 统计学 2018-09-12 Jianqing Fan , Yuan Ke , Kaizheng Wang

We consider the problem of simultaneous variable selection and constant coefficient identification in high-dimensional varying coefficient models based on B-spline basis expansion. Both objectives can be considered as some type of model…

统计方法学 · 统计学 2010-08-16 Heng Lian

We consider estimation in a high-dimensional linear model with strongly correlated variables. We propose to cluster the variables first and do subsequent sparse estimation such as the Lasso for cluster-representatives or the group Lasso…

统计方法学 · 统计学 2015-01-14 Peter Bühlmann , Philipp Rütimann , Sara van de Geer , Cun-Hui Zhang

Leading methods for support recovery in high-dimensional regression, such as Lasso, have been well-studied and their limitations in the context of correlated design have been characterized with precise incoherence conditions. In this work,…

统计理论 · 数学 2019-03-25 S. Jalil Kazemitabar , Arash A. Amini , Ameet Talwalkar

This paper is concerned with high-dimensional panel data models where the number of regressors can be much larger than the sample size. Under the assumption that the true parameter vector is sparse we propose a panel-Lasso estimator and…

统计理论 · 数学 2014-02-14 Anders Bredahl Kock

Shrinkage estimators that possess the ability to produce sparse solutions have become increasingly important to the analysis of today's complex datasets. Examples include the LASSO, the Elastic-Net and their adaptive counterparts.…

统计方法学 · 统计学 2017-02-09 Hongmei Liu , J. Sunil Rao

Sparse linear regression is a central problem in high-dimensional statistics. We study the correlated random design setting, where the covariates are drawn from a multivariate Gaussian $N(0,\Sigma)$, and we seek an estimator with small…

数据结构与算法 · 计算机科学 2023-05-29 Jonathan Kelner , Frederic Koehler , Raghu Meka , Dhruv Rohatgi

Variable selection in linear models plays a pivotal role in modern statistics. Hard-thresholding methods such as $l_0$ regularization are theoretically ideal but computationally infeasible. In this paper, we propose a new approach, called…

机器学习 · 统计学 2015-03-20 Kun Yang