中文
相关论文

相关论文: The Adaptive $\tau$-Lasso: Robustness and Oracle P…

200 篇论文

The adaptive lasso refers to a class of methods that use weighted versions of the $L_1$-norm penalty, with weights derived from an initial estimate of the parameter vector to be estimated. Irrespective of the method chosen to compute this…

统计方法学 · 统计学 2021-07-16 Ballout Nadim , Etievant Lola , Viallon Vivian

Linear models that contain a time-dependent response and explanatory variables have attracted much interest in recent years. The most general form of the existing approaches is of a linear regression model with autoregressive moving average…

统计方法学 · 统计学 2021-02-15 Hamed Haselimashhadi , Veronica Vinciotti

Lasso, or $\ell^1$ regularized least squares, has been explored extensively for its remarkable sparsity properties. It is shown in this paper that the solution to Lasso, in addition to its sparsity, has robustness properties: it is the…

信息论 · 计算机科学 2008-11-13 Huan Xu , Constantine Caramanis , Shie Mannor

The presence of outliers (anomalous values) in synthetic aperture radar (SAR) data and the misspecification in statistical image models may result in inaccurate inferences. To avoid such issues, the Rayleigh regression model based on a…

应用统计 · 统计学 2022-08-02 B. G. Palm , F. M. Bayer , R. Machado , M. I. Pettersson , V. T. Vu , R. J. Cintra

The consistency of doubly robust estimators relies on consistent estimation of at least one of two nuisance regression parameters. In moderate to large dimensions, the use of flexible data-adaptive regression estimators may aid in achieving…

机器学习 · 统计学 2019-01-30 Iván Díaz

Shrinkage estimators that possess the ability to produce sparse solutions have become increasingly important to the analysis of today's complex datasets. Examples include the LASSO, the Elastic-Net and their adaptive counterparts.…

统计方法学 · 统计学 2017-02-09 Hongmei Liu , J. Sunil Rao

This paper presents a comprehensive exploration of the theoretical properties inherent in the Adaptive Lasso and the Transfer Lasso. The Adaptive Lasso, a well-established method, employs regularization divided by initial estimators and is…

机器学习 · 统计学 2024-04-18 Masaaki Takada , Hironori Fujisawa

The lasso and related sparsity inducing algorithms have been the target of substantial theoretical and applied research. Correspondingly, many results are known about their behavior for a fixed or optimally chosen tuning parameter specified…

统计理论 · 数学 2016-06-23 Darren Homrighausen , Daniel J. McDonald

We propose a general approach to handle data contaminations that might disrupt the performance of feature selection and estimation procedures for high-dimensional linear models. Specifically, we consider the co-occurrence of mean-shift and…

统计方法学 · 统计学 2021-06-23 Luca Insolia , Francesca Chiaromonte , Runze Li , Marco Riani

We build a unifying convex analysis framework characterizing the statistical properties of a large class of penalized estimators, both under a regular and an irregular design. Our framework interprets penalized estimators as proximal…

统计理论 · 数学 2026-05-12 Alberto Quaini , Fabio Trojani

We investigate a robust penalized logistic regression algorithm based on a minimum distance criterion. Influential outliers are often associated with the explosion of parameter vector estimates, but in the context of standard logistic…

统计方法学 · 统计学 2014-02-21 Eric C. Chi , David W. Scott

This paper examines LASSO, a widely-used $L_{1}$-penalized regression method, in high dimensional linear predictive regressions, particularly when the number of potential predictors exceeds the sample size and numerous unit root regressors…

计量经济学 · 经济学 2024-01-17 Ziwei Mei , Zhentao Shi

For high-dimensional omics data, sparsity-inducing regularization methods such as the Lasso are widely used and often yield strong predictive performance, even in settings when the assumption of sparsity is likely violated. We demonstrate…

统计方法学 · 统计学 2025-02-13 Andrea Bratsberg , Magne Thoresen , Jelle J. Goeman

Adaptive importance samplers are adaptive Monte Carlo algorithms to estimate expectations with respect to some target distribution which \textit{adapt} themselves to obtain better estimators over a sequence of iterations. Although it is…

统计计算 · 统计学 2020-05-08 Ömer Deniz Akyildiz , Joaquín Míguez

Convex and penalized robust regression methods often suffer from a persistent bias induced by large outliers, limiting their effectiveness in adversarial or heavy-tailed settings. In this work, we study a smooth redescending non-convex…

统计理论 · 数学 2025-12-01 Ilyes Hammouda , Mohamed Ndaoud , Abd-Krim Seghouane

Tensor-on-tensor (TOT) regression is an important tool for the analysis of tensor data, aiming to predict a set of response tensors from a corresponding set of predictor tensors. However, standard TOT regression is sensitive to outliers,…

统计方法学 · 统计学 2026-03-30 Mehdi Hirari , Fabio Centofanti , Mia Hubert , Stefan Van Aelst

We study a set of regularization methods for high-dimensional linear regression models. These penalized estimators have the square root of the residual sum of squared errors as loss function, and any weakly decomposable norm as penalty…

统计理论 · 数学 2016-06-28 Benjamin Stucky , Sara van de Geer

We study the out-of-sample properties of robust empirical optimization problems with smooth $\phi$-divergence penalties and smooth concave objective functions, and develop a theory for data-driven calibration of the non-negative "robustness…

机器学习 · 统计学 2020-05-20 Jun-Ya Gotoh , Michael Jong Kim , Andrew E. B. Lim

Linear regression with normally distributed errors - including particular cases such as ANOVA, Student's t-test or location-scale inference - is a widely used statistical procedure. In this case the ordinary least squares estimator…

统计方法学 · 统计学 2019-09-18 Alain Desgagné

It is well-known that saturated output observations are prevalent in various practical systems and that the $\ell_1$-norm is more robust than the $\ell_2$-norm-based parameter estimation. Unfortunately, adaptive identification based on both…

系统与控制 · 电气工程与系统科学 2024-12-17 Xin Zheng , Lei Guo