中文
相关论文

相关论文: The Adaptive $\tau$-Lasso: Robustness and Oracle P…

200 篇论文

It is known that the Thresholded Lasso (TL), SCAD or MCP correct intrinsic estimation bias of the Lasso. In this paper we propose an alternative method of improving the Lasso for predictive models with general convex loss functions which…

A generic out-of-sample error estimate is proposed for robust $M$-estimators regularized with a convex penalty in high-dimensional linear regression where $(X,y)$ is observed and $p,n$ are of the same order. If $\psi$ is the derivative of…

统计理论 · 数学 2023-03-31 Pierre C Bellec

We consider the adaptive Lasso estimator with componentwise tuning in the framework of a low-dimensional linear regression model. In our setting, at least one of the components is penalized at the rate of consistent model selection and…

统计理论 · 数学 2025-11-11 Nicolai Amann , Ulrike Schneider

The Lasso is one of the most important approaches for parameter estimation and variable selection in high dimensional linear regression. At the heart of its success is the attractive rate of convergence result even when $p$, the dimension…

统计理论 · 数学 2019-08-09 Junlong Zhao , Chenlei Leng

The least absolute shrinkage and selection operator (Lasso) is a popular method for high-dimensional statistics. However, it is known that the Lasso often has estimation bias and prediction error. To address such disadvantages, many…

统计方法学 · 统计学 2026-04-29 Guo Liu

In this paper, we derive non-asymptotic error bounds for the Lasso estimator when the penalty parameter for the estimator is chosen using $K$-fold cross-validation. Our bounds imply that the cross-validated Lasso estimator has nearly…

统计理论 · 数学 2020-02-07 Denis Chetverikov , Zhipeng Liao , Victor Chernozhukov

We study the problem of robustly estimating the posterior distribution for the setting where observed data can be contaminated with potentially adversarial outliers. We propose Rob-ULA, a robust variant of the Unadjusted Langevin Algorithm…

机器学习 · 统计学 2019-07-30 Kush Bhatia , Yi-An Ma , Anca D. Dragan , Peter L. Bartlett , Michael I. Jordan

Plausible identification of conditional average treatment effects (CATEs) may rely on controlling for a large number of variables to account for confounding factors. In these high-dimensional settings, estimation of the CATE requires…

计量经济学 · 经济学 2023-01-18 Adam Baybutt , Manu Navjeevan

The association between a continuous and an ordinal variable is commonly modeled through the polyserial correlation model. However, this model, which is based on a partially-latent normality assumption, may be misspecified in practice, due…

统计方法学 · 统计学 2026-02-11 Max Welz

The lasso has been studied extensively as a tool for estimating the coefficient vector in the high-dimensional linear model; however, considerably less is known about estimating the error variance in this context. In this paper, we propose…

统计方法学 · 统计学 2019-07-22 Guo Yu , Jacob Bien

In this paper,we consider a high-dimensional statistical estimation problem in which the the number of parameters is comparable or larger than the sample size. We present a unified analysis of the performance guarantees of exponential…

统计理论 · 数学 2017-10-04 Tung Duy Luu , Jalal Fadili , Christophe Chesneau

Sequential data collection has emerged as a widely adopted technique for enhancing the efficiency of data gathering processes. Despite its advantages, such data collection mechanism often introduces complexities to the statistical inference…

统计理论 · 数学 2023-11-09 Mufang Ying , Koulik Khamaru , Cun-Hui Zhang

Linear regression estimators are known to be sensitive to outliers, and one alternative to obtain a robust and efficient estimator of the regression parameter is to model the error with Student's $t$ distribution. In this article, we…

统计方法学 · 统计学 2026-03-19 Amanda Ng , Shangkai Zhu , Archer Gong Zhang , Nancy Reid

We establish statistical properties of random-weighting methods in LASSO regression under different regularization parameters $\lambda_n$ and suitable regularity conditions. The random-weighting methods in view concern repeated optimization…

统计方法学 · 统计学 2022-05-25 Tun Lee Ng , Michael A. Newton

In practice, the data distribution at test time often differs, to a smaller or larger extent, from that of the original training data. Consequentially, the so-called source classifier, trained on the available labelled data, deteriorates on…

机器学习 · 统计学 2021-06-18 Wouter M. Kouw , Marco Loog

Lasso-type estimators are routinely used to estimate high-dimensional time series models. The theoretical guarantees established for these estimators typically require the penalty level to be chosen in a suitable fashion often depending on…

This paper considers the problem of robust adaptive efficient estimating of a periodic function in a continuous time regression model with the dependent noises given by a general square integrable semimartingale with a conditionally…

统计理论 · 数学 2019-09-24 Evgeny Pchelintsev , Serguei Pergamenshchikov

This paper proposes a new robust smooth-threshold estimating equation to select important variables and automatically estimate parameters for high dimensional longitudinal data. A novel working correlation matrix is proposed to capture…

统计方法学 · 统计学 2021-11-30 Liya Fu , Jiaqi Li , You-Gan Wang

Estimation and inference in statistics pose significant challenges when data are collected adaptively. Even in linear models, the Ordinary Least Squares (OLS) estimator may fail to exhibit asymptotic normality for single coordinate…

统计理论 · 数学 2023-10-31 Licong Lin , Mufang Ying , Suvrojit Ghosh , Koulik Khamaru , Cun-Hui Zhang

We consider the problem of variables selection and estimation in linear regression model in situations where the number of parameters diverges with the sample size. We propose the adaptive Generalized Ridge-Lasso (\mbox{AdaGril}) which is…

统计方法学 · 统计学 2013-02-27 Mohammed El Anbari , Abdallah Mkhadri