中文
相关论文

相关论文: Restricted LASSO and Double Shrinking

200 篇论文

There has been much recent work on inference after model selection when the noise level is known, however, $\sigma$ is rarely known in practice and its estimation is difficult in high-dimensional settings. In this work we propose using the…

统计理论 · 数学 2017-02-13 Xiaoying Tian , Joshua R. Loftus , Jonathan E. Taylor

We consider situations where a user feeds her attributes to a machine learning method that tries to predict her best option based on a random sample of other users. The predictor is incentive-compatible if the user has no incentive to…

计量经济学 · 经济学 2021-09-07 Mehmet Caner , Kfir Eliaz

This paper provides a statistical analysis of high-dimensional batch Reinforcement Learning (RL) using sparse linear function approximation. When there is a large number of candidate features, our result sheds light on the fact that…

机器学习 · 计算机科学 2020-11-10 Botao Hao , Yaqi Duan , Tor Lattimore , Csaba Szepesvári , Mengdi Wang

We consider estimation of conditional hazard functions and densities over the class of multivariate c\`adl\`ag functions with uniformly bounded sectional variation norm when data are either fully observed or subject to right-censoring. We…

Sparse linear regression is a vast field and there are many different algorithms available to build models. Two new papers published in Statistical Science study the comparative performance of several sparse regression methodologies,…

机器学习 · 计算机科学 2021-02-10 Owais Sarwar , Benjamin Sauk , Nikolaos V. Sahinidis

We consider a regression framework where the design points are deterministic and the errors possibly non-i.i.d. and heavy-tailed (with a moment of order $p$ in $[1,2]$). Given a class of candidate regression functions, we propose a…

统计理论 · 数学 2025-06-03 Yannick Baraud , Guillaume Maillard

We study the distributions of the LASSO, SCAD, and thresholding estimators, in finite samples and in the large-sample limit. The asymptotic distributions are derived for both the case where the estimators are tuned to perform consistent…

统计理论 · 数学 2009-09-07 Benedikt M. Potscher , Hannes Leeb

The Lasso is a computationally efficient regression regularization procedure that can produce sparse estimators when the number of predictors (p) is large. Oracle inequalities provide probability loss bounds for the Lasso estimator at a…

机器学习 · 统计学 2017-07-21 Cheryl J. Flynn , Clifford M. Hurvich , Jeffrey S. Simonoff

Scaled sparse linear regression jointly estimates the regression coefficients and noise level in a linear model. It chooses an equilibrium with a sparse regression method by iteratively estimating the noise level via the mean residual…

机器学习 · 统计学 2012-06-22 Tingni Sun , Cun-Hui Zhang

Selective inference methods are developed for group lasso estimators for use with a wide class of distributions and loss functions. The method includes the use of exponential family distributions, as well as quasi-likelihood modeling for…

统计方法学 · 统计学 2024-03-28 Yiling Huang , Sarah Pirenne , Snigdha Panigrahi , Gerda Claeskens

Consider the case that we observe $n$ independent and identically distributed copies of a random variable with a probability distribution known to be an element of a specified statistical model. We are interested in estimating an infinite…

统计理论 · 数学 2017-09-20 Mark J. van der Laan , Aurélien F. Bibaut

Effect modification occurs when the effect of the treatment on an outcome varies according to the level of other covariates and often has important implications in decision making. When there are tens or hundreds of covariates, it becomes…

统计方法学 · 统计学 2021-11-23 Qingyuan Zhao , Dylan S. Small , Ashkan Ertefaie

We propose a new approach to mixed-frequency regressions in a high-dimensional environment that resorts to Group Lasso penalization and Bayesian techniques for estimation and inference. In particular, to improve the prediction properties of…

计量经济学 · 经济学 2020-06-12 Matteo Mogliani , Anna Simoni

This paper is concerned with inference on the regression function of a high-dimensional linear model when outcomes are missing at random. We propose an estimator which combines a Lasso pilot estimate of the regression function with a bias…

统计方法学 · 统计学 2024-12-11 Yikun Zhang , Alexander Giessing , Yen-Chi Chen

Sparse model estimation is a topic of high importance in modern data analysis due to the increasing availability of data sets with a large number of variables. Another common problem in applied statistics is the presence of outliers in the…

应用统计 · 统计学 2025-02-03 Andreas Alfons , Christophe Croux , Sarah Gelper

While Weighted Lasso sparse regression has appealing statistical guarantees that would entail a major real-world impact in finance, genomics, and brain imaging applications, it is typically scarcely adopted due to its complex…

机器学习 · 计算机科学 2022-06-13 Kenan Šehić , Alexandre Gramfort , Joseph Salmon , Luigi Nardi

Analysis of random censored life-time data along with some related stochastic covariables is of great importance in many applied sciences like medical research, population studies and planning etc. The parametric estimation technique…

统计理论 · 数学 2019-05-09 Abhik Ghosh , Ayanendranath Basu

This article presents a novel methodology for detecting multiple biomarkers in high-dimensional mediation models by utilizing a modified Least Absolute Shrinkage and Selection Operator (LASSO) alongside Pathway LASSO. This approach…

统计方法学 · 统计学 2025-04-17 Pei-Shan Yen , Soumya Sahu , Debarghya Nandi , Zhaoliang Zhou , Olusola Ajilore , Dulal Bhaumik

We show that two polynomial time methods, a Lasso estimator with adaptively chosen tuning parameter and a Slope estimator, adaptively achieve the exact minimax prediction and $\ell_2$ estimation rate $(s/n)\log (p/s)$ in high-dimensional…

统计理论 · 数学 2017-05-26 Pierre C. Bellec , Guillaume Lecué , Alexandre B. Tsybakov

Beta regression model is useful in the analysis of bounded continuous outcomes such as proportions. It is well known that for any regression model, the presence of multicollinearity leads to poor performance of the maximum likelihood…

统计方法学 · 统计学 2021-11-30 Ejaz Ahmed , Reza Arabi Belaghi , Yasin Asar , Abdulkhadir Hussein