中文
相关论文

相关论文: Estimation in high-dimensional linear regression: …

200 篇论文

This paper develops a new approach to post-selection inference for screening high-dimensional predictors of survival outcomes. Post-selection inference for right-censored outcome data has been investigated in the literature, but much…

统计方法学 · 统计学 2021-12-22 Tzu-Jung Huang , Alex Luedtke , Ian W. McKeague

We propose a nonconvex estimator for joint multivariate regression and precision matrix estimation in the high dimensional regime, under sparsity constraints. A gradient descent algorithm with hard thresholding is developed to solve the…

机器学习 · 统计学 2016-06-03 Jinghui Chen , Quanquan Gu

Due to the curse of dimensionality, estimation in a multidimensional nonparametric regression model is in general not feasible. Hence, additional restrictions are introduced, and the additive model takes a prominent place. The restrictions…

统计理论 · 数学 2007-06-13 M. Studer , B. Seifert , T. Gasser

Linear regression is a fundamental and popular statistical method. There are various kinds of linear regression, such as mean regression and quantile regression. In this paper, we propose a new one called distribution regression, which…

统计方法学 · 统计学 2017-12-27 Xin Chen , Xuejun Ma , Wang Zhou

We investigate how to improve efficiency using regression adjustments with covariates in covariate-adaptive randomizations (CARs) with imperfect subject compliance. Our regression-adjusted estimators, which are based on the doubly robust…

计量经济学 · 经济学 2023-06-19 Liang Jiang , Oliver B. Linton , Haihan Tang , Yichong Zhang

We revisit the problem of estimating the local average treatment effect (LATE) and the local average treatment effect on the treated (LATT) when control variables are available, either to render the instrumental variable (IV) suitably…

计量经济学 · 经济学 2022-11-16 Tymon Słoczyński , S. Derya Uysal , Jeffrey M. Wooldridge

Many machine learning tasks that involve predicting an output response can be solved by training a weighted regression model. Unfortunately, the predictive power of this type of models may severely deteriorate under low sample sizes or…

机器学习 · 统计学 2021-10-01 Tam Le , Truyen Nguyen , Makoto Yamada , Jose Blanchet , Viet Anh Nguyen

Linear mixed models (LMMs) are used extensively to model dependecies of observations in linear regression and are used extensively in many application areas. Parameter estimation for LMMs can be computationally prohibitive on big data.…

机器学习 · 统计学 2019-03-08 Zilong Tan , Kimberly Roche , Xiang Zhou , Sayan Mukherjee

Correlated outcomes are common in many practical problems. In some settings, one outcome is of particular interest, and others are auxiliary. To leverage information shared by all the outcomes, traditional multi-task learning (MTL)…

统计方法学 · 统计学 2023-03-23 Muxuan Liang , Jaeyoung Park , Qing Lu , Xiang Zhong

Estimating statistical models within sensor networks requires distributed algorithms, in which both data and computation are distributed across the nodes of the network. We propose a general approach for distributed learning based on…

机器学习 · 计算机科学 2012-07-03 Qiang Liu , Alexander Ihler

Nonlinear regression problem is one of the most popular and important statistical tasks. The first methods like least squares estimation go back to Gauss and Legendre. Recent models and developments in statistics and machine learning like…

统计理论 · 数学 2025-02-20 Vladimir Spokoiny

A learned generative model often produces biased statistics relative to the underlying data distribution. A standard technique to correct this bias is importance sampling, where samples from the model are weighted by the likelihood ratio…

In this paper we analyze boosting algorithms in linear regression from a new perspective: that of modern first-order methods in convex optimization. We show that classic boosting algorithms in linear regression, namely the incremental…

统计理论 · 数学 2015-05-19 Robert M. Freund , Paul Grigas , Rahul Mazumder

Meta-learning involves training models on a variety of training tasks in a way that enables them to generalize well on new, unseen test tasks. In this work, we consider meta-learning within the framework of high-dimensional multivariate…

统计理论 · 数学 2024-04-01 Yanhao Jin , Krishnakumar Balasubramanian , Debashis Paul

We propose the Bayesian adaptive Lasso (BaLasso) for variable selection and coefficient estimation in linear regression. The BaLasso is adaptive to the signal level by adopting different shrinkage for different coefficients. Furthermore, we…

统计方法学 · 统计学 2010-09-14 Chenlei Leng , Minh Ngoc Tran , David Nott

Fully robust versions of the elastic net estimator are introduced for linear and logistic regression. The algorithms to compute the estimators are based on the idea of repeatedly applying the non-robust classical estimators to data subsets…

统计方法学 · 统计学 2017-03-16 Fatma Sevinc Kurnaz , Irene Hoffmann , Peter Filzmoser

The ordinary least squares estimate in linear regression is sensitive to the influence of errors with large variance, which reduces its robustness, especially when dealing with heavy-tailed errors or outliers frequently encountered in…

统计方法学 · 统计学 2025-05-01 Mengjiao Shi , Yunhai Xiao

We consider the problem of model selection and estimation in sparse high dimensional linear regression models with strongly correlated variables. First, we study the theoretical properties of the dual Lasso solution, and we show that joint…

应用统计 · 统计学 2017-03-21 Niharika Gauraha

This paper presents and discusses forms of estimation by regularized regression and model selection using the LASSO method - Least Absolute Shrinkage and Selection Operator. LASSO is recognized as one of the main supervised learning methods…

统计方法学 · 统计学 2025-11-14 Alessandro V. M. Oliveira

There are now many options for doubly robust estimation; however, there is a concerning trend in the applied literature to believe that the combination of a propensity score and an adjusted outcome model automatically results in a doubly…