中文
相关论文

相关论文: Lazy Estimation of Variable Importance for Large N…

200 篇论文

This paper introduces a novel framework for estimation and inference in penalized M-estimators applied to robust high-dimensional linear regression models. Traditional methods for high-dimensional statistical inference, which predominantly…

统计方法学 · 统计学 2025-04-15 Dian Zheng , Lingzhou Xue

Obtaining valid treatment effect inference remains a challenging problem when dealing with numerous instruments and non-sparse control variables. In this paper, we propose a novel ridge regularization-based instrumental variables method for…

计量经济学 · 经济学 2025-10-17 Xiduo Chen , Xingdong Feng , Antonio F. Galvao , Yeheng Ge

When developing risk prediction models, shrinkage methods are recommended, especially when the sample size is limited. Several earlier studies have shown that the shrinkage of model coefficients can reduce overfitting of the prediction…

统计方法学 · 统计学 2019-07-29 Ben Van Calster , Maarten van Smeden , Ewout W. Steyerberg

Sparse Gaussian graphical models characterize sparse dependence relationships between random variables in a network. To estimate multiple related Gaussian graphical models on the same set of variables, we formulate a hierarchical model,…

统计方法学 · 统计学 2014-06-10 Yuancheng Zhu , Rina Foygel Barber

Recent theoretical studies proved that deep neural network (DNN) estimators obtained by minimizing empirical risk with a certain sparsity constraint can attain optimal convergence rates for regression and classification problems. However,…

统计理论 · 数学 2021-08-10 Ilsang Ohn , Yongdai Kim

Given a collection of features available for inclusion in a predictive model, it may be of interest to quantify the relative importance of a subset of features for the prediction task at hand. For example, in HIV vaccine trials, participant…

统计方法学 · 统计学 2025-03-27 Charles J. Wolock , Peter B. Gilbert , Noah Simon , Marco Carone

One popular approach for nonstructural economic and financial forecasting is to include a large number of economic and financial variables, which has been shown to lead to significant improvements for forecasting, for example, by the…

机器学习 · 统计学 2011-06-21 Song Song , Peter J. Bickel

This paper is concerned with a novel deep learning method for variational problems with essential boundary conditions. To this end, we first reformulate the original problem into a minimax problem corresponding to a feasible augmented…

数值分析 · 数学 2022-05-10 Jianguo Huang , Haoqin Wang , Tao Zhou

This paper develops new tools to quantify uncertainty in optimal decision making and to gain insight into which variables one should collect information about given the potential cost of measuring a large number of variables. We investigate…

统计方法学 · 统计学 2021-05-11 Yunan Wu , Lan Wang , Haoda Fu

Bias in datasets can be very detrimental for appropriate statistical estimation. In response to this problem, importance weighting methods have been developed to match any biased distribution to its corresponding target unbiased…

机器学习 · 计算机科学 2022-09-12 Antoine de Mathelin , Francois Deheeger , Mathilde Mougeot , Nicolas Vayatis

$\ell_p$-norm penalization, notably the Lasso, has become a standard technique, extending shrinkage regression to subset selection. Despite aiming for oracle properties and consistent estimation, existing Lasso-derived methods still rely on…

统计方法学 · 统计学 2025-06-23 Sihyung Park , Leonard A. Stefanski

We study the nonparametric least squares estimator (LSE) of a multivariate convex regression function. The LSE, given as the solution to a quadratic program with $O(n^2)$ linear constraints ($n$ being the sample size), is difficult to…

统计计算 · 统计学 2015-09-29 Rahul Mazumder , Arkopal Choudhury , Garud Iyengar , Bodhisattva Sen

We propose a model-free reinforcement learning algorithm inspired by the popular randomized least squares value iteration (RLSVI) algorithm as well as the optimism principle. Unlike existing upper-confidence-bound (UCB) based approaches,…

机器学习 · 计算机科学 2021-10-27 Haque Ishfaq , Qiwen Cui , Viet Nguyen , Alex Ayoub , Zhuoran Yang , Zhaoran Wang , Doina Precup , Lin F. Yang

This paper studies linear overparameterized models in economic forecasting and highlights that including noise variables (regressors with no predictive power) regularizes the estimator. We consider a setting where both the outcome variable…

计量经济学 · 经济学 2026-04-16 Yuan Liao , Xinjie Ma , Andreas Neuhierl , Zhentao Shi

Variable importance is central to scientific studies, including the social sciences and causal inference, healthcare, and other domains. However, current notions of variable importance are often tied to a specific predictive model. This is…

机器学习 · 统计学 2020-02-11 Jiayun Dong , Cynthia Rudin

Generalized linear models (GLMs) are fundamental tools for statistical modeling, with maximum likelihood estimation (MLE) serving as the classical approach for parameter inference. While MLE performs well for canonical GLMs, it can become…

统计方法学 · 统计学 2026-03-03 Linglingzhi Zhu , Jonghyeok Lee , Yao Xie

We propose a method for estimating long-term treatment effects with many short-term proxy outcomes: a central challenge when experimenting on digital platforms. We formalize this challenge as a latent variable problem where observed proxies…

计量经济学 · 经济学 2026-01-13 Apoorva Lal , Guido Imbens , Peter Hull

We study the problem of offline policy optimization in stochastic contextual bandit problems, where the goal is to learn a near-optimal policy based on a dataset of decision data collected by a suboptimal behavior policy. Rather than making…

机器学习 · 计算机科学 2023-09-28 Germano Gabbianelli , Gergely Neu , Matteo Papini

High-dimensional time series data appear in many scientific areas in the current data-rich environment. Analysis of such data poses new challenges to data analysts because of not only the complicated dynamic dependence between the series,…

统计方法学 · 统计学 2022-06-22 Di Wang , Ruey S. Tsay

Many statistical problems can be reduced to a linear inverse problem in which only a noisy version of the operator is available. Particular examples include random design regression, deconvolution problem, instrumental variable regression,…

统计理论 · 数学 2025-04-22 Vladimir Spokoiny