English
Related papers

Related papers: Lazy Estimation of Variable Importance for Large N…

200 papers

Variable selection in linear regression models has been a problem since hypothesis testing began. Which variables to include or exclude from a model is not an easy task. Techniques such as Forward, Back ward, Stepwise Regression…

Methodology · Statistics 2026-05-01 By Riyadh Alrawkan , Edward Boone , Ryad Ghanam , Anton Westveld

Forecasting accuracy in highly uncertain environments is challenging due to the stochastic nature of systems. Deterministic forecasting provides only point estimates and cannot capture potential outcomes. Therefore, probabilistic…

Machine Learning · Computer Science 2024-12-12 Worachit Amnuaypongsa , Jitkomut Songsiri

We propose a penalized likelihood method to fit the bivariate categorical response regression model. Our method allows practitioners to estimate which predictors are irrelevant, which predictors only affect the marginal distributions of the…

Methodology · Statistics 2022-01-25 Aaron J. Molstad , Adam J. Rothman

Importance sampling has been successfully used to accelerate stochastic optimization in many convex problems. However, the lack of an efficient way to calculate the importance still hinders its application to Deep Learning. In this paper,…

Machine Learning · Computer Science 2017-09-14 Angelos Katharopoulos , François Fleuret

Variational inference (VI) is a specific type of approximate Bayesian inference that approximates an intractable posterior distribution with a tractable one. VI casts the inference problem as an optimization problem, more specifically, the…

Machine Learning · Computer Science 2022-12-20 Felix Leibfried

Label noise has been broadly observed in real-world datasets. To mitigate the negative impact of overfitting to label noise for deep models, effective strategies (\textit{e.g.}, re-weighting, or loss rectification) have been broadly applied…

Machine Learning · Computer Science 2026-03-19 Haoliang Sun , Qi Wei , Lei Feng , Yupeng Hu , Fan Liu , Hehe Fan , Yilong Yin

Importance weighted variational inference (VI) approximates densities known up to a normalizing constant by optimizing bounds that tighten with the number of Monte Carlo samples $N$. Standard optimization relies on reparameterized gradient…

Machine Learning · Statistics 2026-02-03 Kamélia Daudel , Minh-Ngoc Tran , Cheng Zhang

The core principle of Variational Inference (VI) is to convert the statistical inference problem of computing complex posterior probability densities into a tractable optimization problem. This property enables VI to be faster than several…

Machine Learning · Computer Science 2023-10-25 Ankush Ganguly , Sanjana Jain , Ukrit Watchareeruetai

Common high-dimensional methods for prediction rely on having either a sparse signal model, a model in which most parameters are zero and there are a small number of non-zero parameters that are large in magnitude, or a dense signal model,…

Methodology · Statistics 2017-09-29 Victor Chernozhukov , Christian Hansen , Yuan Liao

Sparse parametric models are of great interest in statistical learning and are often analyzed by means of regularized estimators. Pathwise methods allow to efficiently compute the full solution path for penalized estimators, for any…

Machine Learning · Statistics 2024-12-06 Alessandro De Gregorio , Francesco Iafrate

Latent variable models have been playing a central role in psychometrics and related fields. In many modern applications, the inference based on latent variable models involves one or several of the following features: (1) the presence of…

Methodology · Statistics 2025-01-08 Siliang Zhang , Yunxiao Chen

Logistic regression is a ubiquitous method for probabilistic classification. However, the effectiveness of logistic regression depends upon careful and relatively computationally expensive tuning, especially for the regularisation…

Machine Learning · Computer Science 2025-04-04 Angus Dempster , Geoffrey I. Webb , Daniel F. Schmidt

We provide a unified analysis of the predictive risk of ridge regression and regularized discriminant analysis in a dense random effects model. We work in a high-dimensional asymptotic regime where $p, n \to \infty$ and $p/n \to \gamma \in…

Statistics Theory · Mathematics 2015-11-05 Edgar Dobriban , Stefan Wager

Regression methods are fundamental for scientific and technological applications. However, fitted models can be highly unreliable outside of their training domain, and hence the quantification of their uncertainty is crucial in many of…

Machine Learning · Statistics 2024-03-05 Filippo Bigi , Sanggyu Chong , Michele Ceriotti , Federico Grasselli

Offline reinforcement learning (RL), where the agent aims to learn the optimal policy based on the data collected by a behavior policy, has attracted increasing attention in recent years. While offline RL with linear function approximation…

Machine Learning · Computer Science 2024-10-10 Qiwei Di , Heyang Zhao , Jiafan He , Quanquan Gu

Two different approaches exist to handle missing values for prediction: either imputation, prior to fitting any predictive algorithms, or dedicated methods able to natively incorporate missing values. While imputation is widely (and easily)…

Statistics Theory · Mathematics 2023-02-01 Alexis Ayme , Claire Boyer , Aymeric Dieuleveut , Erwan Scornet

In many applications, it is of interest to assess the relative contribution of features (or subsets of features) toward the goal of predicting a response -- in other words, to gauge the variable importance of features. Most recent work on…

Methodology · Statistics 2025-10-23 Brian D. Williamson , Peter B. Gilbert , Noah R. Simon , Marco Carone

Penalization schemes like Lasso or ridge regression are routinely used to regress a response of interest on a high-dimensional set of potential predictors. Despite being decisive, the question of the relative strength of penalization is…

Methodology · Statistics 2018-11-08 Britta Velten , Wolfgang Huber

In this paper, we study norm-based regularization methods for neural networks. We compare existing penalization approaches and introduce two regularization strategies that extend classical ridge- and lasso-type penalties to neural network…

Machine Learning · Statistics 2026-05-04 Muhammad Qasim , Farrukh Javed

We discuss the fundamental issue of identification in linear instrumental variable (IV) models with unknown IV validity. With the assumption of the "sparsest rule", which is equivalent to the plurality rule but becomes operational in…

Methodology · Statistics 2023-12-06 Yiqi Lin , Frank Windmeijer , Xinyuan Song , Qingliang Fan