English
Related papers

Related papers: The Derivative of Influence Function, Location Bre…

200 papers

Influence functions efficiently estimate the effect of removing a single training data point on a model's learned parameters. While influence estimates align well with leave-one-out retraining for linear models, recent works have shown this…

Machine Learning · Computer Science 2022-09-13 Juhan Bae , Nathan Ng , Alston Lo , Marzyeh Ghassemi , Roger Grosse

As machine learning is increasingly deployed in the real world, it is paramount that we develop the tools necessary to analyze the decision-making of the models we train and deploy to end-users. Recently, researchers have shown that…

Machine Learning · Computer Science 2022-05-05 Andrew Silva , Rohit Chopra , Matthew Gombolay

In modern drug development, the broader availability of high-dimensional observational data provides opportunities for scientist to explore subgroup heterogeneity, especially when randomized clinical trials are unavailable due to cost and…

Methodology · Statistics 2021-02-24 Xinzhou Guo , Linqing Wei , Chong Wu , Jingshen Wang

In traditional logistic regression models, the link function is often assumed to be linear and continuous in predictors. Here, we consider a threshold model that all continuous features are discretized into ordinal levels, which further…

Methodology · Statistics 2022-02-18 Yinan Lin , Wen Zhou , Zhi Geng , Gexin Xiao , Jianxin Yin

An experiment was performed using Dual-plane-SPIV in the LMFL boundary layer facility to determine all of the derivative moments needed to estimate the average dissipation rate of the turbulent kinetic energy, $\varepsilon$, and its…

Study samples often differ from the target populations of inference and policy decisions in non-random ways. Researchers typically believe that such departures from random sampling -- due to changes in the population over time and space, or…

Methodology · Statistics 2023-07-20 Tamara Broderick , Ryan Giordano , Rachael Meager

For data segmentation in high-dimensional linear regression settings, the regression parameters are often assumed to be sparse segment-wise, which enables many existing methods to estimate the parameters locally via $\ell_1$-regularised…

Methodology · Statistics 2026-05-08 Haeran Cho , Tobias Kley , Housen Li

Distant supervision (DS) is a strong way to expand the datasets for enhancing relation extraction (RE) models but often suffers from high label noise. Current works based on attention, reinforcement learning, or GAN are black-box models so…

Machine Learning · Computer Science 2022-01-26 Zifeng Wang , Rui Wen , Xi Chen , Shao-Lun Huang , Ningyu Zhang , Yefeng Zheng

This paper concerns the development of an inferential framework for high-dimensional linear mixed effect models. These are suitable models, for instance, when we have $n$ repeated measurements for $M$ subjects. We consider a scenario where…

Methodology · Statistics 2019-12-17 Lina Lin , Mathias Drton , Ali Shojaie

Cook's [J. Roy. Statist. Soc. Ser. B 48 (1986) 133--169] local influence approach based on normal curvature is an important diagnostic tool for assessing local influence of minor perturbations to a statistical model. However, no rigorous…

Statistics Theory · Mathematics 2008-12-18 Hongtu Zhu , Joseph G. Ibrahim , Sikyum Lee , Heping Zhang

Deep learning models have been criticized for their lack of easy interpretation, which undermines confidence in their use for important applications. Nevertheless, they are consistently utilized in many applications, consequential to…

Machine Learning · Computer Science 2020-01-06 Roozbeh Yousefzadeh , Dianne P. O'Leary

Many reinforcement learning (RL) environments consist of independent entities that interact sparsely. In such environments, RL agents have only limited influence over other entities in any particular situation. Our idea in this work is that…

Machine Learning · Computer Science 2021-12-03 Maximilian Seitzer , Bernhard Schölkopf , Georg Martius

We study the problem of learning feature representations from a pair of random variables, where we focus on the representations that are induced by their dependence. We provide sufficient and necessary conditions for such dependence induced…

Machine Learning · Computer Science 2024-11-26 Xiangxiang Xu , Lizhong Zheng

We introduce a new Stata package called summclust that summarizes the cluster structure of the dataset for linear regression models with clustered disturbances. The key unit of observation for such a model is the cluster. We therefore…

Econometrics · Economics 2023-11-27 James G. MacKinnon , Morten Ørregaard Nielsen , Matthew D. Webb

Performative distribution shift captures the setting where the choice of which ML model is deployed changes the data distribution. For example, a bank which uses the number of open credit lines to determine a customer's risk of default on a…

Machine Learning · Computer Science 2021-02-17 Zachary Izzo , Lexing Ying , James Zou

High-dimensional group inference is an essential part of statistical methods for analysing complex data sets, including hierarchical testing, tests of interaction, detection of heterogeneous treatment effects and inference for local…

Methodology · Statistics 2020-12-01 Zijian Guo , Claude Renaux , Peter Bühlmann , T. Tony Cai

BCART (Bayesian Classification and Regression Trees) and BART (Bayesian Additive Regression Trees) are popular Bayesian regression models widely applicable in modern regression problems. Their popularity is intimately tied to the ability to…

Methodology · Statistics 2023-05-19 Matthew T. Pratola , Edward I. George , Robert E. McCulloch

This paper provides general matrix formulas for computing the score function, the (expected and observed) Fisher information and the $\Delta$ matrices (required for the assessment of local influence) for a quite general model which includes…

Methodology · Statistics 2021-09-17 Alexandre G. Patriota

This paper illustrates the central role of loss functions in data-driven decision making, providing a comprehensive survey on their influence in cost-sensitive classification (CSC) and reinforcement learning (RL). We demonstrate how…

Machine Learning · Statistics 2025-04-07 Kaiwen Wang , Nathan Kallus , Wen Sun

Subsampling methods have been recently proposed to speed up least squares estimation in large scale settings. However, these algorithms are typically not robust to outliers or corruptions in the observed covariates. The concept of influence…

Machine Learning · Statistics 2014-06-20 Brian McWilliams , Gabriel Krummenacher , Mario Lucic , Joachim M. Buhmann