English
Related papers

Related papers: Technical Report: Higher Order Influence Functions…

200 papers

These lecture notes provide an overview of existing methodologies and recent developments for estimation and inference with high dimensional time series regression models. First, we present main limit theory results for high dimensional…

Econometrics · Economics 2023-09-01 Christis Katsouris

A critical aspect of analyzing and improving modern machine learning systems lies in understanding how individual training examples influence a model's predictive behavior. Estimating this influence enables critical applications, including…

Machine Learning · Computer Science 2025-10-15 Narine Kokhlikyan , Kamalika Chaudhuri , Saeed Mahloujifar

Influence functions estimate effect of individual data points on predictions of the model on test data and were adapted to deep learning in Koh and Liang [2017]. They have been used for detecting data poisoning, detecting helpful and…

Machine Learning · Computer Science 2022-10-04 Nikunj Saunshi , Arushi Gupta , Mark Braverman , Sanjeev Arora

Procedures in assessing the impact of serial dependency on performance analysis are usually built on parametrically specified models. In this paper, we propose a robust, nonparametric approach to carry out this assessment, by computing the…

Methodology · Statistics 2016-06-22 Henry Lam

We propose a doubly robust estimator for the average treatment effect in high dimensional low sample size observational studies, where contamination and model misspecification pose serious inferential challenges. The estimator combines…

Methodology · Statistics 2025-11-04 Byeonghee Lee , Sangwook Kang , Ju-Hyun Park , Saebom Jeon , Joonsung Kang

Instrumental variable (IV) methods are widely used to infer treatment effects in the presence of unmeasured confounding. In this paper, we study nonparametric inference with an IV under a separable binary treatment choice model, which…

Methodology · Statistics 2026-02-03 Chan Park , Eric Tchetgen Tchetgen

Influence functions (IF) have been seen as a technique for explaining model predictions through the lens of the training data. Their utility is assumed to be in identifying training examples "responsible" for a prediction so that, for…

Machine Learning · Computer Science 2023-05-29 Andrea Schioppa , Katja Filippova , Ivan Titov , Polina Zablotskaia

As medical devices become more complex, they routinely collect extensive and complicated data. While classical regressions typically examine the relationship between an outcome and a vector of predictors, it becomes imperative to identify…

Methodology · Statistics 2024-05-16 Huaqing Jin , Fei Jiang

In some inferential statistical methods, such as tests and confidence intervals, it is important to describe the stochastic behavior of statistical functionals, aside from their large sample properties. We study such behavior in terms of…

Statistics Theory · Mathematics 2022-10-25 Tommaso Lando , Idir Arab , Paulo Eduardo Oliveira

Statistical inference on the explained variation of an outcome by a set of covariates is of particular interest in practice. When the covariates are of moderate to high-dimension and the effects are not sparse, several approaches have been…

Methodology · Statistics 2022-01-24 Hua Yun Chen

The analysis of practical probabilistic models on the computer demands a convenient representation for the available knowledge and an efficient algorithm to perform inference. An appealing representation is the influence diagram, a network…

Artificial Intelligence · Computer Science 2013-04-15 Ross D. Shachter

The problem of inferring pair-wise and higher-order interactions in complex systems involving large numbers of interacting variables, from observational data, is fundamental to many fields. Known to the statistical physics community as the…

Methodology · Statistics 2021-01-01 Sjoerd Viktor Beentjes , Ava Khamseh

We focus on the problem estimating a monotone trend function under additive and dependent noise. New point-wise confidence interval estimators under both short- and long-range dependent errors are introduced and studied. These intervals are…

Statistics Theory · Mathematics 2016-02-23 Pramita Bagchi , Moulinath Banerjee , Stilian Stoev

Linear and nonlinear optical effect has been widely discussed in large quantity of materials using theoretical or experimental methods. Except linear optical conductivity, higher-order nonlinear responses are not studied fully. Starting…

Materials Science · Physics 2025-08-12 Maoyuan Wang , Jianhui Zhou , Yugui Yao

The main aim of this paper is to study the functional inequality \begin{equation*} \int_{[0,1]}f\bigl((1-t)x+ty\bigr)d\mu(t)\geq 0, \qquad x,y\in I \mbox{ with } x<y, \end{equation*} for a continuous unknown function $f:I\to{\mathbb R}$,…

Classical Analysis and ODEs · Mathematics 2025-03-28 Zsolt Páles , Tomasz Szostok

Influence functions approximate how removing a training example changes a quantity of interest, called the target function, such as a held-out loss. To estimate the influence of a group of examples, the standard practice is to sum the…

Machine Learning · Computer Science 2026-05-18 Jaeseung Heo , Kyeongheung Yun , Youngbin Choi , Sehyun Hwang , Jungseul Ok , Dongwoo Kim

Estimators based on influence functions (IFs) have been shown to be effective in many settings, especially when combined with machine learning techniques. By focusing on estimating a specific target of interest (e.g., the average effect of…

Methodology · Statistics 2019-10-29 Aaron Fisher , Edward H. Kennedy

Classical decision theory models behaviour in terms of utility maximisation where utilities represent rational preference relations over outcomes. However, empirical evidence and theoretical considerations suggest that we need to go beyond…

Computer Science and Game Theory · Computer Science 2015-06-04 Jules Hedges , Paulo Oliva , Evguenia Sprits , Viktor Winschel , Philipp Zahn

In experimental and observational data settings, researchers often have limited knowledge of the reasons for missing outcomes. To address this uncertainty, we propose bounds on causal effects for missing outcomes, accommodating the scenario…

Methodology · Statistics 2026-03-19 Max Rubinstein , Denis Agniel , Larry Han , Marcela Horvitz-Lennon , Sharon-Lise Normand

Influence functions are important for quantifying the impact of individual training data points on a model's predictions. Although extensive research has been conducted on influence functions in traditional machine learning models, their…

Computation and Language · Computer Science 2024-12-23 Zhe Li , Wei Zhao , Yige Li , Jun Sun