English
Related papers

Related papers: Scaling Up Influence Functions

200 papers

Data attribution seeks to trace model behavior back to the training examples that shaped it, enabling debugging, auditing, and data valuation at scale. Classical influence-function methods offer a principled foundation but remain…

Machine Learning · Computer Science 2025-11-26 Sibo Ma , Julian Nyarko

When trying to gain better visibility into a machine learning model in order to understand and mitigate the associated risks, a potentially valuable source of evidence is: which training examples most contribute to a given behavior?…

Classical influence functions face significant challenges when applied to deep neural networks, primarily due to non-invertible Hessians and high-dimensional parameter spaces. We propose the local Bayesian influence function (BIF), an…

Machine Learning · Computer Science 2026-03-03 Philipp Alexander Kreer , Wilson Wu , Maxwell Adam , Zach Furman , Jesse Hoogland

Model selection requires repeatedly evaluating models on a given dataset and measuring their relative performances. In modern applications of machine learning, the models being considered are increasingly more expensive to evaluate and the…

Machine Learning · Computer Science 2020-10-21 Anant Raj , Cameron Musco , Lester Mackey , Nicolo Fusi

This paper aims to provide a tutorial for upper level undergraduate and graduate students in statistics, biostatistics and epidemiology on deriving influence functions for non-parametric and semi-parametric models. The author will build on…

Statistics Theory · Mathematics 2019-03-12 Jonathan Levy

Influence functions approximate the effect of training samples in test-time predictions and have a wide variety of applications in machine learning interpretability and uncertainty estimation. A commonly-used (first-order) influence…

Machine Learning · Computer Science 2021-02-12 Samyadeep Basu , Philip Pope , Soheil Feizi

Machine learning systems such as large scale recommendation systems or natural language processing systems are usually trained on billions of training points and are associated with hundreds of billions or trillions of parameters. Improving…

Machine Learning · Computer Science 2023-05-26 Michael Kounavis , Ousmane Dia , Ilqar Ramazanli

As machine learning is increasingly deployed in the real world, it is paramount that we develop the tools necessary to analyze the decision-making of the models we train and deploy to end-users. Recently, researchers have shown that…

Machine Learning · Computer Science 2022-05-05 Andrew Silva , Rohit Chopra , Matthew Gombolay

Multi-stage training and knowledge transfer, from a large-scale pretraining task to various finetuning tasks, have revolutionized natural language processing and computer vision resulting in state-of-the-art performance improvements. In…

Machine Learning · Computer Science 2020-07-20 Hongge Chen , Si Si , Yang Li , Ciprian Chelba , Sanjiv Kumar , Duane Boning , Cho-Jui Hsieh

In this paper, we argue that iterative computation with diffusion models offers a powerful paradigm for not only generation but also visual perception tasks. We unify tasks such as depth estimation, optical flow, and amodal segmentation…

Computer Vision and Pattern Recognition · Computer Science 2024-11-19 Rahul Ravishankar , Zeeshan Patel , Jathushan Rajasegaran , Jitendra Malik

How does the training data affect a model's behavior? This is the question we seek to answer with data attribution. The leading practical approaches to data attribution are based on influence functions (IF). IFs utilize a first-order Taylor…

Machine Learning · Computer Science 2025-09-11 Ittai Rubinstein , Samuel B. Hopkins

Influence functions provide crucial insights into model training, but existing methods suffer from large computational costs and limited generalization. Particularly, recent works have proposed various metrics and algorithms to calculate…

Machine Learning · Computer Science 2025-10-31 Ishika Agarwal , Dilek Hakkani-Tür

Good models require good training data. For overparameterized deep models, the causal relationship between training data and model predictions is increasingly opaque and poorly understood. Influence analysis partially demystifies training's…

Machine Learning · Computer Science 2024-04-02 Zayd Hammoudeh , Daniel Lowd

Influence diagnosis is important since presence of influential observations could lead to distorted analysis and misleading interpretations. For high-dimensional data, it is particularly so, as the increased dimensionality and complexity…

Statistics Theory · Mathematics 2013-11-27 Junlong Zhao , Chenlei Leng , Lexin Li , Hansheng Wang

Influence functions are important for quantifying the impact of individual training data points on a model's predictions. Although extensive research has been conducted on influence functions in traditional machine learning models, their…

Computation and Language · Computer Science 2024-12-23 Zhe Li , Wei Zhao , Yige Li , Jun Sun

A critical step for reliable large language models (LLMs) use in healthcare is to attribute predictions to their training data, akin to a medical case study. This requires token-level precision: pinpointing not just which training examples…

Machine Learning · Computer Science 2026-05-14 Shixing Yu , Promit Ghosal , Kyra Gan

Data selection is a critical aspect of Reinforcement Learning with Verifiable Rewards (RLVR) for enhancing the reasoning capabilities of large language models (LLMs). Current data selection methods are largely heuristic-based, lacking…

Machine Learning · Computer Science 2026-04-16 Erle Zhu , Dazhi Jiang , Yuan Wang , Xujun Li , Jiale Cheng , Yuxian Gu , Yilin Niu , Aohan Zeng , Jie Tang , Minlie Huang , Hongning Wang

Scaling up language models has been empirically shown to improve performance on a wide range of downstream tasks. However, if we were to observe worse performance as a function of scale ("inverse scaling") on certain tasks, this would…

Computation and Language · Computer Science 2023-05-25 Jason Wei , Najoung Kim , Yi Tay , Quoc V. Le

Recently, influence functions present an apparatus for achieving explainability for deep neural models by quantifying the perturbation of individual train instances that might impact a test prediction. Our objectives in this paper are…

Computation and Language · Computer Science 2024-03-12 Somnath Banerjee , Maulindu Sarkar , Punyajoy Saha , Binny Mathew , Animesh Mukherjee

Influence functions efficiently estimate the effect of removing a single training data point on a model's learned parameters. While influence estimates align well with leave-one-out retraining for linear models, recent works have shown this…

Machine Learning · Computer Science 2022-09-13 Juhan Bae , Nathan Ng , Alston Lo , Marzyeh Ghassemi , Roger Grosse