English
Related papers

Related papers: Supervising Feature Influence

200 papers

Performative learning addresses the increasingly pervasive situations in which algorithmic decisions may induce changes in the data distribution as a consequence of their public deployment. We propose a novel view in which these…

Machine Learning · Computer Science 2024-11-05 Edwige Cyffers , Muni Sreenivas Pydi , Jamal Atif , Olivier Cappé

A predictive model makes outcome predictions based on some given features, i.e., it estimates the conditional probability of the outcome given a feature vector. In general, a predictive model cannot estimate the causal effect of a feature…

Machine Learning · Computer Science 2023-04-11 Jiuyong Li , Lin Liu , Ziqi Xu , Ha Xuan Tran , Thuc Duy Le , Jixue Liu

Following the wide-spread adoption of machine learning models in real-world applications, the phenomenon of performativity, i.e. model-dependent shifts in the test distribution, becomes increasingly prevalent. Unfortunately, since models…

Machine Learning · Statistics 2026-01-21 Ivan Kirev , Lyuben Baltadzhiev , Nikola Konstantinov

Continual learning aims to learn on non-stationary data streams without catastrophically forgetting previous knowledge. Prevalent replay-based methods address this challenge by rehearsing on a small buffer holding the seen data, for which a…

Machine Learning · Computer Science 2023-04-21 Zhicheng Sun , Yadong Mu , Gang Hua

To draw scientifically meaningful conclusions and build reliable models of quantitative phenomena, cause and effect must be taken into consideration (either implicitly or explicitly). This is particularly challenging when the measurements…

Machine Learning · Computer Science 2020-12-11 Max A. Little , Reham Badawy

To address the problem of NLP classifiers learning spurious correlations between training features and target labels, a common approach is to make the model's predictions invariant to these features. However, this can be counter-productive…

Machine Learning · Computer Science 2023-06-22 Parikshit Bansal , Amit Sharma

We consider the problem of function estimation in the case where the data distribution may shift between training and test time, and additional information about it may be available at test time. This relates to popular scenarios such as…

Machine Learning · Statistics 2013-06-05 Bernhard Schölkopf , Dominik Janzing , Jonas Peters , Kun Zhang

Several instance-based explainability methods for finding influential training examples for test-time decisions have been proposed recently, including Influence Functions, TraceIn, Representer Point Selection, Grad-Dot, and Grad-Cos.…

Machine Learning · Computer Science 2021-11-09 Karthikeyan K , Anders Søgaard

Covariate shift, a widely used assumption in tackling {\it distributional shift} (when training and test distributions differ), focuses on scenarios where the distribution of the labels conditioned on the feature vector is the same, but the…

Machine Learning · Computer Science 2025-02-24 Deeksha Adil , Jarosław Błasiok

We pose causal inference as the problem of learning to classify probability distributions. In particular, we assume access to a collection $\{(S_i,l_i)\}_{i=1}^n$, where each $S_i$ is a sample drawn from the probability distribution of $X_i…

Machine Learning · Statistics 2015-05-20 David Lopez-Paz , Krikamol Muandet , Bernhard Schölkopf , Ilya Tolstikhin

Behavioral cloning reduces policy learning to supervised learning by training a discriminative model to predict expert actions given observations. Such discriminative models are non-causal: the training procedure is unaware of the causal…

Machine Learning · Computer Science 2019-11-05 Pim de Haan , Dinesh Jayaraman , Sergey Levine

The convenient access to copious multi-faceted data has encouraged machine learning researchers to reconsider correlation-based learning and embrace the opportunity of causality-based learning, i.e., causal machine learning (causal…

Machine Learning · Computer Science 2022-02-08 Lu Cheng , Ruocheng Guo , Raha Moraffah , Paras Sheth , K. Selcuk Candan , Huan Liu

We study the problem of deriving policies, or rules, that when enacted on a complex system, cause a desired outcome. Absent the ability to perform controlled experiments, such rules have to be inferred from past observations of the system's…

Machine Learning · Computer Science 2020-09-09 Kailash Budhathoki , Mario Boley , Jilles Vreeken

Causal inference is central to many areas of artificial intelligence, including complex reasoning, planning, knowledge-base construction, robotics, explanation, and fairness. An active community of researchers develops and enhances…

Artificial Intelligence · Computer Science 2019-11-05 Amanda Gentzel , Dan Garant , David Jensen

Machine Learning explainability techniques have been proposed as a means of `explaining' or interrogating a model in order to understand why a particular decision or prediction has been made. Such an ability is especially important at a…

Machine Learning · Statistics 2022-02-28 Matthew J. Vowels

Classical supervised learning produces unreliable models when training and target distributions differ, with most existing solutions requiring samples from the target domain. We propose a proactive approach which learns a relationship in…

Machine Learning · Statistics 2019-03-01 Adarsh Subbaswamy , Peter Schulam , Suchi Saria

One of the common ways children learn is by mimicking adults. Imitation learning focuses on learning policies with suitable performance from demonstrations generated by an expert, with an unspecified performance measure, and unobserved…

Machine Learning · Computer Science 2022-08-15 Junzhe Zhang , Daniel Kumor , Elias Bareinboim

A dataset has been classified by some unknown classifier into two types of points. What were the most important factors in determining the classification outcome? In this work, we employ an axiomatic approach in order to uniquely…

Computer Science and Game Theory · Computer Science 2015-05-04 Amit Datta , Anupam Datta , Ariel D. Procaccia , Yair Zick

We propose a counterfactual approach to train ``causality-aware" predictive models that are able to leverage causal information in static anticausal machine learning tasks (i.e., prediction tasks where the outcome influences the features).…

Applications · Statistics 2020-12-01 Elias Chaibub Neto

As data-driven methods are deployed in real-world settings, the processes that generate the observed data will often react to the decisions of the learner. For example, a data source may have some incentive for the algorithm to provide a…

Machine Learning · Computer Science 2023-04-26 Roy Dong , Heling Zhang , Lillian J. Ratliff