English
Related papers

Related papers: Towards Explaining Distribution Shifts

200 papers

The scores of distance-based outlier detection methods are difficult to interpret, making it challenging to determine a cut-off threshold between normal and outlier data points without additional context. We describe a generic…

Machine Learning · Computer Science 2023-07-20 David Muhr , Michael Affenzeller , Josef Küng

We describe a formal approach based on graphical causal models to identify the "root causes" of the change in the probability distribution of variables. After factorizing the joint distribution into conditional distributions of each…

Methodology · Statistics 2021-05-25 Kailash Budhathoki , Dominik Janzing , Patrick Bloebaum , Hoiyi Ng

Stochastic optimization problems often involve data distributions that change in reaction to the decision variables. This is the case for example when members of the population respond to a deployed classifier by manipulating their features…

Optimization and Control · Mathematics 2020-12-15 Dmitriy Drusvyatskiy , Lin Xiao

High-dimensional representations for words, text, images, knowledge graphs and other structured data are commonly used in different paradigms of machine learning and data mining. These representations have different degrees of…

Computation and Language · Computer Science 2020-11-26 Sunipa Dev

In this review, we examine the problem of designing interpretable and explainable machine learning models. Interpretability and explainability lie at the core of many machine learning and statistical applications in medicine, economics,…

Machine Learning · Computer Science 2023-03-02 Ričards Marcinkevičs , Julia E. Vogt

We propose a novel framework for analyzing the dynamics of distribution shift in real-world systems that captures the feedback loop between learning algorithms and the distributions on which they are deployed. Prior work largely models…

Machine Learning · Computer Science 2023-10-31 Lauren Conger , Franca Hoffmann , Eric Mazumdar , Lillian Ratliff

Data-carving methods perform selective inference by conditioning the distribution of data on the observed selection event. However, existing data-carving approaches typically require an analytically tractable characterization of the…

Methodology · Statistics 2025-06-03 Sifan Liu , Snigdha Panigrahi

Traffic signal control algorithms are vulnerable to distribution shift, where performance degrades under traffic conditions that differ from those seen during design or training. This paper introduces a principled approach to quantify…

Systems and Control · Electrical Eng. & Systems 2025-11-19 Federico Taschin , Ozan K. Tonguz

In this paper, we present an approach for evaluating attribution maps, which play a central role in interpreting the predictions of convolutional neural networks (CNNs). We show that the widely used insertion/deletion metrics are…

Computer Vision and Pattern Recognition · Computer Science 2024-11-25 Lars Nieradzik , Henrike Stephani , Janis Keuper

Precise and reliable climate projections are required for climate adaptation and mitigation, but Earth system models still exhibit great uncertainties. Several approaches have been developed to reduce the spread of climate projections and…

The Right to Explanation is an important regulatory principle that allows individuals to request actionable explanations for algorithmic decisions. However, several technical challenges arise when providing such actionable explanations in…

Machine Learning · Computer Science 2023-06-13 Anna P. Meyer , Dan Ley , Suraj Srinivas , Himabindu Lakkaraju

Modeling non-stationary data is a challenging problem in the field of continual learning, and data distribution shifts may result in negative consequences on the performance of a machine learning model. Classic learning tools are often…

Machine Learning · Computer Science 2024-10-23 Sebastián Basterrech , Line Clemmensen , Gerardo Rubino

Ensuring generalization to unseen environments remains a challenge. Domain shift can lead to substantially degraded performance unless shifts are well-exercised within the available training environments. We introduce a simple robust…

Machine Learning · Computer Science 2021-10-20 Yilun Xu , Tommi Jaakkola

Rectified flow (Liu et al., 2022; Liu, 2022; Wu et al., 2023) is a method for defining a transport map between two distributions, and enjoys popularity in machine learning, although theoretical results supporting the validity of these…

Statistics Theory · Mathematics 2025-12-11 Gonzalo Mena , Arun Kumar Kuchibhotla , Larry Wasserman

Recent studies on interpretability of attention distributions have led to notions of faithful and plausible explanations for a model's predictions. Attention distributions can be considered a faithful explanation if a higher attention…

Computation and Language · Computer Science 2020-04-30 Akash Kumar Mohankumar , Preksha Nema , Sharan Narasimhan , Mitesh M. Khapra , Balaji Vasan Srinivasan , Balaraman Ravindran

We study a setting where the goal is to learn a target function f(x) with respect to a target distribution D(x), but training is done on i.i.d. samples from a different training distribution D'(x), labeled by the true target f(x). Such a…

Machine Learning · Computer Science 2026-02-13 Marko Medvedev , Idan Attias , Elisabetta Cornacchia , Theodor Misiakiewicz , Gal Vardi , Nathan Srebro

Image attribution analysis seeks to highlight the feature representations learned by visual models such that the highlighted feature maps can reflect the pixel-wise importance of inputs. Gradient integration is a building block in the…

Computer Vision and Pattern Recognition · Computer Science 2025-06-26 Róisín Luo , James McDermott , Colm O'Riordan

Robustness to distribution shifts is critical for deploying machine learning models in the real world. Despite this necessity, there has been little work in defining the underlying mechanisms that cause these shifts and evaluating the…

Many machine learning models appear to deploy effortlessly under distribution shift, and perform well on a target distribution that is considerably different from the training distribution. Yet, learning theory of distribution shift bounds…

Machine Learning · Computer Science 2024-05-30 Robi Bhattacharjee , Nick Rittler , Kamalika Chaudhuri

We introduce the proximal optimal transport divergence, a novel discrepancy measure that interpolates between information divergences and optimal transport distances via an infimal convolution formulation. This divergence provides a…

Optimization and Control · Mathematics 2025-08-11 Ricardo Baptista , Panagiota Birmpa , Markos A. Katsoulakis , Luc Rey-Bellet , Benjamin J. Zhang