English
Related papers

Related papers: Towards Explaining Distribution Shifts

200 papers

In this paper, we aim to forecast a future trajectory distribution of a moving agent in the real world, given the social scene images and historical trajectories. Yet, it is a challenging task because the ground-truth distribution is…

Computer Vision and Pattern Recognition · Computer Science 2022-04-01 Ke Guo , Wenxi Liu , Jia Pan

Use of machine learning to perform database operations, such as indexing, cardinality estimation, and sorting, is shown to provide substantial performance benefits. However, when datasets change and data distribution shifts, empirical…

Machine Learning · Computer Science 2024-11-12 Sepanta Zeighami , Cyrus Shahahbi

In this paper, we present results on improving out-of-domain weather prediction and uncertainty estimation as part of the \texttt{Shifts Challenge on Robustness and Uncertainty under Real-World Distributional Shift} challenge. We find that…

Machine Learning · Computer Science 2024-01-10 Sankalp Gilda , Neel Bhandari , Wendy Mak , Andrea Panizza

Visual representations underlie object recognition tasks, but they often contain both robust and non-robust features. Our main observation is that image classifiers may perform poorly on out-of-distribution samples because spurious…

Computer Vision and Pattern Recognition · Computer Science 2022-04-27 Chengzhi Mao , Kevin Xia , James Wang , Hao Wang , Junfeng Yang , Elias Bareinboim , Carl Vondrick

Distribution shifts remain a fundamental problem for the safe application of machine learning systems. If undetected, they may impact the real-world performance of such systems or will at least render original performance claims invalid. In…

Machine Learning · Computer Science 2023-03-10 Lisa M. Koch , Christian M. Schürch , Christian F. Baumgartner , Arthur Gretton , Philipp Berens

Transfer learning is essential when sufficient data comes from the source domain, with scarce labeled data from the target domain. We develop estimators that achieve minimax linear risk for linear regression problems under distribution…

Machine Learning · Computer Science 2021-06-24 Qi Lei , Wei Hu , Jason D. Lee

The dominating NLP paradigm of training a strong neural predictor to perform one task on a specific dataset has led to state-of-the-art performance in a variety of applications (eg. sentiment classification, span-prediction based question…

Computation and Language · Computer Science 2021-09-06 Paul Michel

Transmission matrices, mapping the propagation of light from one end of the tissue to the other, form an important mathematical tool in the analysis of tissue scattering and the design of wavefront shaping systems. To understand the…

Optics · Physics 2025-04-01 Anat Levin , Marina Alterman

Distribution shifts have long been regarded as troublesome external forces that a decision-maker should either counteract or conform to. An intriguing feedback phenomenon termed decision dependence arises when the deployed decision affects…

Optimization and Control · Mathematics 2025-03-11 Zhiyu He , Saverio Bolognani , Florian Dörfler , Michael Muehlebach

The field of performative prediction had its beginnings in 2020 with the seminal paper "Performative Prediction" by Perdomo et al., which established a novel machine learning setup where the deployment of a predictive model causes a…

Machine Learning · Statistics 2026-02-12 Thomas Kehrenberg , Javier Sanguino , Jose A. Lozano , Novi Quadrianto

Performative distribution shift captures the setting where the choice of which ML model is deployed changes the data distribution. For example, a bank which uses the number of open credit lines to determine a customer's risk of default on a…

Machine Learning · Computer Science 2021-02-17 Zachary Izzo , Lexing Ying , James Zou

A common task in computational text analyses is to quantify how two corpora differ according to a measurement like word frequency, sentiment, or information content. However, collapsing the texts' rich stories into a single number is often…

Optimal transport distances have found many applications in machine learning for their capacity to compare non-parametric probability distributions. Yet their algorithmic complexity generally prevents their direct use on large scale…

Machine Learning · Computer Science 2021-03-08 Kilian Fatras , Thibault Séjourné , Nicolas Courty , Rémi Flamary

Diffusion maps approximate the generator of Langevin dynamics from simulation data. They afford a means of identifying the slowly-evolving principal modes of high-dimensional molecular systems. When combined with a biasing mechanism,…

Data Analysis, Statistics and Probability · Physics 2020-07-01 Zofia Trstanova , Ben Leimkuhler , Tony Lelièvre

A common approach to mechanistic interpretability is to causally manipulate model representations via targeted interventions in order to understand what those representations encode. Here we ask whether such interventions create…

Machine Learning · Computer Science 2026-04-24 Satchel Grant , Simon Jerome Han , Alexa R. Tartaglini , Christopher Potts

There is a growing awareness of the harmful effects of distribution shift on the performance of deployed machine learning models. Consequently, there is a growing interest in detecting these shifts before associated costs have time to…

Machine Learning · Computer Science 2023-07-28 Oliver Cobb , Arnaud Van Looveren

Optimal transport has become part of the standard quantitative economics toolbox. It is the framework of choice to describe models of matching with transfers, but beyond that, it allows to: extend quantile regression; identify discrete…

General Economics · Economics 2021-07-13 Alfred Galichon

Recent work has shown that the performance of machine learning models can vary substantially when models are evaluated on data drawn from a distribution that is close to but different from the training distribution. As a result, predicting…

Machine Learning · Computer Science 2021-08-23 Devin Guillory , Vaishaal Shankar , Sayna Ebrahimi , Trevor Darrell , Ludwig Schmidt

To remedy the drawbacks of full-mass or fixed-mass constraints in classical optimal transport, we propose adaptive optimal transport which is distinctive from the classical optimal transport in its ability of adaptive-mass preserving. It…

Machine Learning · Computer Science 2025-03-10 Pei Yang , Qi Tan , Guihua Wen

The ability to detect and adapt to changes in data distributions is crucial to maintain the accuracy and reliability of machine learning models. Detection is generally approached by observing the drift of model performance from a global…

Machine Learning · Computer Science 2025-05-22 Flavio Giobergia , Eliana Pastor , Luca de Alfaro , Elena Baralis