English
Related papers

Related papers: Interpretable Distribution Shift Detection using O…

200 papers

Detecting Out-of-Distribution (OOD) inputs is crucial for improving the reliability of deep neural networks in the real-world deployment. In this paper, inspired by the inherent distribution shift between ID and OOD data, we propose a novel…

Computer Vision and Pattern Recognition · Computer Science 2024-10-11 Ao Ke , Wenlong Chen , Chuanwen Feng , Yukun Cao , Xike Xie , S. Kevin Zhou , Lei Feng

The theory of optimal transportation has developed into a powerful and elegant framework for comparing probability distributions, with wide-ranging applications in all areas of science. The fundamental idea of analyzing probabilities by…

Methodology · Statistics 2025-03-14 Florian F Gunsilius

An adaptive, adversarial methodology is developed for the optimal transport problem between two distributions $\mu$ and $\nu$, known only through a finite set of independent samples $(x_i)_{i=1..N}$ and $(y_j)_{j=1..M}$. The methodology…

Optimization and Control · Mathematics 2019-02-20 Montacer Essid , Debra Laefer , Esteban G. Tabak

We give a method for proactively identifying small, plausible shifts in distribution which lead to large differences in model performance. These shifts are defined via parametric changes in the causal mechanisms of observed variables, where…

Machine Learning · Computer Science 2023-01-18 Nikolaj Thams , Michael Oberst , David Sontag

To remedy the drawbacks of full-mass or fixed-mass constraints in classical optimal transport, we propose adaptive optimal transport which is distinctive from the classical optimal transport in its ability of adaptive-mass preserving. It…

Machine Learning · Computer Science 2025-03-10 Pei Yang , Qi Tan , Guihua Wen

Machine learning systems operate under the assumption that training and test data are sampled from a fixed probability distribution. However, this assumptions is rarely verified in practice, as the conditions upon which data was acquired…

Machine Learning · Computer Science 2025-07-09 Eduardo Fernandes Montesuma , Fred Maurice Ngolè Mboula , Antoine Souloumiac

The performance of machine learning models relies heavily on the quality of input data, yet real-world applications often face significant data-related challenges. A common issue arises when curating training data or deploying models: two…

Machine Learning · Computer Science 2025-09-24 Varun Babbar , Zhicheng Guo , Cynthia Rudin

This paper introduces a novel framework for distributed two-sample testing using the Integrated Transportation Distance (ITD), an extension of the Optimal Transport distance. The approach addresses the challenges of detecting distributional…

Methodology · Statistics 2025-06-23 Zhengqi Lin , Yan Chen

Detecting weak, systematic distribution shifts and quantitatively modeling individual, heterogeneous responses to policies or incentives have found increasing empirical applications in social and economic sciences. Given two probability…

Statistics Theory · Mathematics 2024-03-29 YoonHaeng Hur , Tengyuan Liang

This note continues study of exchangeability martingales, i.e., processes that are martingales under any exchangeable distribution for the observations. Such processes can be used for detecting violations of the IID assumption, which is…

Machine Learning · Computer Science 2020-12-29 Vladimir Vovk

Recently, Optimal Transport has been proposed as a probabilistic framework in Machine Learning for comparing and manipulating probability distributions. This is rooted in its rich history and theory, and has offered new solutions to…

Machine Learning · Computer Science 2024-08-22 Eduardo Fernandes Montesuma , Fred Ngolè Mboula , Antoine Souloumiac

Missing data is a crucial issue when applying machine learning algorithms to real-world datasets. Starting from the simple assumption that two batches extracted randomly from the same dataset should share the same distribution, we leverage…

Machine Learning · Statistics 2020-07-02 Boris Muzellec , Julie Josse , Claire Boyer , Marco Cuturi

Automated machine learning has been widely researched and adopted in the field of supervised classification and regression, but progress in unsupervised settings has been limited. We propose a novel approach to automate outlier detection…

Machine Learning · Computer Science 2024-09-10 Prabhant Singh , Joaquin Vanschoren

Optimal transport (OT) provides effective tools for comparing and mapping probability measures. We propose to leverage the flexibility of neural networks to learn an approximate optimal transport map. More precisely, we present a new and…

Machine Learning · Computer Science 2022-07-06 Florentin Coeurdoux , Nicolas Dobigeon , Pierre Chainais

While previous distribution shift detection approaches can identify if a shift has occurred, these approaches cannot localize which specific features have caused a distribution shift -- a critical step in diagnosing or fixing any underlying…

Machine Learning · Computer Science 2021-07-16 Sean Kulinski , Saurabh Bagchi , David I. Inouye

Transport-based techniques for signal and data analysis have received increased attention recently. Given their abilities to provide accurate generative models for signal intensities and other data distributions, they have been used in a…

Computer Vision and Pattern Recognition · Computer Science 2016-09-23 Soheil Kolouri , Serim Park , Matthew Thorpe , Dejan Slepčev , Gustavo K. Rohde

Optimal transport is a powerful framework for the efficient allocation of resources between sources and targets. However, traditional models often struggle to scale effectively in the presence of large and heterogeneous populations. In this…

Artificial Intelligence · Computer Science 2024-11-13 Navpreet Kaur , Juntao Chen , Yingdong Lu

Optimal transport has become part of the standard quantitative economics toolbox. It is the framework of choice to describe models of matching with transfers, but beyond that, it allows to: extend quantile regression; identify discrete…

General Economics · Economics 2021-07-13 Alfred Galichon

We develop methods for forming prediction sets in an online setting where the data generating distribution is allowed to vary over time in an unknown fashion. Our framework builds on ideas from conformal inference to provide a general…

Methodology · Statistics 2021-12-10 Isaac Gibbs , Emmanuel Candès

This paper proposes an interpretable non-model sharing collaborative data analysis method as one of the federated learning systems, which is an emerging technology to analyze distributed data. Analyzing distributed data is essential in many…

Machine Learning · Computer Science 2020-11-10 Akira Imakura , Hiroaki Inaba , Yukihiko Okada , Tetsuya Sakurai