English
Related papers

Related papers: Interpretable Distribution Shift Detection using O…

200 papers

Optimal transport (OT) based data analysis is often faced with the issue that the underlying cost function is (partially) unknown. This paper is concerned with the derivation of distributional limits for the empirical OT value when the cost…

Statistics Theory · Mathematics 2023-01-05 Shayan Hundrieser , Gilles Mordant , Christoph Alexander Weitkamp , Axel Munk

Data-carving methods perform selective inference by conditioning the distribution of data on the observed selection event. However, existing data-carving approaches typically require an analytically tractable characterization of the…

Methodology · Statistics 2025-06-03 Sifan Liu , Snigdha Panigrahi

We introduce the proximal optimal transport divergence, a novel discrepancy measure that interpolates between information divergences and optimal transport distances via an infimal convolution formulation. This divergence provides a…

Optimization and Control · Mathematics 2025-08-11 Ricardo Baptista , Panagiota Birmpa , Markos A. Katsoulakis , Luc Rey-Bellet , Benjamin J. Zhang

For probability measures on countable spaces we derive distributional limits for empirical entropic optimal transport quantities. More precisely, we show that the empirical optimal transport plan weakly converges to a centered Gaussian…

Probability · Mathematics 2022-12-27 Shayan Hundrieser , Marcel Klatt , Axel Munk

The performance of learning models often deteriorates when deployed in out-of-sample environments. To ensure reliable deployment, we propose a stability evaluation criterion based on distributional perturbations. Conceptually, our stability…

Machine Learning · Statistics 2024-05-07 Jose Blanchet , Peng Cui , Jiajin Li , Jiashuo Liu

We propose a novel approach based on optimal transport (OT) for tackling the problem of highly mixed data in blind hyperspectral unmixing. Our method constrains the distribution of the estimated abundance matrix to resemble a targeted…

Image and Video Processing · Electrical Eng. & Systems 2025-09-26 D. Doutsas , B. Figliuzzi

Data in the real world often has an evolving distribution. Thus, machine learning models trained on such data get outdated over time. This phenomenon is called model drift. Knowledge of this drift serves two purposes: (i) Retain an accurate…

Machine Learning · Computer Science 2025-03-11 Pranoy Panda , Kancheti Sai Srinivas , Vineeth N Balasubramanian , Gaurav Sinha

Detecting dynamic patterns of task-specific responses shared across heterogeneous datasets is an essential and challenging problem in many scientific applications in medical science and neuroscience. In our motivating example of rodent…

Neurons and Cognition · Quantitative Biology 2024-07-02 Yubai Yuan , Babak Shahbaba , Norbert Fortin , Keiland Cooper , Qing Nie , Annie Qu

A wide variety of model explanation approaches have been proposed in recent years, all guided by very different rationales and heuristics. In this paper, we take a new route and cast interpretability as a statistical inference problem. We…

Machine Learning · Computer Science 2024-01-01 Hugo Henri Joseph Senetaire , Damien Garreau , Jes Frellsen , Pierre-Alexandre Mattei

Imbalanced data pose challenges for deep learning based classification models. One of the most widely-used approaches for tackling imbalanced data is re-weighting, where training samples are associated with different weights in the loss…

Machine Learning · Computer Science 2022-08-08 Dandan Guo , Zhuo Li , Meixi Zheng , He Zhao , Mingyuan Zhou , Hongyuan Zha

Finding a transformation between two unknown probability distributions from finite samples is crucial for modeling complex data distributions and performing tasks such as sample generation, domain adaptation and statistical inference. One…

Machine Learning · Computer Science 2024-07-11 Zhe Xiong , Qiaoqiao Ding , Xiaoqun Zhang

This work develops a methodology for creating a data-driven digital twin from a library of physics-based models representing various asset states. The digital twin is updated using interpretable machine learning. Specifically, we use…

Computational Engineering, Finance, and Science · Computer Science 2020-04-30 Michael G. Kapteyn , Karen E. Willcox

Semantically coherent out-of-distribution (SCOOD) detection aims to discern outliers from the intended data distribution with access to unlabeled extra set. The coexistence of in-distribution and out-of-distribution samples will exacerbate…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Fan Lu , Kai Zhu , Wei Zhai , Kecheng Zheng , Yang Cao

Distribution shift is a key challenge for predictive models in practice, creating the need to identify potentially harmful shifts in advance of deployment. Existing work typically defines these worst-case shifts as ones that most degrade…

Machine Learning · Computer Science 2024-07-08 Kevin Ren , Yewon Byun , Bryan Wilder

Optimal transport (OT) is a central framework for modeling distribution shifts. Because OT compares distributions directly in input space, a well-designed ground metric between observations is essential to ensure that the optimizer does not…

Machine Learning · Computer Science 2026-05-07 Philip Naumann , Jacob Kauffmann , Klaus-Robert Müller , Grégoire Montavon

We study stochastic dynamical systems in settings where only partial statistical information about the noise is available, e.g., in the form of a limited number of noise realizations. Such systems are particularly challenging to analyze and…

Optimization and Control · Mathematics 2023-04-06 Liviu Aolaritei , Nicolas Lanzetti , Florian Dörfler

This work presents a new classifier that is specifically designed to be fully interpretable. This technique determines the probability of a class outcome, based directly on probability assignments measured from the training data. The…

Machine Learning · Statistics 2017-10-31 Sapan Agarwal , Corey M. Hudson

The ability to detect and adapt to changes in data distributions is crucial to maintain the accuracy and reliability of machine learning models. Detection is generally approached by observing the drift of model performance from a global…

Machine Learning · Computer Science 2025-05-22 Flavio Giobergia , Eliana Pastor , Luca de Alfaro , Elena Baralis

Network traffic classification that is widely applicable and highly accurate is valuable for many network security and management tasks. A flexible and easily configurable classification framework is ideal, as it can be customized for use…

Machine Learning · Computer Science 2025-02-11 Jiahui Chen , Joe Breen , Jeff M. Phillips , Jacobus Van der Merwe

The term dataset shift refers to the situation where the data used to train a machine learning model is different from where the model operates. While several types of shifts naturally occur, existing shift detectors are usually designed to…

Machine Learning · Computer Science 2021-06-29 Simona Maggio , Léo Dreyfus-Schmidt