中文
相关论文

相关论文: Interpretable Distribution Shift Detection using O…

200 篇论文

Optimal transport (OT) based data analysis is often faced with the issue that the underlying cost function is (partially) unknown. This paper is concerned with the derivation of distributional limits for the empirical OT value when the cost…

Data-carving methods perform selective inference by conditioning the distribution of data on the observed selection event. However, existing data-carving approaches typically require an analytically tractable characterization of the…

统计方法学 · 统计学 2025-06-03 Sifan Liu , Snigdha Panigrahi

We introduce the proximal optimal transport divergence, a novel discrepancy measure that interpolates between information divergences and optimal transport distances via an infimal convolution formulation. This divergence provides a…

For probability measures on countable spaces we derive distributional limits for empirical entropic optimal transport quantities. More precisely, we show that the empirical optimal transport plan weakly converges to a centered Gaussian…

概率论 · 数学 2022-12-27 Shayan Hundrieser , Marcel Klatt , Axel Munk

The performance of learning models often deteriorates when deployed in out-of-sample environments. To ensure reliable deployment, we propose a stability evaluation criterion based on distributional perturbations. Conceptually, our stability…

机器学习 · 统计学 2024-05-07 Jose Blanchet , Peng Cui , Jiajin Li , Jiashuo Liu

We propose a novel approach based on optimal transport (OT) for tackling the problem of highly mixed data in blind hyperspectral unmixing. Our method constrains the distribution of the estimated abundance matrix to resemble a targeted…

图像与视频处理 · 电气工程与系统科学 2025-09-26 D. Doutsas , B. Figliuzzi

Data in the real world often has an evolving distribution. Thus, machine learning models trained on such data get outdated over time. This phenomenon is called model drift. Knowledge of this drift serves two purposes: (i) Retain an accurate…

机器学习 · 计算机科学 2025-03-11 Pranoy Panda , Kancheti Sai Srinivas , Vineeth N Balasubramanian , Gaurav Sinha

Detecting dynamic patterns of task-specific responses shared across heterogeneous datasets is an essential and challenging problem in many scientific applications in medical science and neuroscience. In our motivating example of rodent…

神经元与认知 · 定量生物学 2024-07-02 Yubai Yuan , Babak Shahbaba , Norbert Fortin , Keiland Cooper , Qing Nie , Annie Qu

A wide variety of model explanation approaches have been proposed in recent years, all guided by very different rationales and heuristics. In this paper, we take a new route and cast interpretability as a statistical inference problem. We…

机器学习 · 计算机科学 2024-01-01 Hugo Henri Joseph Senetaire , Damien Garreau , Jes Frellsen , Pierre-Alexandre Mattei

Imbalanced data pose challenges for deep learning based classification models. One of the most widely-used approaches for tackling imbalanced data is re-weighting, where training samples are associated with different weights in the loss…

机器学习 · 计算机科学 2022-08-08 Dandan Guo , Zhuo Li , Meixi Zheng , He Zhao , Mingyuan Zhou , Hongyuan Zha

Finding a transformation between two unknown probability distributions from finite samples is crucial for modeling complex data distributions and performing tasks such as sample generation, domain adaptation and statistical inference. One…

机器学习 · 计算机科学 2024-07-11 Zhe Xiong , Qiaoqiao Ding , Xiaoqun Zhang

This work develops a methodology for creating a data-driven digital twin from a library of physics-based models representing various asset states. The digital twin is updated using interpretable machine learning. Specifically, we use…

计算工程、金融与科学 · 计算机科学 2020-04-30 Michael G. Kapteyn , Karen E. Willcox

Semantically coherent out-of-distribution (SCOOD) detection aims to discern outliers from the intended data distribution with access to unlabeled extra set. The coexistence of in-distribution and out-of-distribution samples will exacerbate…

计算机视觉与模式识别 · 计算机科学 2023-03-22 Fan Lu , Kai Zhu , Wei Zhai , Kecheng Zheng , Yang Cao

Distribution shift is a key challenge for predictive models in practice, creating the need to identify potentially harmful shifts in advance of deployment. Existing work typically defines these worst-case shifts as ones that most degrade…

机器学习 · 计算机科学 2024-07-08 Kevin Ren , Yewon Byun , Bryan Wilder

Optimal transport (OT) is a central framework for modeling distribution shifts. Because OT compares distributions directly in input space, a well-designed ground metric between observations is essential to ensure that the optimizer does not…

机器学习 · 计算机科学 2026-05-07 Philip Naumann , Jacob Kauffmann , Klaus-Robert Müller , Grégoire Montavon

We study stochastic dynamical systems in settings where only partial statistical information about the noise is available, e.g., in the form of a limited number of noise realizations. Such systems are particularly challenging to analyze and…

最优化与控制 · 数学 2023-04-06 Liviu Aolaritei , Nicolas Lanzetti , Florian Dörfler

This work presents a new classifier that is specifically designed to be fully interpretable. This technique determines the probability of a class outcome, based directly on probability assignments measured from the training data. The…

机器学习 · 统计学 2017-10-31 Sapan Agarwal , Corey M. Hudson

The ability to detect and adapt to changes in data distributions is crucial to maintain the accuracy and reliability of machine learning models. Detection is generally approached by observing the drift of model performance from a global…

机器学习 · 计算机科学 2025-05-22 Flavio Giobergia , Eliana Pastor , Luca de Alfaro , Elena Baralis

Network traffic classification that is widely applicable and highly accurate is valuable for many network security and management tasks. A flexible and easily configurable classification framework is ideal, as it can be customized for use…

机器学习 · 计算机科学 2025-02-11 Jiahui Chen , Joe Breen , Jeff M. Phillips , Jacobus Van der Merwe

The term dataset shift refers to the situation where the data used to train a machine learning model is different from where the model operates. While several types of shifts naturally occur, existing shift detectors are usually designed to…

机器学习 · 计算机科学 2021-06-29 Simona Maggio , Léo Dreyfus-Schmidt