English
Related papers

Related papers: Beyond Top-Class Agreement: Using Divergences to F…

200 papers

This paper investigates the accuracy of generative models and the impact of knowledge transfer on their generation precision. Specifically, we examine a generative model for a target task, fine-tuned using a pre-trained model from a source…

Machine Learning · Statistics 2025-06-03 Xinyu Tian , Xiaotong Shen

We consider linear models with scalar responses and covariates from a separable Hilbert space. The aim is to detect change points in the error distribution, based on sequential residual empirical distribution functions. Expansions for those…

Statistics Theory · Mathematics 2024-11-08 Natalie Neumeyer , Leonie Selk

The scores of distance-based outlier detection methods are difficult to interpret, making it challenging to determine a cut-off threshold between normal and outlier data points without additional context. We describe a generic…

Machine Learning · Computer Science 2023-07-20 David Muhr , Michael Affenzeller , Josef Küng

Hypothesis testing in high dimensional data is a notoriously difficult problem without direct access to competing models' likelihood functions. This paper argues that statistical divergences can be used to quantify the difference between…

Data Analysis, Statistics and Probability · Physics 2024-08-02 Jeremy J. H. Wilkinson , Christopher G. Lester

In selective classification (SC), a classifier abstains from making predictions that are likely to be wrong to avoid excessive errors. To deploy imperfect classifiers -- either due to intrinsic statistical noise of data or for robustness…

Machine Learning · Computer Science 2024-11-28 Hengyue Liang , Le Peng , Ju Sun

Learning to sample from intractable distributions over discrete sets without relying on corresponding training data is a central problem in a wide range of fields, including Combinatorial Optimization. Currently, popular deep learning-based…

Machine Learning · Computer Science 2025-08-25 Sebastian Sanokowski , Sepp Hochreiter , Sebastian Lehner

Message identification (M-I) divergence is an important measure of the information distance between probability distributions, similar to Kullback-Leibler (K-L) and Renyi divergence. In fact, M-I divergence with a variable parameter can…

Information Theory · Computer Science 2024-04-08 Rui She , Shanyun Liu , Pingyi Fan

We consider a distributed learning setup where a network of agents sequentially access realizations of a set of random variables with unknown distributions. The network objective is to find a parametrized distribution that best describes…

Optimization and Control · Mathematics 2016-05-10 Angelia Nedić , Alex Olshevsky , César Uribe

Estimating the Kullback-Leibler (KL) divergence between two distributions given samples from them is well-studied in machine learning and information theory. Motivated by considerations of multi-group fairness, we seek KL divergence…

Machine Learning · Computer Science 2022-03-01 Parikshit Gopalan , Nina Narodytska , Omer Reingold , Vatsal Sharan , Udi Wieder

To facilitate effective decision-making, precipitation datasets should include uncertainty estimates. Quantile regression with machine learning has been proposed for issuing such estimates. Distributional regression offers distinct…

Machine Learning · Computer Science 2025-01-07 Georgia Papacharalampous , Hristos Tyralis , Nikolaos Doulamis , Anastasios Doulamis

The performance of machine learning classification algorithms are evaluated by estimating metrics, often from the confusion matrix, using training data and cross-validation. However, these do not prove that the best possible performance has…

Machine Learning · Statistics 2024-03-05 L. Crow , S. J. Watts

Knowledge distillation is widely used to improve generalization in practice, yet its theoretical understanding remains elusive. In the standard distillation setting, a teacher model provides soft predictions to guide the training of a…

Information Theory · Computer Science 2026-05-18 Bingying Li , Haiyun He

The predictability of errors in deterministic temperature forecasts is investigated. More precisely, the aim is to issue warnings whenever the differences between forecast and verification exceed a given threshold. The warnings are…

Atmospheric and Oceanic Physics · Physics 2011-12-08 S. Hallerberg , J. Bröcker , H. Kantz , L. A. Smith

When using complex Bayesian models to combine information, the checking for consistency of the information being combined is good statistical practice. Here a new method is developed for detecting prior-data conflicts in Bayesian models…

Methodology · Statistics 2016-11-29 David J. Nott , Xueou Wang , Michael Evans , Berthold-Georg Englert

Estimating the uncertainty in deep neural network predictions is crucial for many real-world applications. A common approach to model uncertainty is to choose a parametric distribution and fit the data to it using maximum likelihood…

Machine Learning · Computer Science 2022-11-28 Ali Harakeh , Jordan Hu , Naiqing Guan , Steven L. Waslander , Liam Paull

Learning from an imbalanced dataset is a tricky proposition. Because these datasets are biased towards one class, most existing classifiers tend not to perform well on minority class examples. Conventional classifiers usually aim to…

Machine Learning · Computer Science 2022-07-18 Tanujit Chakraborty , Ashis Kumar Chakraborty

The use of neural networks has been very successful in a wide variety of applications. However, it has recently been observed that it is difficult to generalize the performance of neural networks under the condition of distributional shift.…

Computational Finance · Quantitative Finance 2022-09-20 Dangxing Chen

Recently, continual learning has received a lot of attention. One of the significant problems is the occurrence of \emph{concept drift}, which consists of changing probabilistic characteristics of the incoming data. In the case of the…

Machine Learning · Computer Science 2022-10-11 Sebastián Basterrech , Michal Woźniak

In this paper, we present results on improving out-of-domain weather prediction and uncertainty estimation as part of the \texttt{Shifts Challenge on Robustness and Uncertainty under Real-World Distributional Shift} challenge. We find that…

Machine Learning · Computer Science 2024-01-10 Sankalp Gilda , Neel Bhandari , Wendy Mak , Andrea Panizza

Recently, a series of papers proposed deep learning-based approaches to sample from target distributions using controlled diffusion processes, being trained only on the unnormalized target densities without access to samples. Building on…

Machine Learning · Computer Science 2024-05-24 Lorenz Richter , Julius Berner