English
Related papers

Related papers: An Interpretable Evaluation of Entropy-based Novel…

200 papers

Conformal prediction (CP) provides model-agnostic uncertainty quantification with guaranteed coverage, but conventional methods often produce overly conservative uncertainty sets, especially in multi-dimensional settings. This limitation…

Machine Learning · Computer Science 2025-02-12 Minxing Zheng , Shixiang Zhu

We approach multivariate mode estimation through Gibbs distributions and introduce GERVE (Gibbs-measure Entropy-Regularised Variational Estimation), a likelihood-free framework that approximates Gibbs measures directly from samples by…

Methodology · Statistics 2026-02-23 Tâm LeMinh , Julyan Arbel , Florence Forbes , Hien Duy Nguyen

Web image datasets curated online inherently contain ambiguous in-distribution (ID) instances and out-of-distribution (OOD) instances, which we collectively call non-conforming (NC) instances. In many recent approaches for mitigating the…

Computer Vision and Pattern Recognition · Computer Science 2023-07-20 Xia Huang , Kai Fong Ernest Chong

Despite the tremendous progress in the estimation of generative models, the development of tools for diagnosing their failures and assessing their performance has advanced at a much slower pace. Recent developments have investigated metrics…

Machine Learning · Computer Science 2020-06-09 Josip Djolonga , Mario Lucic , Marco Cuturi , Olivier Bachem , Olivier Bousquet , Sylvain Gelly

Kernel continual learning by \citet{derakhshani2021kernel} has recently emerged as a strong continual learner due to its non-parametric ability to tackle task interference and catastrophic forgetting. Unfortunately its success comes at the…

Machine Learning · Computer Science 2021-12-28 Mohammad Mahdi Derakhshani , Xiantong Zhen , Ling Shao , Cees G. M. Snoek

Novelty detection is the unsupervised problem of identifying anomalies in test data which significantly differ from the training set. Novelty detection is one of the classic challenges in Machine Learning and a core component of several…

Machine Learning · Computer Science 2019-03-06 Rémi Domingues

Many deep models have been recently proposed for anomaly detection. This paper presents comparison of selected generative deep models and classical anomaly detection methods on an extensive number of non--image benchmark datasets. We…

Machine Learning · Computer Science 2018-07-16 Vít Škvára , Tomáš Pevný , Václav Šmídl

In this thesis we examined several multimodal feature extraction and learning methods for retrieval and classification purposes. We reread briefly some theoretical results of learning in Section 2 and reviewed several generative and…

Computer Vision and Pattern Recognition · Computer Science 2017-05-16 Bálint Zoltán Daróczy

Devising domain- and model-agnostic evaluation metrics for generative models is an important and as yet unresolved problem. Most existing metrics, which were tailored solely to the image synthesis setup, exhibit a limited capacity for…

Machine Learning · Computer Science 2022-07-14 Ahmed M. Alaa , Boris van Breugel , Evgeny Saveliev , Mihaela van der Schaar

We introduce and motivate generative modeling as a central task for machine learning and provide a critical view of the algorithms which have been proposed for solving this task. We overview how generative modeling can be defined…

Machine Learning · Computer Science 2021-03-02 Alex Lamb

Generative models are typically evaluated by direct inspection of their generated samples, e.g., by visual inspection in the case of images. Further evaluation metrics like the Fr\'echet inception distance or maximum mean discrepancy are…

Information Theory · Computer Science 2024-08-02 Michael Baur , Nurettin Turan , Simon Wallner , Wolfgang Utschick

Diffusion models have recently driven significant breakthroughs in generative modeling. While state-of-the-art models produce high-quality samples on average, individual samples can still be low quality. Detecting such samples without human…

Machine Learning · Computer Science 2025-06-13 Metod Jazbec , Eliot Wong-Toi , Guoxuan Xia , Dan Zhang , Eric Nalisnick , Stephan Mandt

Due to the complexity of modern computer systems, novel and unexpected behaviors frequently occur. Such deviations are either normal occurrences, such as software updates and new user activities, or abnormalities, such as misconfigurations,…

Machine Learning · Computer Science 2023-09-06 Quentin Fournier , Daniel Aloise , Leandro R. Costa

Deep generative models have achieved great success in producing high-quality samples, making them a central tool across machine learning applications. Beyond sample quality, an important yet less systematically studied question is whether…

Machine Learning · Computer Science 2026-02-17 Farzan Farnia , Mohammad Jalali , Azim Ospanov

Recent advances in generative modeling have led to an increased interest in the study of statistical divergences as means of model comparison. Commonly used evaluation methods, such as the Frechet Inception Distance (FID), correlate well…

Machine Learning · Statistics 2018-10-30 Mehdi S. M. Sajjadi , Olivier Bachem , Mario Lucic , Olivier Bousquet , Sylvain Gelly

There has been a recent explosion in research into machine-learning-based generative modeling to tackle computational challenges for simulations in high energy physics (HEP). In order to use such alternative simulators in practice, we need…

High Energy Physics - Experiment · Physics 2023-04-24 Raghav Kansal , Anni Li , Javier Duarte , Nadezda Chernyavskaya , Maurizio Pierini , Breno Orzari , Thiago Tomei

Probabilistic generative models provide a flexible and systematic framework for learning the underlying geometry of data. However, model selection in this setting is challenging, particularly when selecting for ill-defined qualities such as…

Machine Learning · Computer Science 2022-10-05 Chester Holtz , Gal Mishne , Alexander Cloninger

Regression tasks, notably in safety-critical domains, require proper uncertainty quantification, yet the literature remains largely classification-focused. In this light, we introduce a family of measures for total, aleatoric, and epistemic…

Machine Learning · Computer Science 2025-10-30 Christopher Bülte , Yusuf Sale , Gitta Kutyniok , Eyke Hüllermeier

Building on the success of deep learning, Generative Adversarial Networks (GANs) provide a modern approach to learn a probability distribution from observed samples. GANs are often formulated as a zero-sum game between two sets of…

Machine Learning · Computer Science 2020-09-28 Pirazh Khorramshahi , Hossein Souri , Rama Chellappa , Soheil Feizi

We tackle the problem of robust novelty detection, where we aim to detect novelties in terms of semantic content while being invariant to changes in other, irrelevant factors. Specifically, we operate in a setup with multiple environments,…

Machine Learning · Computer Science 2023-10-11 Stefan Smeu , Elena Burceanu , Emanuela Haller , Andrei Liviu Nicolicioiu