English
Related papers

Related papers: Mitigating Out-of-Distribution Data Density Overes…

200 papers

We introduce a novel combination of Bayesian Models (BMs) and Neural Networks (NNs) for making predictions with a minimum expected risk. Our approach combines the best of both worlds, the data efficiency and interpretability of a BM with…

Machine Learning · Computer Science 2021-09-28 Mathias Löwe , Per Lunnemann Hansen , Sebastian Risi

After an autoencoder (AE) has learnt to reconstruct one dataset, it might be expected that the likelihood on an out-of-distribution (OOD) input would be low. This has been studied as an approach to detect OOD inputs. Recent work showed this…

Machine Learning · Computer Science 2021-07-29 Bang Xiang Yong , Tim Pearce , Alexandra Brintrup

Clinically deployed segmentation models are known to fail on data outside of their training distribution. As these models perform well on most cases, it is imperative to detect out-of-distribution (OOD) images at inference to protect…

Machine Learning · Computer Science 2023-10-23 McKell Woodland , Nihil Patel , Mais Al Taie , Joshua P. Yung , Tucker J. Netherton , Ankit B. Patel , Kristy K. Brock

Reinforcement learning (RL) post-training is a dominant approach for improving the reasoning performance of large language models (LLMs), yet growing evidence suggests that its gains arise primarily from distribution sharpening rather than…

Machine Learning · Computer Science 2026-01-30 Xiaotong Ji , Rasul Tutunov , Matthieu Zimmer , Haitham Bou Ammar

In the recent years, researchers proposed a number of successful methods to perform out-of-distribution (OOD) detection in deep neural networks (DNNs). So far the scope of the highly accurate methods has been limited to image level…

Computer Vision and Pattern Recognition · Computer Science 2021-04-01 Ertunc Erdil , Krishna Chaitanya , Neerav Karani , Ender Konukoglu

In addition to accurate scene understanding through precise semantic segmentation of LiDAR point clouds, detecting out-of-distribution (OOD) objects, instances not encountered during training, is essential to prevent the incorrect…

Computer Vision and Pattern Recognition · Computer Science 2025-10-13 Hanieh Shojaei Miandashti , Claus Brenner

Safety measures need to be systemically investigated to what extent they evaluate the intended performance of Deep Neural Networks (DNNs) for critical applications. Due to a lack of verification methods for high-dimensional DNNs, a…

Machine Learning · Computer Science 2024-01-31 Jens Henriksson , Christian Berger , Stig Ursing , Markus Borg

We propose a continuous-time formulation of persistent contrastive divergence (PCD) for maximum likelihood estimation (MLE) of unnormalised densities. Our approach expresses PCD as a coupled, multiscale system of stochastic differential…

Machine Learning · Statistics 2025-10-03 Paul Felix Valsecchi Oliva , O. Deniz Akyildiz , Andrew Duncan

Precise probabilistic forecasts are fundamental for energy risk management, and there is a wide range of both statistical and machine learning models for this purpose. Inherent to these probabilistic models is some form of uncertainty…

Machine Learning · Computer Science 2025-10-10 Andreas Lebedev , Abhinav Das , Sven Pappert , Stephan Schlüter

Out-of-distribution (OOD) detection plays a vital role in enhancing the reliability of machine learning (ML) models. The emergence of large language models (LLMs) has catalyzed a paradigm shift within the ML community, showcasing their…

Computation and Language · Computer Science 2024-04-17 Bo Liu , Liming Zhan , Zexin Lu , Yujie Feng , Lei Xue , Xiao-Ming Wu

In this work, two machine learning (ML)-based structures for joint detection-channel estimation in OFDM systems are proposed and extensively characterized. Both ML architectures, namely Deep Neural Network (DNN) and Extreme Learning Machine…

Information Theory · Computer Science 2023-04-25 Wilson de Souza Junior , Taufik Abrao

Safety-critical applications like autonomous driving use Deep Neural Networks (DNNs) for object detection and segmentation. The DNNs fail to predict when they observe an Out-of-Distribution (OOD) input leading to catastrophic consequences.…

Computer Vision and Pattern Recognition · Computer Science 2022-11-14 Lokesh Veeramacheneni , Matias Valdenegro-Toro

Out-of-distribution (OOD) detection is crucial to safety-critical machine learning applications and has been extensively studied. While recent studies have predominantly focused on classifier-based methods, research on deep generative model…

Machine Learning · Computer Science 2024-02-19 Genki Osada , Tsubasa Takahashi , Takashi Nishide

Brain vessel segmentation of MR scans is a critical step in the diagnosis of cerebrovascular diseases. Due to the fine vessel structure, manual vessel segmentation is time consuming. Therefore, automatic deep learning (DL) based…

Image and Video Processing · Electrical Eng. & Systems 2025-03-31 Omini Rathore , Richard Paul , Abigail Morrison , Hanno Scharr , Elisabeth Pfaehler

This paper addresses maximum likelihood (ML) estimation based model fitting in the context of extrasolar planet detection. This problem is featured by the following properties: 1) the candidate models under consideration are highly…

Methodology · Statistics 2017-07-24 Bin Liu , Ke-Jia Chen

This paper deals with uncertainty quantification and out-of-distribution detection in deep learning using Bayesian and ensemble methods. It proposes a practical solution to the lack of prediction diversity observed recently for standard…

Machine Learning · Computer Science 2025-02-03 Antoine de Mathelin , François Deheeger , Mathilde Mougeot , Nicolas Vayatis

Detecting out-of-distribution (OOD) samples is an essential requirement for the deployment of machine learning systems in the real world. Until now, research on energy-based OOD detectors has focused on the softmax confidence score from a…

Machine Learning · Computer Science 2021-02-18 Francesco Tonin , Arun Pandey , Panagiotis Patrinos , Johan A. K. Suykens

Identifying future congestion points in electricity distribution networks is an important challenge distribution system operators face. A proven approach for addressing this challenge is to assess distribution grid adequacy using…

Systems and Control · Electrical Eng. & Systems 2022-07-12 Julian N. Betge , Barbera Droste , Jacco Heres , Simon H. Tindemans

Detecting out-of-distribution (OOD) samples is crucial for trustworthy AI in real-world applications. Leveraging recent advances in representation learning and latent embeddings, Various scoring algorithms estimate distributions beyond the…

Machine Learning · Computer Science 2024-09-20 Jeng-Lin Li , Ming-Ching Chang , Wei-Chao Chen

Deep neural networks (DNNs), especially convolutional neural networks, have achieved superior performance on image classification tasks. However, such performance is only guaranteed if the input to a trained model is similar to the training…

Computer Vision and Pattern Recognition · Computer Science 2021-01-28 Liang Liang , Linhai Ma , Linchen Qian , Jiasong Chen