English
Related papers

Related papers: A Simple and Effective Method for Uncertainty Quan…

200 papers

Machine learning methods must be trusted to make appropriate decisions in real-world environments, even when faced with out-of-distribution (OOD) samples. Many current approaches simply aim to detect OOD examples and alert the user when an…

Machine Learning · Computer Science 2022-09-13 Randolph Linderman , Jingyang Zhang , Nathan Inkawhich , Hai Li , Yiran Chen

Out-of-distribution (OOD) detection is critical for ensuring the reliability of deep learning systems, particularly in safety-critical applications. Likelihood-based deep generative models have historically faced criticism for their…

Machine Learning · Computer Science 2025-07-11 Yifan Ding , Arturas Aleksandraus , Amirhossein Ahmadian , Jonas Unger , Fredrik Lindsten , Gabriel Eilertsen

There have been several efforts to improve Novelty Detection (ND) performance. However, ND methods often suffer significant performance drops under minor distribution shifts caused by changes in the environment, known as style shifts. This…

Moving beyond testing on in-distribution data works on Out-of-Distribution (OOD) detection have recently increased in popularity. A recent attempt to categorize OOD data introduces the concept of near and far OOD detection. Specifically,…

Machine Learning · Computer Science 2021-11-23 Junjiao Tian , Yen-Change Hsu , Yilin Shen , Hongxia Jin , Zsolt Kira

In the real world, a learning system could receive an input that is unlike anything it has seen during training. Unfortunately, out-of-distribution samples can lead to unpredictable behaviour. We need to know whether any given input belongs…

Machine Learning · Computer Science 2019-08-21 Alireza Shafaei , Mark Schmidt , James J. Little

Out-of-distribution (OOD) detection is crucial to safety-critical machine learning applications and has been extensively studied. While recent studies have predominantly focused on classifier-based methods, research on deep generative model…

Machine Learning · Computer Science 2024-02-19 Genki Osada , Tsubasa Takahashi , Takashi Nishide

Likelihood-based generative models are a promising resource to detect out-of-distribution (OOD) inputs which could compromise the robustness or reliability of a machine learning system. However, likelihoods derived from such models have…

Machine Learning · Computer Science 2020-01-20 Joan Serrà , David Álvarez , Vicenç Gómez , Olga Slizovskaia , José F. Núñez , Jordi Luque

Out-of-distribution (OoD) detection is a natural downstream task for deep generative models, due to their ability to learn the input probability distribution. There are mainly two classes of approaches for OoD detection using deep…

Machine Learning · Computer Science 2019-07-11 Yujia Huang , Sihui Dai , Tan Nguyen , Richard G. Baraniuk , Anima Anandkumar

Out-Of-Distribution (OOD) detection has received broad attention over the years, aiming to ensure the reliability and safety of deep neural networks (DNNs) in real-world scenarios by rejecting incorrect predictions. However, we notice a…

Computer Vision and Pattern Recognition · Computer Science 2022-12-01 Yao Zhu , Yuefeng Chen , Xiaodan Li , Rong Zhang , Hui Xue , Xiang Tian , Rongxin Jiang , Bolun Zheng , Yaowu Chen

Rigorous statistical methods, including parameter estimation with accompanying uncertainties, underpin the validity of scientific discovery, especially in the natural sciences. With increasingly complex data models such as deep learning…

Machine Learning · Computer Science 2026-02-18 Aurora Grefsrud , Nello Blaser , Trygve Buanes

Deep neural networks (DNNs) provide state-of-the-art results for a multitude of applications, but the approaches using DNNs for multimodal audiovisual applications do not consider predictive uncertainty associated with individual…

Neural and Evolutionary Computing · Computer Science 2019-09-23 Mahesh Subedar , Ranganath Krishnan , Paulo Lopez Meyer , Omesh Tickoo , Jonathan Huang

Machine learning models deployed in the wild can be challenged by out-of-distribution (OOD) data from unknown classes. Recent advances in OOD detection rely on distance measures to distinguish samples that are relatively far away from the…

Machine Learning · Computer Science 2023-12-25 Soumya Suvra Ghosal , Yiyou Sun , Yixuan Li

The hybrid neural differentiable models mark a significant advancement in the field of scientific machine learning. These models, integrating numerical representations of known physics into deep neural networks, offer enhanced predictive…

Machine Learning · Computer Science 2024-01-02 Deepak Akhare , Tengfei Luo , Jian-Xun Wang

Many neural network-based out-of-distribution (OoD) detection methods have been proposed. However, they require many training data for each target task. We propose a simple yet effective meta-learning method to detect OoD with small…

Machine Learning · Statistics 2022-06-22 Tomoharu Iwata , Atsutoshi Kumagai

Deep neural networks (DNNs) are powerful learning models yet their results are not always reliable. This is due to the fact that modern DNNs are usually uncalibrated and we cannot characterize their epistemic uncertainty. In this work, we…

Computer Vision and Pattern Recognition · Computer Science 2020-06-03 Gianni Franchi , Andrei Bursuc , Emanuel Aldea , Severine Dubuisson , Isabelle Bloch

Trusting the predictions of deep learning models in safety critical settings such as the medical domain is still not a viable option. Distentangled uncertainty quantification in the field of medical imaging has received little attention. In…

Image and Video Processing · Electrical Eng. & Systems 2022-11-14 Kumud Lakara , Matias Valdenegro-Toro

Out-of-distribution (OOD) detection is a critical requirement for the deployment of deep neural networks. This paper introduces the HEAT model, a new post-hoc OOD detection method estimating the density of in-distribution (ID) samples using…

Computer Vision and Pattern Recognition · Computer Science 2023-08-21 Marc Lafon , Elias Ramzi , Clément Rambour , Nicolas Thome

Existing uncertainty modeling approaches try to detect an out-of-distribution point from the in-distribution dataset. We extend this argument to detect finer-grained uncertainty that distinguishes between (a). certain points, (b). uncertain…

Machine Learning · Computer Science 2020-02-12 Rahul Soni , Naresh Shah , Jimmy D. Moore

As the use of machine learning continues to expand, the importance of ensuring its safety cannot be overstated. A key concern in this regard is the ability to identify whether a given sample is from the training distribution, or is an…

Machine Learning · Computer Science 2023-08-11 Nicola Franco , Daniel Korth , Jeanette Miriam Lorenz , Karsten Roscher , Stephan Guennemann

Deep Neural Networks are actively being used in the design of autonomous Cyber-Physical Systems (CPSs). The advantage of these models is their ability to handle high-dimensional state-space and learn compact surrogate representations of the…

Machine Learning · Computer Science 2021-08-27 Shreyas Ramakrishna , Zahra Rahiminasab , Gabor Karsai , Arvind Easwaran , Abhishek Dubey