English
Related papers

Related papers: A Variational Dirichlet Framework for Out-of-Distr…

200 papers

Deep neural networks for image classification only learn to map in-distribution inputs to their corresponding ground truth labels in training without differentiating out-of-distribution samples from in-distribution ones. This results from…

Machine Learning · Computer Science 2023-08-29 Zhilin Zhao , Longbing Cao , Kun-Yu Lin

This paper presents a novel evaluation framework for Out-of-Distribution (OOD) detection that aims to assess the performance of machine learning models in more realistic settings. We observed that the real-world requirements for testing OOD…

Computer Vision and Pattern Recognition · Computer Science 2023-09-01 Vahid Reza Khazaie , Anthony Wong , Mohammad Sabokrou

Deep neural networks achieve superior performance in semantic segmentation, but are limited to a predefined set of classes, which leads to failures when they encounter unknown objects in open-world scenarios. Recognizing and segmenting…

Computer Vision and Pattern Recognition · Computer Science 2025-12-15 Arnold Brosch , Abdelrahman Eldesokey , Michael Felsberg , Kira Maag

Existing uncertainty modeling approaches try to detect an out-of-distribution point from the in-distribution dataset. We extend this argument to detect finer-grained uncertainty that distinguishes between (a). certain points, (b). uncertain…

Machine Learning · Computer Science 2020-02-12 Rahul Soni , Naresh Shah , Jimmy D. Moore

We consider the problem of detecting out-of-distribution (OOD) samples in deep reinforcement learning. In a value based reinforcement learning setting, we propose to use uncertainty estimation techniques directly on the agent's value…

Machine Learning · Computer Science 2019-01-09 Andreas Sedlmeier , Thomas Gabor , Thomy Phan , Lenz Belzner , Claudia Linnhoff-Popien

Deep neural networks suffer from the overconfidence issue in the open world, meaning that classifiers could yield confident, incorrect predictions for out-of-distribution (OOD) samples. Thus, it is an urgent and challenging task to detect…

Computer Vision and Pattern Recognition · Computer Science 2022-04-12 Qiuyu Zhu , Guohui Zheng , Yingying Yan

A crucial requirement for machine learning algorithms is not only to perform well, but also to show robustness and adaptability when encountering novel scenarios. One way to achieve these characteristics is to endow the deep learning models…

Computer Vision and Pattern Recognition · Computer Science 2025-02-26 Eduardo Aguilar , Bogdan Raducanu , Petia Radeva

Deep neural networks have attained remarkable performance when applied to data that comes from the same distribution as that of the training set, but can significantly degrade otherwise. Therefore, detecting whether an example is…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Yen-Chang Hsu , Yilin Shen , Hongxia Jin , Zsolt Kira

Deep neural networks are increasingly used in a wide range of technologies and services, but remain highly susceptible to out-of-distribution (OOD) samples, that is, drawn from a different distribution than the original training set. A…

Machine Learning · Computer Science 2024-04-17 Pietro Recalcati , Fabio Garcea , Luca Piano , Fabrizio Lamberti , Lia Morra

The quantification of uncertainty is important for the adoption of machine learning, especially to reject out-of-distribution (OOD) data back to human experts for review. Yet progress has been slow, as a balance must be struck between…

Machine Learning · Computer Science 2022-09-12 Derek Everett , Andre T. Nguyen , Luke E. Richards , Edward Raff

Deep neural networks have become the default choice for many of the machine learning tasks such as classification and regression. Dropout, a method commonly used to improve the convergence of deep neural networks, generates an ensemble of…

Machine Learning · Statistics 2019-04-11 Tal Kachman , Michal Moshkovitz , Michal Rosen-Zvi

We study the problem of Out-of-Distribution (OOD) detection, that is, detecting whether a learning algorithm's output can be trusted at inference time. While a number of tests for OOD detection have been proposed in prior work, a formal…

Machine Learning · Statistics 2023-09-19 Akshayaa Magesh , Venugopal V. Veeravalli , Anirban Roy , Susmit Jha

Among existing uncertainty estimation approaches, Dirichlet Prior Network (DPN) distinctly models different predictive uncertainty types. However, for in-domain examples with high data uncertainties among multiple classes, even a DPN model…

Machine Learning · Computer Science 2021-01-07 Jay Nandy , Wynne Hsu , Mong Li Lee

Deep neural networks (DNNs) are often constructed under the closed-world assumption, which may fail to generalize to the out-of-distribution (OOD) data. This leads to DNNs producing overconfident wrong predictions and can result in…

Machine Learning · Statistics 2024-12-31 Yang Chen , Chih-Li Sung , Arpan Kusari , Xiaoyang Song , Wenbo Sun

In the real world, a learning system could receive an input that is unlike anything it has seen during training. Unfortunately, out-of-distribution samples can lead to unpredictable behaviour. We need to know whether any given input belongs…

Machine Learning · Computer Science 2019-08-21 Alireza Shafaei , Mark Schmidt , James J. Little

Applying machine learning to increasingly high-dimensional problems with sparse or biased training data increases the risk that a model is used on inputs outside its training domain. For such out-of-distribution (OOD) inputs, the model can…

Machine Learning · Computer Science 2025-03-10 Juniper Tyree , Andreas Rupp , Petri S. Clusius , Michael H. Boy

Standard machine learning is unable to accommodate inputs which do not belong to the training distribution. The resulting models often give rise to confident incorrect predictions which may lead to devastating consequences. This problem is…

Computer Vision and Pattern Recognition · Computer Science 2023-08-01 Matej Grcić , Petra Bevandić , Zoran Kalafatić , Siniša Šegvić

When neural networks process images which do not resemble the distribution seen during training, so called out-of-distribution images, they often make wrong predictions, and do so too confidently. The capability to detect…

Computer Vision and Pattern Recognition · Computer Science 2018-12-13 Marc Masana , Idoia Ruiz , Joan Serrat , Joost van de Weijer , Antonio M. Lopez

Deep generative models have been demonstrated as state-of-the-art density estimators. Yet, recent work has found that they often assign a higher likelihood to data from outside the training distribution. This seemingly paradoxical behavior…

Machine Learning · Computer Science 2022-01-19 Jakob D. Havtorn , Jes Frellsen , Søren Hauberg , Lars Maaløe

Detecting out-of-distribution inputs for visual recognition models has become critical in safe deep learning. This paper proposes a novel hierarchical visual category modeling scheme to separate out-of-distribution data from in-distribution…

Computer Vision and Pattern Recognition · Computer Science 2024-08-29 Jinglun Li , Xinyu Zhou , Pinxue Guo , Yixuan Sun , Yiwen Huang , Weifeng Ge , Wenqiang Zhang