English
Related papers

Related papers: The Open-World Lottery Ticket Hypothesis for OOD I…

200 papers

The distribution of a neural network's latent representations has been successfully used to detect out-of-distribution (OOD) data. This work investigates whether this distribution moreover correlates with a model's epistemic uncertainty,…

Machine Learning · Computer Science 2021-02-24 Janis Postels , Hermann Blum , Yannick Strümpler , Cesar Cadena , Roland Siegwart , Luc Van Gool , Federico Tombari

Out-of-distribution (OOD) detection is essential for the reliable and safe deployment of machine learning systems in the real world. Great progress has been made over the past years. This paper presents the first review of recent advances…

Computation and Language · Computer Science 2023-12-29 Hao Lang , Yinhe Zheng , Yixuan Li , Jian Sun , Fei Huang , Yongbin Li

Out of distribution (OOD) detection remains a critical challenge in malware classification due to the substantial intra family variability introduced by polymorphic and metamorphic malware variants. Most existing deep learning based malware…

Cryptography and Security · Computer Science 2025-12-22 Tosin Ige , Christopher Kiekintveld , Aritran Piplai , Asif Rahman , Olukunle Kolade , Sasidhar Kunapuli

We propose a novel inference-time out-of-domain (OOD) detection algorithm for specialized large language models (LLMs). Despite achieving state-of-the-art performance on in-domain tasks through fine-tuning, specialized LLMs remain…

Computation and Language · Computer Science 2025-09-17 Ayush Gupta , Ramneet Kaur , Anirban Roy , Adam D. Cobb , Rama Chellappa , Susmit Jha

Deep generative models trained by maximum likelihood remain very popular methods for reasoning about data probabilistically. However, it has been observed that they can assign higher likelihoods to out-of-distribution (OOD) data than…

Machine Learning · Statistics 2023-06-16 Anthony L. Caterini , Gabriel Loaiza-Ganem

The strong {\it lottery ticket hypothesis} (LTH) postulates that one can approximate any target neural network by only pruning the weights of a sufficiently over-parameterized random network. A recent work by Malach et al.…

Machine Learning · Computer Science 2021-03-12 Ankit Pensia , Shashank Rajput , Alliot Nagle , Harit Vishwakarma , Dimitris Papailiopoulos

Deep neural networks (DNNs) are often constructed under the closed-world assumption, which may fail to generalize to the out-of-distribution (OOD) data. This leads to DNNs producing overconfident wrong predictions and can result in…

Machine Learning · Statistics 2024-12-31 Yang Chen , Chih-Li Sung , Arpan Kusari , Xiaoyang Song , Wenbo Sun

Domain generalization aims to solve the challenge of Out-of-Distribution (OOD) generalization by leveraging common knowledge learned from multiple training domains to generalize to unseen test domains. To accurately evaluate the OOD…

Machine Learning · Computer Science 2024-03-26 Han Yu , Xingxuan Zhang , Renzhe Xu , Jiashuo Liu , Yue He , Peng Cui

Machine learning methods must be trusted to make appropriate decisions in real-world environments, even when faced with out-of-distribution (OOD) samples. Many current approaches simply aim to detect OOD examples and alert the user when an…

Machine Learning · Computer Science 2022-09-13 Randolph Linderman , Jingyang Zhang , Nathan Inkawhich , Hai Li , Yiran Chen

The ability to detect Out-of-Distribution (OOD) data is important in safety-critical applications of deep learning. The aim is to separate In-Distribution (ID) data drawn from the training distribution from OOD data using a measure of…

Machine Learning · Computer Science 2022-09-21 Guoxuan Xia , Christos-Savvas Bouganis

Deep Neural Networks for classification behave unpredictably when confronted with inputs not stemming from the training distribution. This motivates out-of-distribution detection (OOD) mechanisms. The usual lack of prior information on…

Machine Learning · Computer Science 2022-03-02 Konstantin Kirchheim , Tim Gonschorek , Frank Ortmeier

Deep learning-based approaches have produced models with good insect classification accuracy; Most of these models are conducive for application in controlled environmental conditions. One of the primary emphasis of researchers is to…

Computer Vision and Pattern Recognition · Computer Science 2023-05-04 Mojdeh Saadati , Aditya Balu , Shivani Chiranjeevi , Talukder Zaki Jubery , Asheesh K Singh , Soumik Sarkar , Arti Singh , Baskar Ganapathysubramanian

Out-of-distribution detection (OOD) deals with anomalous input to neural networks. In the past, specialized methods have been proposed to reject predictions on anomalous input. Similarly, it was shown that feature extraction models in…

Machine Learning · Computer Science 2022-01-25 Jan Diers , Christian Pigorsch

Detecting test-time distribution shift has emerged as a key capability for safely deployed machine learning models, with the question being tackled under various guises in recent years. In this paper, we aim to provide a consolidated view…

Computer Vision and Pattern Recognition · Computer Science 2024-09-02 Hongjun Wang , Sagar Vaze , Kai Han

The Lottery Ticket Hypothesis suggests that an over-parametrized network consists of ``lottery tickets'', and training a certain collection of them (i.e., a subnetwork) can match the performance of the full model. In this paper, we study…

Machine Learning · Computer Science 2021-06-09 Chen Liang , Simiao Zuo , Minshuo Chen , Haoming Jiang , Xiaodong Liu , Pengcheng He , Tuo Zhao , Weizhu Chen

Out-of-distribution (OOD) data poses serious challenges in deployed machine learning models, so methods of predicting a model's performance on OOD data without labels are important for machine learning safety. While a number of methods have…

For most intelligent assistant systems, it is essential to have a mechanism that detects out-of-domain (OOD) utterances automatically to handle noisy input properly. One typical approach would be introducing a separate class that contains…

Computation and Language · Computer Science 2020-03-30 Yueqi Feng , Jiali Lin

Neural networks (NNs) are widely used for object classification in autonomous driving. However, NNs can fail on input data not well represented by the training dataset, known as out-of-distribution (OOD) data. A mechanism to detect OOD…

Computer Vision and Pattern Recognition · Computer Science 2021-09-07 Julia Nitsch , Masha Itkina , Ransalu Senanayake , Juan Nieto , Max Schmidt , Roland Siegwart , Mykel J. Kochenderfer , Cesar Cadena

Deep neural networks (DNNs) are known to produce incorrect predictions with very high confidence on out-of-distribution (OOD) inputs. This limitation is one of the key challenges in the adoption of deep learning models in high-assurance…

Machine Learning · Computer Science 2021-03-24 Ramneet Kaur , Susmit Jha , Anirban Roy , Oleg Sokolsky , Insup Lee

Out-of-distribution (OOD) detection is essential for ensuring the reliability of deep learning models operating in open-world scenarios. Current OOD detectors mainly rely on statistical models to identify unusual patterns in the latent…

Machine Learning · Computer Science 2025-06-06 Konstantin Kirchheim , Frank Ortmeier