English
Related papers

Related papers: FrOoDo: Framework for Out-of-Distribution Detectio…

200 papers

Neural networks that are trained on limited category samples often mispredict out-of-distribution (OOD) objects. We observe that features of the same category are more tightly clustered in feature space, while those of different categories…

Computer Vision and Pattern Recognition · Computer Science 2025-01-29 Junkun Chen , Jilin Mei , Liang Chen , Fangzhou Zhao , Yan Xing , Yu Hu

In recent years, there have been significant improvements in various forms of image outlier detection. However, outlier detection performance under adversarial settings lags far behind that in standard settings. This is due to the lack of…

Out-of-distribution (OOD) detection has recently gained substantial attention due to the importance of identifying out-of-domain samples in reliability and safety. Although OOD detection methods have advanced by a great deal, they are still…

Computer Vision and Pattern Recognition · Computer Science 2022-10-03 Mohammad Azizmalayeri , Arshia Soltani Moakhar , Arman Zarei , Reihaneh Zohrabi , Mohammad Taghi Manzuri , Mohammad Hossein Rohban

PyODDS is an end-to end Python system for outlier detection with database support. PyODDS provides outlier detection algorithms which meet the demands for users in different fields, w/wo data science or machine learning background. PyODDS…

Machine Learning · Computer Science 2019-10-14 Yuening Li , Daochen Zha , Na Zou , Xia Hu

Out-of-distribution (OOD) detection is a critical task in machine learning that seeks to identify abnormal samples. Traditionally, unsupervised methods utilize a deep generative model for OOD detection. However, such approaches require a…

Machine Learning · Computer Science 2024-10-25 Alvin Heng , Alexandre H. Thiery , Harold Soh

Out-of-distribution (OOD) detection is important for deploying reliable machine learning models on real-world applications. Recent advances in outlier exposure have shown promising results on OOD detection via fine-tuning model with…

Machine Learning · Computer Science 2023-10-27 Jianing Zhu , Geng Yu , Jiangchao Yao , Tongliang Liu , Gang Niu , Masashi Sugiyama , Bo Han

Real-world machine learning applications often face simultaneous covariate and semantic shifts, challenging traditional domain generalization and out-of-distribution (OOD) detection methods. We introduce Meta-learned Across Domain…

Machine Learning · Computer Science 2024-11-06 Haoliang Wang , Chen Zhao , Feng Chen

The usage of deep neural networks in safety-critical systems is limited by our ability to guarantee their correct behavior. Runtime monitors are components aiming to identify unsafe predictions and discard them before they can lead to…

Machine Learning · Computer Science 2023-01-16 Joris Guérin , Kevin Delmas , Raul Sena Ferreira , Jérémie Guiochet

In the dynamic realms of machine learning and deep learning, the robustness and reliability of models are paramount, especially in critical real-world applications. A fundamental challenge in this sphere is managing Out-of-Distribution…

Machine Learning · Computer Science 2024-03-07 Yingrui Ji , Yao Zhu , Zhigang Li , Jiansheng Chen , Yunlong Kong , Jingbo Chen

Out-of-distribution (OoD) detection techniques are instrumental for safety-related neural networks. We are arguing, however, that current performance-oriented OoD detection techniques geared towards matching metrics such as expected…

Machine Learning · Computer Science 2023-06-16 Chih-Hong Cheng , Changshun Wu , Harald Ruess , Saddek Bensalem

Detecting out-of-distribution (OOD) inputs during the inference stage is crucial for deploying neural networks in the real world. Previous methods commonly relied on the output of a network derived from the highly activated feature map. In…

Computer Vision and Pattern Recognition · Computer Science 2023-03-03 Yeonguk Yu , Sungho Shin , Seongju Lee , Changhyun Jun , Kyoobin Lee

Out-of-distribution (OOD) detection is essential to improve the reliability of machine learning models by detecting samples that do not belong to the training distribution. Detecting OOD samples effectively in certain tasks can pose a…

Computer Vision and Pattern Recognition · Computer Science 2023-11-02 Divyanshu Mishra , He Zhao , Pramit Saha , Aris T. Papageorghiou , J. Alison Noble

To ensure robust and reliable classification results, OoD (out-of-distribution) indicators based on deep generative models are proposed recently and are shown to work well on small datasets. In this paper, we conduct the first large…

Machine Learning · Computer Science 2021-08-13 Wenxiao Chen , Xiaohui Nie , Mingliang Li , Dan Pei

Moving deep learning models from the laboratory setting to the open world entails preparing them to handle unforeseen conditions. In several applications the occurrence of novel classes during deployment poses a significant threat, thus it…

Computer Vision and Pattern Recognition · Computer Science 2023-10-25 Paolo Rabino , Antonio Alliegro , Francesco Cappio Borlino , Tatiana Tommasi

Implementing effective control mechanisms to ensure the proper functioning and security of deployed NLP models, from translation to chatbots, is essential. A key ingredient to ensure safe system behaviour is Out-Of-Distribution (OOD)…

Computation and Language · Computer Science 2024-03-04 Maxime Darrin , Pablo Piantanida , Pierre Colombo

Detecting out-of-distribution (OOD) data is a critical challenge in machine learning due to model overconfidence, often without awareness of their epistemological limits. We hypothesize that ``neural collapse'', a phenomenon affecting…

Machine Learning · Statistics 2024-02-28 Mouïn Ben Ammar , Nacim Belkhir , Sebastian Popescu , Antoine Manzanera , Gianni Franchi

Building up reliable Out-of-Distribution (OOD) detectors is challenging, often requiring the use of OOD data during training. In this work, we develop a data-driven approach which is distinct and complementary to existing works: Instead of…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Jingyang Zhang , Nathan Inkawhich , Randolph Linderman , Ryan Luley , Yiran Chen , Hai Li

With the recently rapid development in deep learning, deep neural networks have been widely adopted in many real-life applications. However, deep neural networks are also known to have very little control over its uncertainty for unseen…

Machine Learning · Computer Science 2019-04-23 Wenhu Chen , Yilin Shen , Hongxia Jin , William Wang

Detecting test-time distribution shift has emerged as a key capability for safely deployed machine learning models, with the question being tackled under various guises in recent years. In this paper, we aim to provide a consolidated view…

Computer Vision and Pattern Recognition · Computer Science 2024-09-02 Hongjun Wang , Sagar Vaze , Kai Han

State-of-the-art models can perform well in controlled environments, but they often struggle when presented with out-of-distribution (OOD) examples, making OOD detection a critical component of NLP systems. In this paper, we focus on…

Computation and Language · Computer Science 2023-07-17 Mateusz Baran , Joanna Baran , Mateusz Wójcik , Maciej Zięba , Adam Gonczarek