English
Related papers

Related papers: CODiT: Conformal Out-of-Distribution Detection in …

200 papers

Efficient and effective Out-of-Distribution (OOD) detection is essential for the safe deployment of AI systems. Existing feature space methods, while effective, often incur significant computational overhead due to their reliance on…

Machine Learning · Computer Science 2024-06-05 Litian Liu , Yao Qin

Time series remains one of the most challenging modalities in machine learning research. The out-of-distribution (OOD) detection and generalization on time series tend to suffer due to its non-stationary property, i.e., the distribution…

Machine Learning · Computer Science 2023-08-07 Wang Lu , Jindong Wang , Xinwei Sun , Yiqiang Chen , Xiangyang Ji , Qiang Yang , Xing Xie

As machine learning models continue to achieve impressive performance across different tasks, the importance of effective anomaly detection for such models has increased as well. It is common knowledge that even well-trained models lose…

Machine Learning · Computer Science 2023-02-23 Ramneet Kaur , Xiayan Ji , Souradeep Dutta , Michele Caprio , Yahan Yang , Elena Bernardis , Oleg Sokolsky , Insup Lee

Out-of-distribution (OOD) data poses serious challenges in deployed machine learning models as even subtle changes could incur significant performance drops. Being able to estimate a model's performance on test data is important in practice…

Machine Learning · Computer Science 2023-02-13 Yuzhe Lu , Zhenlin Wang , Runtian Zhai , Soheil Kolouri , Joseph Campbell , Katia Sycara

The usage of deep neural networks in safety-critical systems is limited by our ability to guarantee their correct behavior. Runtime monitors are components aiming to identify unsafe predictions and discard them before they can lead to…

Machine Learning · Computer Science 2023-01-16 Joris Guérin , Kevin Delmas , Raul Sena Ferreira , Jérémie Guiochet

Deep neural networks have attained remarkable performance when applied to data that comes from the same distribution as that of the training set, but can significantly degrade otherwise. Therefore, detecting whether an example is…

Computer Vision and Pattern Recognition · Computer Science 2020-04-02 Yen-Chang Hsu , Yilin Shen , Hongxia Jin , Zsolt Kira

Out-of-Distribution (OOD) detection is critical for safely deploying deep models in open-world environments, where inputs may lie outside the training distribution. During inference on a model trained exclusively with In-Distribution (ID)…

Computer Vision and Pattern Recognition · Computer Science 2025-07-08 Jiawei Gu , Ziyue Qiao , Zechao Li

Out-of-distribution (OOD) detection is critical to ensuring the reliability and safety of machine learning systems. For instance, in autonomous driving, we would like the driving system to issue an alert and hand over the control to humans…

Computer Vision and Pattern Recognition · Computer Science 2024-01-24 Jingkang Yang , Kaiyang Zhou , Yixuan Li , Ziwei Liu

We study the problem of out-of-distribution dynamics (OODD) detection, which involves detecting when the dynamics of a temporal process change compared to the training-distribution dynamics. This is relevant to applications in control,…

Machine Learning · Computer Science 2022-05-25 Mohamad H Danesh , Alan Fern

Out-of-distribution (OOD) detection aims to detect test samples that do not fall into any training in-distribution (ID) classes. Prior efforts focus on regularizing models with ID data only, largely underperforming counterparts that utilize…

Machine Learning · Computer Science 2025-05-20 Puning Yang , Jian Liang , Jie Cao , Ran He

Out-of-distribution (OOD) detection discerns OOD data where the predictor cannot make valid predictions as in-distribution (ID) data, thereby increasing the reliability of open-world classification. However, it is typically hard to collect…

Machine Learning · Computer Science 2023-12-06 Haotian Zheng , Qizhou Wang , Zhen Fang , Xiaobo Xia , Feng Liu , Tongliang Liu , Bo Han

It is an important problem in trustworthy machine learning to recognize out-of-distribution (OOD) inputs which are inputs unrelated to the in-distribution task. Many out-of-distribution detection methods have been suggested in recent years.…

Machine Learning · Computer Science 2022-06-22 Julian Bitterwolf , Alexander Meinke , Maximilian Augustin , Matthias Hein

Image classification models deployed in the real world may receive inputs outside the intended data distribution. For critical applications such as clinical decision making, it is important that a model can detect such out-of-distribution…

Computer Vision and Pattern Recognition · Computer Science 2021-07-07 Christoph Berger , Magdalini Paschali , Ben Glocker , Konstantinos Kamnitsas

Runtime monitoring provides a more realistic and applicable alternative to verification in the setting of real neural networks used in industry. It is particularly useful for detecting out-of-distribution (OOD) inputs, for which the network…

Machine Learning · Computer Science 2022-12-21 Vahid Hashemi , Jan Křetínsky , Sabine Rieder , Jessica Schmidt

Safe deployment of time-series classifiers for real-world applications relies on the ability to detect the data which is not generated from the same distribution as training data. This task is referred to as out-of-distribution (OOD)…

Machine Learning · Computer Science 2023-10-27 Taha Belkhouja , Yan Yan , Janardhan Rao Doppa

Despite the significant research efforts on trajectory prediction for automated driving, limited work exists on assessing the prediction reliability. To address this limitation we propose an approach that covers two sources of error, namely…

Robotics · Computer Science 2023-08-07 Julian Wiederer , Julian Schmidt , Ulrich Kressel , Klaus Dietmayer , Vasileios Belagiannis

Uncertainties in machine learning are a significant roadblock for its application in safety-critical cyber-physical systems (CPS). One source of uncertainty arises from distribution shifts in the input data between training and test…

Machine Learning · Computer Science 2021-08-02 Yeli Feng , Daniel Jun Xian Ng , Arvind Easwaran

Cyber-physical systems (CPS) greatly benefit by using machine learning components that can handle the uncertainty and variability of the real-world. Typical components such as deep neural networks, however, introduce new types of hazards…

Machine Learning · Computer Science 2020-01-29 Feiyang Cai , Xenofon Koutsoukos

3D object detection is an essential part of automated driving, and deep neural networks (DNNs) have achieved state-of-the-art performance for this task. However, deep models are notorious for assigning high confidence scores to…

Computer Vision and Pattern Recognition · Computer Science 2022-09-30 Chengjie Huang , Van Duong Nguyen , Vahdat Abdelzad , Christopher Gus Mannes , Luke Rowe , Benjamin Therien , Rick Salay , Krzysztof Czarnecki

Detecting out-of-distribution (OOD) data is crucial for ensuring the safe deployment of machine learning models in real-world applications. However, existing OOD detection approaches primarily rely on the feature maps or the full gradient…

Computer Vision and Pattern Recognition · Computer Science 2023-08-02 Sima Behpour , Thang Doan , Xin Li , Wenbin He , Liang Gou , Liu Ren