English
Related papers

Related papers: Runtime Monitoring for Out-of-Distribution Detecti…

200 papers

State-of-the-art Object Detection (OD) methods predominantly operate under a closed-world assumption, where test-time categories match those encountered during training. However, detecting and localizing unknown objects is crucial for…

Computer Vision and Pattern Recognition · Computer Science 2025-06-18 Daniel Montoya , Aymen Bouguerra , Alexandra Gomez-Villa , Fabio Arnez

While reinforcement learning (RL) algorithms have been successfully applied across numerous sequential decision-making problems, their generalization to unforeseen testing environments remains a significant concern. In this paper, we study…

Machine Learning · Computer Science 2024-04-11 Linas Nasvytis , Kai Sandbrink , Jakob Foerster , Tim Franzmeyer , Christian Schroeder de Witt

Out-of-distribution (OOD) detection is a task that detects OOD samples during inference to ensure the safety of deployed models. However, conventional benchmarks have reached performance saturation, making it difficult to compare recent OOD…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Shiho Noda , Atsuyuki Miyai , Qing Yu , Go Irie , Kiyoharu Aizawa

Detecting test-time distribution shift has emerged as a key capability for safely deployed machine learning models, with the question being tackled under various guises in recent years. In this paper, we aim to provide a consolidated view…

Computer Vision and Pattern Recognition · Computer Science 2024-09-02 Hongjun Wang , Sagar Vaze , Kai Han

Out-of-distribution (OOD) detection aims to identify test examples that do not belong to the training distribution and are thus unlikely to be predicted reliably. Despite a plethora of existing works, most of them focused only on the…

Machine Learning · Computer Science 2023-11-07 Reza Averly , Wei-Lun Chao

Out-of-distribution (OOD) detection is critical to ensuring the reliability and safety of machine learning systems. For instance, in autonomous driving, we would like the driving system to issue an alert and hand over the control to humans…

Computer Vision and Pattern Recognition · Computer Science 2024-01-24 Jingkang Yang , Kaiyang Zhou , Yixuan Li , Ziwei Liu

In order for robots to safely navigate in unseen scenarios using learning-based methods, it is important to accurately detect out-of-training-distribution (OoD) situations online. Recently, Gaussian process state-space models (GPSSMs) have…

Robotics · Computer Science 2023-09-19 Alonso Marco , Elias Morley , Claire J. Tomlin

Machine learning models are prone to making incorrect predictions on inputs that are far from the training distribution. This hinders their deployment in safety-critical applications such as autonomous vehicles and healthcare. The detection…

Machine Learning · Computer Science 2022-07-26 Ramneet Kaur , Kaustubh Sridhar , Sangdon Park , Susmit Jha , Anirban Roy , Oleg Sokolsky , Insup Lee

As machine learning models continue to achieve impressive performance across different tasks, the importance of effective anomaly detection for such models has increased as well. It is common knowledge that even well-trained models lose…

Machine Learning · Computer Science 2023-02-23 Ramneet Kaur , Xiayan Ji , Souradeep Dutta , Michele Caprio , Yahan Yang , Elena Bernardis , Oleg Sokolsky , Insup Lee

Out-of-distribution (OOD) detection is essential for the reliability of ML models. Most existing methods for OOD detection learn a fixed decision criterion from a given in-distribution dataset and apply it universally to decide if a data…

Machine Learning · Computer Science 2023-11-29 YiFan Zhang , Xue Wang , Tian Zhou , Kun Yuan , Zhang Zhang , Liang Wang , Rong Jin , Tieniu Tan

Autonomous agents for cyber applications take advantage of modern defense techniques by adopting intelligent agents with conventional and learning-enabled components. These intelligent agents are trained via reinforcement learning (RL)…

Machine Learning · Computer Science 2024-12-05 Ankita Samaddar , Nicholas Potteiger , Xenofon Koutsoukos

It is crucial to detect when an instance lies downright too far from the training samples for the machine learning model to be trusted, a challenge known as out-of-distribution (OOD) detection. For neural networks, one approach to this task…

Safe deployment of time-series classifiers for real-world applications relies on the ability to detect the data which is not generated from the same distribution as training data. This task is referred to as out-of-distribution (OOD)…

Machine Learning · Computer Science 2023-10-27 Taha Belkhouja , Yan Yan , Janardhan Rao Doppa

Out-of-distribution (OOD) detection remains challenging for deep learning models, particularly when test-time OOD samples differ significantly from training outliers. We propose OODD, a novel test-time OOD detection method that dynamically…

Computer Vision and Pattern Recognition · Computer Science 2025-03-14 Yifeng Yang , Lin Zhu , Zewen Sun , Hengyu Liu , Qinying Gu , Nanyang Ye

Out-of-distribution (OOD) detection is crucial for ensuring reliable deployment of machine learning models. Recent advancements focus on utilizing easily accessible auxiliary outliers (e.g., data from the web or other datasets) in training.…

Machine Learning · Computer Science 2024-11-22 Haiyun Yao , Zongbo Han , Huazhu Fu , Xi Peng , Qinghua Hu , Changqing Zhang

Out-of-distribution (OOD) detection is important for deploying machine learning models in the real world, where test data from shifted distributions can naturally arise. While a plethora of algorithmic approaches have recently emerged for…

Machine Learning · Computer Science 2021-12-03 Peyman Morteza , Yixuan Li

Deep neural networks (DNNs) are widely used in perception systems for safety-critical applications, such as autonomous driving and robotics. However, DNNs remain vulnerable to various safety concerns, including generalization errors,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Albert Schotschneider , Svetlana Pavlitska , J. Marius Zöllner

Out-of-distribution detection (OOD) deals with anomalous input to neural networks. In the past, specialized methods have been proposed to reject predictions on anomalous input. Similarly, it was shown that feature extraction models in…

Machine Learning · Computer Science 2022-01-25 Jan Diers , Christian Pigorsch

In this paper, we tackle the detection of out-of-distribution (OOD) objects in semantic segmentation. By analyzing the literature, we found that current methods are either accurate or fast but not both which limits their usability in real…

Computer Vision and Pattern Recognition · Computer Science 2021-08-04 Victor Besnier , Andrei Bursuc , David Picard , Alexandre Briot

Object detection is essential to many perception algorithms used in modern robotics applications. Unfortunately, the existing models share a tendency to assign high confidence scores for out-of-distribution (OOD) samples. Although OOD…

Computer Vision and Pattern Recognition · Computer Science 2023-12-19 Bartłomiej Olber , Krystian Radlak , Krystian Chachuła , Jakub Łyskawa , Piotr Frątczak