中文
相关论文

相关论文: Activation Subspaces for Out-of-Distribution Detec…

200 篇论文

This paper introduces a novel method leveraging bi-encoder-based detectors along with a comprehensive study comparing different out-of-distribution (OOD) detection methods in NLP using different feature extractors. The feature extraction…

计算与语言 · 计算机科学 2024-03-14 Louis Owen , Biddwan Ahmed , Abhay Kumar

Out-of-distribution (OOD) detection, which maps high-dimensional data into a scalar OOD score, is critical for the reliable deployment of machine learning models. A key challenge in recent research is how to effectively leverage and…

机器学习 · 计算机科学 2026-02-06 Claus Hofmann , Christian Huber , Bernhard Lehner , Daniel Klotz , Sepp Hochreiter , Werner Zellinger

Out-of-distribution (OOD) detection is crucial for the safe deployment of neural networks. Existing CLIP-based approaches perform OOD detection by devising novel scoring functions or sophisticated fine-tuning methods. In this work, we…

计算与语言 · 计算机科学 2024-11-06 Yixia Li , Boya Xiong , Guanhua Chen , Yun Chen

Out-of-distribution (OOD) detectors can act as safety monitors in embedded cyber-physical systems by identifying samples outside a machine learning model's training distribution to prevent potentially unsafe actions. However, OOD detectors…

机器学习 · 计算机科学 2024-09-04 Aditya Bansal , Michael Yuhas , Arvind Easwaran

Deep learning models are increasingly deployed in safety-critical applications, where reliable out-of-distribution (OOD) detection is essential to ensure robustness. Existing methods predominantly rely on the penultimate-layer activations…

计算机视觉与模式识别 · 计算机科学 2026-05-13 Shreen Gul , Mohamed Elmahallawy , Ardhendu Tripathy , Sanjay Madria

Out-of-distribution (OOD) detection discerns OOD data where the predictor cannot make valid predictions as in-distribution (ID) data, thereby increasing the reliability of open-world classification. However, it is typically hard to collect…

机器学习 · 计算机科学 2023-12-06 Haotian Zheng , Qizhou Wang , Zhen Fang , Xiaobo Xia , Feng Liu , Tongliang Liu , Bo Han

Detecting out-of-distribution (OOD) samples is essential for ensuring the reliability of deep neural networks (DNNs) in real-world scenarios. While previous research has predominantly investigated the disparity between in-distribution (ID)…

计算机视觉与模式识别 · 计算机科学 2024-07-23 Yingwen Wu , Tao Li , Xinwen Cheng , Jie Yang , Xiaolin Huang

Neural network-based radio receivers are expected to play a key role in future wireless systems, making reliable Out-Of-Distribution (OOD) detection essential. We propose a post-hoc, layerwise OOD framework based on channelwise feature…

机器学习 · 计算机科学 2026-01-15 Marko Tuononen , Heikki Penttinen , Duy Vu , Dani Korpi , Vesa Starck , Ville Hautamäki

As language models become more general purpose, increased attention needs to be paid to detecting out-of-distribution (OOD) instances, i.e., those not belonging to any of the distributions seen during training. Existing methods for…

机器学习 · 计算机科学 2024-07-19 Aryan Gulati , Xingjian Dong , Carlos Hurtado , Sarath Shekkizhar , Swabha Swayamdipta , Antonio Ortega

Out-of-distribution (OOD) detection is important for deploying machine learning models in the real world, where test data from shifted distributions can naturally arise. While a plethora of algorithmic approaches have recently emerged for…

机器学习 · 计算机科学 2021-12-03 Peyman Morteza , Yixuan Li

Pretrained Transformers achieve remarkable performance when training and test data are from the same distribution. However, in real-world scenarios, the model often faces out-of-distribution (OOD) instances that can cause severe semantic…

计算与语言 · 计算机科学 2022-01-24 Wenxuan Zhou , Fangyu Liu , Muhao Chen

Out-of-Distribution (OoD) detection is important for building safe artificial intelligence systems. However, current OoD detection methods still cannot meet the performance requirements for practical deployment. In this paper, we propose a…

机器学习 · 统计学 2020-12-18 Haiwen Huang , Zhihan Li , Lulu Wang , Sishuo Chen , Bin Dong , Xinyu Zhou

In this work, we study the out-of-distribution (OOD) detection problem through the use of the feature space of a pre-trained deep classifier. We show that learning the density of in-distribution (ID) features with an energy-based models…

计算机视觉与模式识别 · 计算机科学 2024-03-18 Marc Lafon , Clément Rambour , Nicolas Thome

State-of-the-art Object Detection (OD) methods predominantly operate under a closed-world assumption, where test-time categories match those encountered during training. However, detecting and localizing unknown objects is crucial for…

计算机视觉与模式识别 · 计算机科学 2025-06-18 Daniel Montoya , Aymen Bouguerra , Alexandra Gomez-Villa , Fabio Arnez

Out-of-Distribution (OOD) detection, i.e., identifying whether an input is sampled from a novel distribution other than the training distribution, is a critical task for safely deploying machine learning systems in the open world. Recently,…

机器学习 · 计算机科学 2023-01-13 Feng Xue , Zi He , Chuanlong Xie , Falong Tan , Zhenguo Li

Detecting Out-of-Distribution (OOD) samples in real world visual applications like classification or object detection has become a necessary precondition in today's deployment of Deep Learning systems. Many techniques have been proposed, of…

计算机视觉与模式识别 · 计算机科学 2022-08-24 Abhishek Joshi , Sathish Chalasani , Kiran Nanjunda Iyer

Deep neural networks have achieved great success in classification tasks during the last years. However, one major problem to the path towards artificial intelligence is the inability of neural networks to accurately detect samples from…

机器学习 · 计算机科学 2021-03-16 Aristotelis-Angelos Papadopoulos , Mohammad Reza Rajati , Nazim Shaikh , Jiamian Wang

The training and test data for deep-neural-network-based classifiers are usually assumed to be sampled from the same distribution. When part of the test samples are drawn from a distribution that is sufficiently far away from that of the…

机器学习 · 计算机科学 2021-12-14 Yinan Wang , Wenbo Sun , Jionghua "Judy" Jin , Zhenyu "James" Kong , Xiaowei Yue

When deploying deep learning technology in self-driving cars, deep neural networks are constantly exposed to domain shifts. These include, e.g., changes in weather conditions, time of day, and long-term temporal shift. In this work we…

计算机视觉与模式识别 · 计算机科学 2020-05-15 Philipp Oberdiek , Matthias Rottmann , Gernot A. Fink

This paper presents a novel evaluation framework for Out-of-Distribution (OOD) detection that aims to assess the performance of machine learning models in more realistic settings. We observed that the real-world requirements for testing OOD…

计算机视觉与模式识别 · 计算机科学 2023-09-01 Vahid Reza Khazaie , Anthony Wong , Mohammad Sabokrou