中文
相关论文

相关论文: Kernel PCA for Out-of-Distribution Detection

200 篇论文

Out-of-distribution (OOD) detection is essential for the reliable and safe deployment of machine learning systems in the real world. Great progress has been made over the past years. This paper presents the first review of recent advances…

计算与语言 · 计算机科学 2023-12-29 Hao Lang , Yinhe Zheng , Yixuan Li , Jian Sun , Fei Huang , Yongbin Li

Out-of-distribution (OOD) detection is a critical task for ensuring the reliability and safety of deep neural networks in real-world scenarios. Different from most previous OOD detection methods that focus on designing OOD scores or…

计算机视觉与模式识别 · 计算机科学 2022-10-11 Yao Zhu , YueFeng Chen , Chuanlong Xie , Xiaodan Li , Rong Zhang , Hui Xue , Xiang Tian , bolun zheng , Yaowu Chen

In the open world, detecting out-of-distribution (OOD) data, whose labels are disjoint with those of in-distribution (ID) samples, is important for reliable deep neural networks (DNNs). To achieve better detection performance, one type of…

计算机视觉与模式识别 · 计算机科学 2025-02-28 Yingwen Wu , Ruiji Yu , Xinwen Cheng , Zhengbao He , Xiaolin Huang

Deep neural networks achieve superior performance in challenging tasks such as image classification. However, deep classifiers tend to incorrectly classify out-of-distribution (OOD) inputs, which are inputs that do not belong to the…

机器学习 · 计算机科学 2019-10-24 Vahdat Abdelzad , Krzysztof Czarnecki , Rick Salay , Taylor Denounden , Sachin Vernekar , Buu Phan

Out-of-distribution (OOD) detection is a critical issue for the stable and reliable operation of systems using a deep neural network (DNN). Although many OOD detection methods have been proposed, it remains unclear how the differences…

机器学习 · 计算机科学 2024-10-30 Kazuki Uematsu , Kosuke Haruki , Taiji Suzuki , Mitsuhiro Kimura , Takahiro Takimoto , Hideyuki Nakagawa

Out-of-distribution (OOD) detection is crucial when deploying deep neural networks in the real world to ensure the reliability and safety of their applications. One main challenge in OOD detection is that neural network models often produce…

计算机视觉与模式识别 · 计算机科学 2025-10-15 Jinlun Ye , Zhuohao Sun , Yiqiao Qiu , Qiu Li , Zhijun Tan , Ruixuan Wang

Out-of-Distribution (OOD) detection requires sensitivity to subtle shifts without overreacting to natural In-Distribution (ID) diversity. However, from the viewpoint of detection granularity, global representation inevitably suppress local…

计算机视觉与模式识别 · 计算机科学 2026-04-24 Wenrui Liu , Hong Chang , Ruibing Hou , Shiguang Shan , Xilin Chen

Out-of-distribution detection is an important capability that has long eluded vanilla neural networks. Deep Neural networks (DNNs) tend to generate over-confident predictions when presented with inputs that are significantly…

机器学习 · 计算机科学 2022-02-24 Sumedh A Sontakke , Buvaneswari Ramanan , Laurent Itti , Thomas Woo

Principal component analysis (PCA) is largely adopted for chemical process monitoring and numerous PCA-based systems have been developed to solve various fault detection and diagnosis problems. Since PCA-based methods assume that the…

机器学习 · 计算机科学 2017-12-13 Haitao Zhao

Detecting out-of-distribution (OOD) data is a critical challenge in machine learning due to model overconfidence, often without awareness of their epistemological limits. We hypothesize that ``neural collapse'', a phenomenon affecting…

We introduce powerful ideas from Hyperdimensional Computing into the challenging field of Out-of-Distribution (OOD) detection. In contrast to most existing work that performs OOD detection based on only a single layer of a neural network,…

计算机视觉与模式识别 · 计算机科学 2022-08-31 Samuel Wilson , Tobias Fischer , Niko Sünderhauf , Feras Dayoub

A key feature of out-of-distribution (OOD) detection is to exploit a trained neural network by extracting statistical patterns and relationships through the multi-layer classifier to detect shifts in the expected input data distribution.…

机器学习 · 计算机科学 2023-06-07 Eduardo Dadalto , Pierre Colombo , Guillaume Staerman , Nathan Noiry , Pablo Piantanida

Principal Component Analysis (PCA) and its nonlinear extension Kernel PCA (KPCA) are widely used across science and industry for data analysis and dimensionality reduction. Modern deep learning tools have achieved great empirical success,…

机器学习 · 计算机科学 2023-02-23 Francesco Tonin , Qinghua Tao , Panagiotis Patrinos , Johan A. K. Suykens

The usage of deep neural networks in safety-critical systems is limited by our ability to guarantee their correct behavior. Runtime monitors are components aiming to identify unsafe predictions and discard them before they can lead to…

机器学习 · 计算机科学 2023-01-16 Joris Guérin , Kevin Delmas , Raul Sena Ferreira , Jérémie Guiochet

Detecting out-of-distribution (OOD) samples is essential for ensuring the reliability of deep neural networks (DNNs) in real-world scenarios. While previous research has predominantly investigated the disparity between in-distribution (ID)…

计算机视觉与模式识别 · 计算机科学 2024-07-23 Yingwen Wu , Tao Li , Xinwen Cheng , Jie Yang , Xiaolin Huang

Out-of-distribution (OOD) detection is critical for safety-sensitive machine learning applications and has been extensively studied, yielding a plethora of methods developed in the literature. However, most studies for OOD detection did not…

计算机视觉与模式识别 · 计算机科学 2023-10-13 Atsuyuki Miyai , Qing Yu , Go Irie , Kiyoharu Aizawa

Existing Out-of-Distribution (OoD) detection methods address to detect OoD samples from In-Distribution (InD) data mainly by exploring differences in features, logits and gradients in Deep Neural Networks (DNNs). We in this work propose a…

机器学习 · 计算机科学 2024-07-17 Kun Fang , Qinghua Tao , Xiaolin Huang , Jie Yang

Traditional deep learning (DL) approaches based on supervised learning paradigms require large amounts of annotated data that are rarely available in the medical domain. Unsupervised Out-of-distribution (OOD) detection is an alternative…

图像与视频处理 · 电气工程与系统科学 2023-08-15 Alvaro Fernandez-Quilez , Linas Vidziunas , Ørjan Kløvfjell Thoresen , Ketil Oppedal , Svein Reidar Kjosavik , Trygve Eftestøl

Deep neural networks (DNN) have outstanding performance in various applications. Despite numerous efforts of the research community, out-of-distribution (OOD) samples remain a significant limitation of DNN classifiers. The ability to…

机器学习 · 计算机科学 2023-03-27 Bartlomiej Olber , Krystian Radlak , Adam Popowicz , Michal Szczepankiewicz , Krystian Chachuła

For safety assurance of deep neural networks (DNNs), out-of-distribution (OoD) monitoring techniques are essential as they filter spurious input that is distant from the training dataset. This paper studies the problem of systematically…

软件工程 · 计算机科学 2022-05-17 Chih-Hong Cheng , Changshun Wu , Emmanouil Seferis , Saddek Bensalem