中文
相关论文

相关论文: Neuron Activation Coverage: Rethinking Out-of-dist…

200 篇论文

We propose a simple, efficient, and accurate method for detecting out-of-distribution (OOD) data for trained neural networks. We propose a novel descriptor, HAct - activation histograms, for OOD detection, that is, probability distributions…

机器学习 · 计算机科学 2023-10-19 Sudeepta Mondal , Ganesh Sundaramoorthi

Traditional machine learning paradigms are based on the assumption that both training and test data follow the same statistical pattern, which is mathematically referred to as Independent and Identically Distributed ($i.i.d.$). However, in…

机器学习 · 计算机科学 2023-07-28 Jiashuo Liu , Zheyan Shen , Yue He , Xingxuan Zhang , Renzhe Xu , Han Yu , Peng Cui

In the dynamic realms of machine learning and deep learning, the robustness and reliability of models are paramount, especially in critical real-world applications. A fundamental challenge in this sphere is managing Out-of-Distribution…

机器学习 · 计算机科学 2024-03-07 Yingrui Ji , Yao Zhu , Zhigang Li , Jiansheng Chen , Yunlong Kong , Jingbo Chen

We study the problem of Out-of-Distribution (OOD) detection, that is, detecting whether a learning algorithm's output can be trusted at inference time. While a number of tests for OOD detection have been proposed in prior work, a formal…

机器学习 · 统计学 2023-09-19 Akshayaa Magesh , Venugopal V. Veeravalli , Anirban Roy , Susmit Jha

Graph Neural Networks (GNNs) are state-of-the-art models for performing prediction tasks on graphs. While existing GNNs have shown great performance on various tasks related to graphs, little attention has been paid to the scenario where…

机器学习 · 计算机科学 2023-08-15 Yu Song , Donglin Wang

Since deep learning models have been implemented in many commercial applications, it is important to detect out-of-distribution (OOD) inputs correctly to maintain the performance of the models, ensure the quality of the collected data, and…

计算机视觉与模式识别 · 计算机科学 2019-09-10 Qing Yu , Kiyoharu Aizawa

Deep neural networks achieve superior performance in challenging tasks such as image classification. However, deep classifiers tend to incorrectly classify out-of-distribution (OOD) inputs, which are inputs that do not belong to the…

机器学习 · 计算机科学 2019-10-24 Vahdat Abdelzad , Krzysztof Czarnecki , Rick Salay , Taylor Denounden , Sachin Vernekar , Buu Phan

Machine learning models, while progressively advanced, rely heavily on the IID assumption, which is often unfulfilled in practice due to inevitable distribution shifts. This renders them susceptible and untrustworthy for deployment in…

机器学习 · 计算机科学 2024-03-05 Han Yu , Jiashuo Liu , Xingxuan Zhang , Jiayun Wu , Peng Cui

As deep neural networks (DNNs) become increasingly common, concerns about their robustness do as well. A longstanding problem for deployed DNNs is their behavior in the face of unfamiliar inputs; specifically, these models tend to be…

机器学习 · 计算机科学 2025-01-23 Esha Datta , Johanna Hennig , Eva Domschot , Connor Mattes , Michael R. Smith

We characterized the generalization capabilities of DNN-based encoding models when predicting neuronal responses from the visual cortex. We collected \textit{MacaqueITBench}, a large-scale dataset of neural population responses from the…

信号处理 · 电气工程与系统科学 2024-06-26 Spandan Madan , Will Xiao , Mingran Cao , Hanspeter Pfister , Margaret Livingstone , Gabriel Kreiman

Computer-aided diagnostics has benefited from the development of deep learning-based computer vision techniques in these years. Traditional supervised deep learning methods assume that the test sample is drawn from the identical…

计算机视觉与模式识别 · 计算机科学 2024-07-04 Zesheng Hong , Yubiao Yue , Yubin Chen , Lele Cong , Huanjie Lin , Yuanmei Luo , Mini Han Wang , Weidong Wang , Jialong Xu , Xiaoqi Yang , Hechang Chen , Zhenzhang Li , Sihong Xie

The proper handling of out-of-distribution (OOD) samples in deep classifiers is a critical concern for ensuring the suitability of deep neural networks in safety-critical systems. Existing approaches developed for robust OOD detection in…

计算机视觉与模式识别 · 计算机科学 2024-06-18 Nasrin Alipour , Seyyed Ali SeyyedSalehi

Out-of-distribution (OOD) detection remains challenging for deep learning models, particularly when test-time OOD samples differ significantly from training outliers. We propose OODD, a novel test-time OOD detection method that dynamically…

计算机视觉与模式识别 · 计算机科学 2025-03-14 Yifeng Yang , Lin Zhu , Zewen Sun , Hengyu Liu , Qinying Gu , Nanyang Ye

Deep Learning models are easily disturbed by variations in the input images that were not seen during training, resulting in unpredictable behaviours. Such Out-of-Distribution (OOD) images represent a significant challenge in the context of…

图像与视频处理 · 电气工程与系统科学 2024-10-28 Benjamin Lambert , Florence Forbes , Senan Doyle , Alan Tucholka , Michel Dojat

The usage of deep neural networks in safety-critical systems is limited by our ability to guarantee their correct behavior. Runtime monitors are components aiming to identify unsafe predictions and discard them before they can lead to…

机器学习 · 计算机科学 2023-01-16 Joris Guérin , Kevin Delmas , Raul Sena Ferreira , Jérémie Guiochet

This paper presents a principled approach for detecting out-of-distribution (OOD) samples in deep neural networks (DNN). Modeling probability distributions on deep features has recently emerged as an effective, yet computationally cheap…

机器学习 · 计算机科学 2020-12-09 Ibrahima Ndiour , Nilesh Ahuja , Omesh Tickoo

In the recent years, researchers proposed a number of successful methods to perform out-of-distribution (OOD) detection in deep neural networks (DNNs). So far the scope of the highly accurate methods has been limited to image level…

计算机视觉与模式识别 · 计算机科学 2021-04-01 Ertunc Erdil , Krishna Chaitanya , Neerav Karani , Ender Konukoglu

Supervised learning aims to train a classifier under the assumption that training and test data are from the same distribution. To ease the above assumption, researchers have studied a more realistic setting: out-of-distribution (OOD)…

机器学习 · 计算机科学 2023-02-28 Zhen Fang , Yixuan Li , Jie Lu , Jiahua Dong , Bo Han , Feng Liu

Deep Neural Networks for classification behave unpredictably when confronted with inputs not stemming from the training distribution. This motivates out-of-distribution detection (OOD) mechanisms. The usual lack of prior information on…

机器学习 · 计算机科学 2022-03-02 Konstantin Kirchheim , Tim Gonschorek , Frank Ortmeier

We study out-of-distribution (OOD) prediction behavior of neural networks when they classify images from unseen classes or corrupted images. To probe the OOD behavior, we introduce a new measure, nearest category generalization (NCG), where…

机器学习 · 计算机科学 2023-03-09 Yao-Yuan Yang , Cyrus Rashtchian , Ruslan Salakhutdinov , Kamalika Chaudhuri