中文
相关论文

相关论文: Does Your Neural Network Extrapolate? Feature Engi…

200 篇论文

Distribution shifts on graphs -- the discrepancies in data distribution between training and employing a graph machine learning model -- are ubiquitous and often unavoidable in real-world scenarios. These shifts may severely deteriorate…

机器学习 · 计算机科学 2025-03-31 Kexin Zhang , Shuhan Liu , Song Wang , Weili Shi , Chen Chen , Pan Li , Sheng Li , Jundong Li , Kaize Ding

Out-of-distribution (OOD) detection and OOD generalization are widely studied in Deep Neural Networks (DNNs), yet their relationship remains poorly understood. We empirically show that the degree of Neural Collapse (NC) in a network layer…

机器学习 · 计算机科学 2025-09-23 Md Yousuf Harun , Jhair Gallardo , Christopher Kanan

Out-of-distribution (OOD) detection plays a crucial role in ensuring the security of neural networks. Existing works have leveraged the fact that In-distribution (ID) samples form a subspace in the feature space, achieving state-of-the-art…

机器学习 · 计算机科学 2024-01-04 Jiawei Zhang , Yufan Chen , Cheng Jin , Lei Zhu , Yuantao Gu

Out-of-distribution (OOD) detection is a critical task to ensure the reliability and security of machine learning models deployed in real-world applications. Conventional methods for OOD detection that rely on single-modal information,…

计算机视觉与模式识别 · 计算机科学 2024-03-21 K Huang , G Song , Hanwen Su , Jiyan Wang

Detecting out-of-distribution (OOD) data is essential for safe deployment of deep neural networks (DNNs). This problem becomes particularly challenging in the presence of long-tailed in-distribution (ID) datasets, often leading to high…

计算机视觉与模式识别 · 计算机科学 2025-11-25 Nimeshika Udayangani , Hadi M. Dolatabadi , Sarah Erfani , Christopher Leckie

Out-of-distribution detection (OOD) is a crucial technique for deploying machine learning models in the real world to handle the unseen scenarios. In this paper, we first propose a simple yet effective Neural Activation Prior (NAP) for OOD…

计算机视觉与模式识别 · 计算机科学 2024-05-27 Weilin Wan , Weizhong Zhang , Quan Zhou , Fan Yi , Cheng Jin

With the availability of large pre-trained models, a modern workflow for building real-world machine learning solutions is to fine-tune such models on a downstream task with a relatively small domain-specific dataset. In such applications,…

机器学习 · 计算机科学 2024-05-28 Lu Tan , Huei Zhou , Yinxiang Huang , Zeming Zheng , Yujiu Yang

Out-of-distribution (OOD) detection is critical for ensuring the reliability of deep learning systems, particularly in safety-critical applications. Likelihood-based deep generative models have historically faced criticism for their…

The application of machine learning in safety-critical systems requires a reliable assessment of uncertainty. However, deep neural networks are known to produce highly overconfident predictions on out-of-distribution (OOD) data. Even if…

机器学习 · 计算机科学 2022-10-19 Alexander Meinke , Julian Bitterwolf , Matthias Hein

Out-of-distribution (OOD) detection can be used in deep learning-based applications to reject outlier samples from being unreliably classified by deep neural networks. Learning to classify between OOD and in-distribution samples is…

计算机视觉与模式识别 · 计算机科学 2023-01-31 Jaeyoung Kim , Seo Taek Kong , Dongbin Na , Kyu-Hwan Jung

Generalization, the ability to perform well beyond the training context, is a hallmark of biological and artificial intelligence, yet anticipating unseen failures remains a central challenge. Conventional approaches often take a…

机器学习 · 计算机科学 2026-03-03 Chi-Ning Chou , Artem Kirsanov , Yao-Yuan Yang , SueYeon Chung

The ability to detect objects that are not prevalent in the training set is a critical capability in many 3D applications, including autonomous driving. Machine learning methods for object recognition often assume that all object categories…

计算机视觉与模式识别 · 计算机科学 2025-07-02 Zizhao Li , Xueyang Kang , Joseph West , Kourosh Khoshelham

Deep neural networks (DNNs) are known to produce incorrect predictions with very high confidence on out-of-distribution (OOD) inputs. This limitation is one of the key challenges in the adoption of deep learning models in high-assurance…

机器学习 · 计算机科学 2021-03-24 Ramneet Kaur , Susmit Jha , Anirban Roy , Oleg Sokolsky , Insup Lee

Out-of-distribution (OOD) detection is important for deploying reliable machine learning models on real-world applications. Recent advances in outlier exposure have shown promising results on OOD detection via fine-tuning model with…

机器学习 · 计算机科学 2023-10-27 Jianing Zhu , Geng Yu , Jiangchao Yao , Tongliang Liu , Gang Niu , Masashi Sugiyama , Bo Han

Detecting data points deviating from the training distribution is pivotal for ensuring reliable machine learning. Extensive research has been dedicated to the challenge, spanning classical anomaly detection techniques to contemporary…

机器学习 · 计算机科学 2024-05-30 Xuefeng Du , Yiyou Sun , Yixuan Li

The ability to detect Out-of-Distribution (OOD) data is important in safety-critical applications of deep learning. The aim is to separate In-Distribution (ID) data drawn from the training distribution from OOD data using a measure of…

机器学习 · 计算机科学 2022-09-21 Guoxuan Xia , Christos-Savvas Bouganis

Deep Learning models are easily disturbed by variations in the input images that were not observed during the training stage, resulting in unpredictable predictions. Detecting such Out-of-Distribution (OOD) images is particularly crucial in…

计算机视觉与模式识别 · 计算机科学 2023-07-31 Benjamin Lambert , Florence Forbes , Senan Doyle , Michel Dojat

Out-of-distribution (OOD) generalization is challenging because distribution shifts come in many forms. Numerous algorithms exist to address specific settings, but choosing the right training algorithm for the right dataset without trial…

机器学习 · 计算机科学 2025-06-03 Liangze Jiang , Damien Teney

Out-of-distribution (OOD) detection discerns OOD data where the predictor cannot make valid predictions as in-distribution (ID) data, thereby increasing the reliability of open-world classification. However, it is typically hard to collect…

机器学习 · 计算机科学 2023-12-06 Haotian Zheng , Qizhou Wang , Zhen Fang , Xiaobo Xia , Feng Liu , Tongliang Liu , Bo Han

A widely recognized limitation of molecular prediction models is their reliance on structures observed in the training data, resulting in poor generalization to out-of-distribution compounds. Yet in drug discovery, the compounds most…

机器学习 · 计算机科学 2026-01-05 Jina Kim , Jeffrey Willette , Bruno Andreis , Sung Ju Hwang