中文
相关论文

相关论文: Feature Protection For Out-of-distribution General…

200 篇论文

A major challenge in machine learning is resilience to out-of-distribution data, that is data that exists outside of the distribution of a model's training data. Training is often performed using limited, carefully curated datasets and so…

计算机视觉与模式识别 · 计算机科学 2022-11-30 Christopher J. Holder , Majid Khonji , Jorge Dias , Muhammad Shafique

Out-of-distribution (OOD) detection aims to identify OOD data based on representations extracted from well-trained deep models. However, existing methods largely ignore the reprogramming property of deep models and thus may not fully…

机器学习 · 计算机科学 2022-10-28 Qizhou Wang , Feng Liu , Yonggang Zhang , Jing Zhang , Chen Gong , Tongliang Liu , Bo Han

Most deep-learning-based image classification methods assume that all samples are generated under an independent and identically distributed (IID) setting. However, out-of-distribution (OOD) generalization is more common in practice, which…

机器学习 · 计算机科学 2022-02-24 Xin Guo , Zhengxu Yu , Chao Xiang , Zhongming Jin , Jianqiang Huang , Deng Cai , Xiaofei He , Xian-Sheng Hua

Out-of-distribution (OOD) generalization, where the model needs to handle distribution shifts from training, is a major challenge of machine learning. Contrastive language-image pre-training (CLIP) models have shown impressive zero-shot…

机器学习 · 计算机科学 2023-07-17 Yang Shu , Xingzhuo Guo , Jialong Wu , Ximei Wang , Jianmin Wang , Mingsheng Long

We expect the generalization error to improve with more samples from a similar task, and to deteriorate with more samples from an out-of-distribution (OOD) task. In this work, we show a counter-intuitive phenomenon: the generalization error…

机器学习 · 计算机科学 2023-07-20 Ashwin De Silva , Rahul Ramesh , Carey E. Priebe , Pratik Chaudhari , Joshua T. Vogelstein

Out-of-distribution (OOD) detection is essential for ensuring the robustness of machine learning models by identifying samples that deviate from the training distribution. While traditional OOD detection has primarily focused on…

计算机视觉与模式识别 · 计算机科学 2024-11-14 Shawn Li , Huixian Gong , Hao Dong , Tiankai Yang , Zhengzhong Tu , Yue Zhao

Out-of-distribution (OOD) detection is vital to safety-critical machine learning applications and has thus been extensively studied, with a plethora of methods developed in the literature. However, the field currently lacks a unified,…

We present a principled approach for detecting out-of-distribution (OOD) and adversarial samples in deep neural networks. Our approach consists in modeling the outputs of the various layers (deep features) with parametric probability…

机器学习 · 统计学 2019-09-27 Nilesh A. Ahuja , Ibrahima Ndiour , Trushant Kalyanpur , Omesh Tickoo

Detecting deepfakes has become a critical challenge in Computer Vision and Artificial Intelligence. Despite significant progress in detection techniques, generalizing them to open-set scenarios continues to be a persistent difficulty.…

计算机视觉与模式识别 · 计算机科学 2025-06-04 Luca Maiano , Fabrizio Casadei , Irene Amerini

Out-of-distribution (OOD) detection is a critical task to ensure the reliability and security of machine learning models deployed in real-world applications. Conventional methods for OOD detection that rely on single-modal information,…

计算机视觉与模式识别 · 计算机科学 2024-03-21 K Huang , G Song , Hanwen Su , Jiyan Wang

Existing vision-language models exhibit strong generalization on a variety of visual domains and tasks. However, such models mainly perform zero-shot recognition in a closed-set manner, and thus struggle to handle open-domain visual…

计算机视觉与模式识别 · 计算机科学 2024-04-17 Yuhang Zang , Hanlin Goh , Josh Susskind , Chen Huang

Out-of-distribution (OOD) detection is a critical task for safe deployment of learning systems in the open world setting. In this work, we investigate the use of feature density estimation via normalizing flows for OOD detection and present…

计算机视觉与模式识别 · 计算机科学 2024-05-01 Evan D. Cook , Marc-Antoine Lavoie , Steven L. Waslander

Out-of-distribution (OOD) detection is critical for ensuring the reliability of deep learning systems, particularly in safety-critical applications. Likelihood-based deep generative models have historically faced criticism for their…

Recently, learning a model that generalizes well on out-of-distribution (OOD) data has attracted great attention in the machine learning community. In this paper, after defining OOD generalization via Wasserstein distance, we theoretically…

机器学习 · 计算机科学 2021-05-25 Mingyang Yi , Lu Hou , Jiacheng Sun , Lifeng Shang , Xin Jiang , Qun Liu , Zhi-Ming Ma

Deep learning has been demonstrated with tremendous success in recent years. Despite so, its performance in practice often degenerates drastically when encountering out-of-distribution (OoD) data, i.e. training and test data are sampled…

计算机视觉与模式识别 · 计算机科学 2024-10-30 Haoyue Bai

State-of-the-art image classifiers trained on massive datasets (such as ImageNet) have been shown to be vulnerable to a range of both intentional and incidental distribution shifts. On the other hand, several recent classifiers with…

计算机视觉与模式识别 · 计算机科学 2022-06-16 Benjamin Feuer , Ameya Joshi , Chinmay Hegde

Recent studies show that even highly biased dense networks contain an unbiased substructure that can achieve better out-of-distribution (OOD) generalization than the original model. Existing works usually search the invariant subnetwork…

机器学习 · 计算机科学 2022-12-20 Yingchun Wang , Jingcai Guo , Song Guo , Weizhan Zhang , Jie Zhang

Deep models often fail to generalize well in test domains when the data distribution differs from that in the training domain. Among numerous approaches to address this Out-of-Distribution (OOD) generalization problem, there has been a…

机器学习 · 计算机科学 2022-10-14 Qixun Wang , Yifei Wang , Hong Zhu , Yisen Wang

Recent vision-language pre-trained models (VL-PTMs) have shown remarkable success in open-vocabulary tasks. However, downstream use cases often involve further fine-tuning of VL-PTMs, which may distort their general knowledge and impair…

计算机视觉与模式识别 · 计算机科学 2026-05-27 Lin Zhu , Yifeng Yang , Qinying Gu , Xinbing Wang , Chenghu Zhou , Nanyang Ye

This paper presents a principled approach for detecting out-of-distribution (OOD) samples in deep neural networks (DNN). Modeling probability distributions on deep features has recently emerged as an effective, yet computationally cheap…

机器学习 · 计算机科学 2020-12-09 Ibrahima Ndiour , Nilesh Ahuja , Omesh Tickoo