中文
相关论文

相关论文: Improving Explainability of Softmax Classifiers Us…

200 篇论文

Out-of-distribution (OOD) detection aims to detect testing samples far away from the in-distribution (ID) training data, which is crucial for the safe deployment of machine learning models in the real world. Distance-based OOD detection…

机器学习 · 计算机科学 2024-02-06 Haodong Lu , Dong Gong , Shuo Wang , Jason Xue , Lina Yao , Kristen Moore

The ability to detect Out-of-Domain (OOD) inputs has been a critical requirement in many real-world NLP applications. For example, intent classification in dialogue systems. The reason is that the inclusion of unsupported OOD inputs may…

计算与语言 · 计算机科学 2022-01-20 Iftitahu Ni'mah , Meng Fang , Vlado Menkovski , Mykola Pechenizkiy

Many methods have been proposed to quantify the predictive uncertainty associated with the outputs of deep neural networks. Among them, ensemble methods often lead to state-of-the-art results, though they require modifications to the…

机器学习 · 计算机科学 2021-05-11 Zhiyun Lu , Eugene Ie , Fei Sha

Trained neural networks (NN) are attractive as surrogate models to replace costly calculations in physical simulations, but are often unknowingly applied to states not adequately represented in the training dataset. We present the novel…

机器学习 · 计算机科学 2024-12-05 Casey Lauer , Robert C. Blake , Jonathan B. Freund

Deep learning methods have boosted the adoption of NLP systems in real-life applications. However, they turn out to be vulnerable to distribution shifts over time which may cause severe dysfunctions in production systems, urging…

计算与语言 · 计算机科学 2022-11-28 Pierre Colombo , Eduardo D. C. Gomes , Guillaume Staerman , Nathan Noiry , Pablo Piantanida

When neural networks are employed for high-stakes decision-making, it is desirable that they provide explanations for their prediction in order for us to understand the features that have contributed to the decision. At the same time, it is…

机器学习 · 计算机科学 2022-05-10 Penny Chong , Ngai-Man Cheung , Yuval Elovici , Alexander Binder

We consider the two related problems of detecting if an example is misclassified or out-of-distribution. We present a simple baseline that utilizes probabilities from softmax distributions. Correctly classified examples tend to have greater…

神经与进化计算 · 计算机科学 2018-10-04 Dan Hendrycks , Kevin Gimpel

Out-of-distribution (OOD) detection is the task of identifying inputs that deviate from the training data distribution. This capability is essential for safely deploying deep computer vision models in open-world environments. In this work,…

计算机视觉与模式识别 · 计算机科学 2025-03-25 Wenxi Chen , Raymond A. Yeh , Shaoshuai Mou , Yan Gu

Recently, the robustness of deep learning models has received widespread attention, and various methods for improving model robustness have been proposed, including adversarial training, model architecture modification, design of loss…

机器学习 · 计算机科学 2023-03-23 Hao Wang , Chen Li , Jinzhe Jiang , Xin Zhang , Yaqian Zhao , Weifeng Gong

This paper deals with uncertainty quantification and out-of-distribution detection in deep learning using Bayesian and ensemble methods. It proposes a practical solution to the lack of prediction diversity observed recently for standard…

机器学习 · 计算机科学 2025-02-03 Antoine de Mathelin , François Deheeger , Mathilde Mougeot , Nicolas Vayatis

Out-of-distribution (OOD) detection is an indispensable aspect of secure AI when deploying machine learning models in real-world applications. Previous paradigms either explore better scoring functions or utilize the knowledge of outliers…

机器学习 · 计算机科学 2023-06-07 Jianing Zhu , Hengzhuang Li , Jiangchao Yao , Tongliang Liu , Jianliang Xu , Bo Han

Machine learning models, while progressively advanced, rely heavily on the IID assumption, which is often unfulfilled in practice due to inevitable distribution shifts. This renders them susceptible and untrustworthy for deployment in…

机器学习 · 计算机科学 2024-03-05 Han Yu , Jiashuo Liu , Xingxuan Zhang , Jiayun Wu , Peng Cui

Deploying machine learning models in safety-related do-mains (e.g. autonomous driving, medical diagnosis) demands for approaches that are explainable, robust against adversarial attacks and aware of the model uncertainty. Recent deep…

计算机视觉与模式识别 · 计算机科学 2020-12-14 Jan Kronenberger , Anselm Haselhoff

The Softmax bottleneck was first identified in language modeling as a theoretical limit on the expressivity of Softmax-based models. Being one of the most widely-used methods to output probability, Softmax-based models have found a wide…

机器学习 · 计算机科学 2021-10-12 Ying-Chen Lin

Reliable out-of-distribution (OOD) detection is important for safe deployment of deep learning models in fetal ultrasound amidst heterogeneous image characteristics and clinical settings. OOD detection relies on estimating a classification…

计算机视觉与模式识别 · 计算机科学 2025-09-24 Chun Kit Wong , Anders N. Christensen , Cosmin I. Bercea , Julia A. Schnabel , Martin G. Tolsgaard , Aasa Feragen

Most existing methods of Out-of-Domain (OOD) intent classification rely on extensive auxiliary OOD corpora or specific training paradigms. However, they are underdeveloped in the underlying principle that the models should have…

计算与语言 · 计算机科学 2024-04-25 Yunhua Zhou , Pengyu Wang , Peiju Liu , Yuxin Wang , Xipeng Qiu

Out-of-distribution (OOD) detection is a crucial task for ensuring the reliability and safety of deep learning. Currently, discriminator models outperform other methods in this regard. However, the feature extraction process used by…

计算机视觉与模式识别 · 计算机科学 2023-06-06 Luping Liu , Yi Ren , Xize Cheng , Rongjie Huang , Chongxuan Li , Zhou Zhao

The distribution of a neural network's latent representations has been successfully used to detect out-of-distribution (OOD) data. This work investigates whether this distribution moreover correlates with a model's epistemic uncertainty,…

Detecting out-of-distribution (OOD) examples is critical in many applications. We propose an unsupervised method to detect OOD samples using a $k$-NN density estimate with respect to a classification model's intermediate activations on…

机器学习 · 计算机科学 2021-02-11 Dara Bahri , Heinrich Jiang , Yi Tay , Donald Metzler

Out-of-distribution (OOD) detection is important for deploying machine learning models in the real world, where test data from shifted distributions can naturally arise. While a plethora of algorithmic approaches have recently emerged for…

机器学习 · 计算机科学 2021-12-03 Peyman Morteza , Yixuan Li