中文
相关论文

相关论文: Improving Explainability of Softmax Classifiers Us…

200 篇论文

Out-of-distribution (OOD) detection is essential for ensuring the robustness of machine learning models by identifying samples that deviate from the training distribution. While traditional OOD detection has primarily focused on…

计算机视觉与模式识别 · 计算机科学 2024-11-14 Shawn Li , Huixian Gong , Hao Dong , Tiankai Yang , Zhengzhong Tu , Yue Zhao

Deep learning models are increasingly deployed in safety-critical applications, where reliable out-of-distribution (OOD) detection is essential to ensure robustness. Existing methods predominantly rely on the penultimate-layer activations…

计算机视觉与模式识别 · 计算机科学 2026-05-13 Shreen Gul , Mohamed Elmahallawy , Ardhendu Tripathy , Sanjay Madria

Data often are formed of multiple modalities, which jointly describe the observed phenomena. Modeling the joint distribution of multimodal data requires larger expressive power to capture high-level concepts and provide better data…

机器学习 · 计算机科学 2020-09-09 Sasho Nedelkoski , Mihail Bogojeski , Odej Kao

Robustness to out-of-distribution (OOD) data is an important goal in building reliable machine learning systems. Especially in autonomous systems, wrong predictions for OOD inputs can cause safety critical situations. As a first step…

机器学习 · 计算机科学 2020-04-17 Andreas Sedlmeier , Thomas Gabor , Thomy Phan , Lenz Belzner , Claudia Linnhoff-Popien

Deep neural networks suffer from the overconfidence issue in the open world, meaning that classifiers could yield confident, incorrect predictions for out-of-distribution (OOD) samples. Thus, it is an urgent and challenging task to detect…

计算机视觉与模式识别 · 计算机科学 2022-04-12 Qiuyu Zhu , Guohui Zheng , Yingying Yan

In this paper, we present a novel approach that combines deep metric learning and synthetic data generation using diffusion models for out-of-distribution (OOD) detection. One popular approach for OOD detection is outlier exposure, where…

计算机视觉与模式识别 · 计算机科学 2024-05-02 Assefa Seyoum Wahd

Out-of-distribution (OOD) object detection is a challenging task due to the absence of open-set OOD data. Inspired by recent advancements in text-to-image generative models, such as Stable Diffusion, we study the potential of generative…

计算机视觉与模式识别 · 计算机科学 2024-09-10 Jiahui Liu , Xin Wen , Shizhen Zhao , Yingxian Chen , Xiaojuan Qi

The softmax function combined with a cross-entropy loss is a principled approach to modeling probability distributions that has become ubiquitous in deep learning. The softmax function is defined by a lone hyperparameter, the temperature,…

机器学习 · 计算机科学 2020-10-16 Atish Agarwala , Jeffrey Pennington , Yann Dauphin , Sam Schoenholz

Deep learning has shown to have great potential in medical applications. In critical domains as such, it is of high interest to have trustworthy algorithms which are able to tell when reliable assessments cannot be guaranteed. Detecting…

计算机视觉与模式识别 · 计算机科学 2024-03-01 Jennie Karlsson , Marisa Wodrich , Niels Christian Overgaard , Freja Sahlin , Kristina Lång , Anders Heyden , Ida Arvidsson

Learning distributed representations, or embeddings, that encode the relational similarity patterns among objects is a relevant task in machine learning. A popular method to learn the embedding matrices $X, Y$ is optimizing a loss function…

机器学习 · 计算机科学 2025-06-03 Lorenzo Dall'Amico , Enrico Maria Belliardo

We present a latent variable model for classification that provides a novel probabilistic interpretation of neural network softmax classifiers. We derive a variational objective to train the model, analogous to the evidence lower bound…

机器学习 · 计算机科学 2024-01-10 Shehzaad Dhuliawala , Mrinmaya Sachan , Carl Allen

Out-of-Distribution (OOD) detection, i.e., identifying whether an input is sampled from a novel distribution other than the training distribution, is a critical task for safely deploying machine learning systems in the open world. Recently,…

机器学习 · 计算机科学 2023-01-13 Feng Xue , Zi He , Chuanlong Xie , Falong Tan , Zhenguo Li

Uncertainty estimation aims to evaluate the confidence of a trained deep neural network. However, existing uncertainty estimation approaches rely on low-dimensional distributional assumptions and thus suffer from the high dimensionality of…

机器学习 · 计算机科学 2023-10-26 Tsai Hor Chan , Kin Wai Lau , Jiajun Shen , Guosheng Yin , Lequan Yu

In classification tasks, softmax functions are ubiquitously used as output activations to produce predictive probabilities. Such outputs only capture aleatoric uncertainty. To capture epistemic uncertainty, approximate Gaussian inference…

机器学习 · 计算机科学 2026-02-12 Bálint Mucsányi , Nathaël Da Costa , Philipp Hennig

Neural networks (NNs) are widely used for object classification in autonomous driving. However, NNs can fail on input data not well represented by the training dataset, known as out-of-distribution (OOD) data. A mechanism to detect OOD…

计算机视觉与模式识别 · 计算机科学 2021-09-07 Julia Nitsch , Masha Itkina , Ransalu Senanayake , Juan Nieto , Max Schmidt , Roland Siegwart , Mykel J. Kochenderfer , Cesar Cadena

Commonly used AI networks are very self-confident in their predictions, even when the evidence for a certain decision is dubious. The investigation of a deep learning model output is pivotal for understanding its decision processes and…

计算机视觉与模式识别 · 计算机科学 2022-11-08 Damian Matuszewski , Ida-Maria Sintorn

Metric learning aims at learning a distance which is consistent with the semantic meaning of the samples. The problem is generally solved by learning an embedding for each sample such that the embeddings of samples of the same category are…

机器学习 · 计算机科学 2018-09-13 Xu Zhang , Felix Xinnan Yu , Svebor Karaman , Wei Zhang , Shih-Fu Chang

Current state-of-the-art approaches to text classification typically leverage BERT-style Transformer models with a softmax classifier, jointly fine-tuned to predict class labels of a target task. In this paper, we instead propose an…

计算与语言 · 计算机科学 2022-12-02 Kishaloy Halder , Josip Krapac , Alan Akbik , Anthony Brew , Matti Lyra

When presented with Out-of-Distribution (OOD) examples, deep neural networks yield confident, incorrect predictions. Detecting OOD examples is challenging, and the potential risks are high. In this paper, we propose to detect OOD examples…

机器学习 · 计算机科学 2020-01-10 Chandramouli Shama Sastry , Sageev Oore

Implementing effective control mechanisms to ensure the proper functioning and security of deployed NLP models, from translation to chatbots, is essential. A key ingredient to ensure safe system behaviour is Out-Of-Distribution (OOD)…

计算与语言 · 计算机科学 2024-03-04 Maxime Darrin , Pablo Piantanida , Pierre Colombo