English
Related papers

Related papers: U-CE: Uncertainty-aware Cross-Entropy for Semantic…

200 papers

Time series forecasting is an important task that involves analyzing temporal dependencies and underlying patterns (such as trends, cyclicality, and seasonality) in historical data to predict future values or trends. Current deep…

Machine Learning · Computer Science 2025-12-01 Jieting Wang , Huimei Shi , Feijiang Li , Xiaolei Shang

Accurate brain image segmentation, particularly for distinguishing various tissues from magnetic resonance imaging (MRI) images, plays a pivotal role in finding the neurological dis ease and medical image computing. In deep learning…

Computer Vision and Pattern Recognition · Computer Science 2026-04-21 Hanuman Verma , Akshansh Gupta , Pranabesh Maji , Saurav Mandal , Vijay Kumar Pandey

Neural networks are often overconfident about their predictions, which undermines their reliability and trustworthiness. In this work, we present a novel technique, named Error-Driven Uncertainty Aware Training (EUAT), which aims to enhance…

Machine Learning · Computer Science 2024-09-12 Pedro Mendes , Paolo Romano , David Garlan

Cross-entropy (CE) loss is the de-facto standard for training deep neural networks to perform classification. However, CE-trained deep neural networks struggle with robustness and generalisation issues. To alleviate these issues, we propose…

Machine Learning · Computer Science 2025-01-22 Michael W. Spratling , Heiko H. Schütt

Deep convolutional neural networks have been proven to be very effective in image related analysis and tasks, such as image segmentation, image classification, image generation, etc. Recently many sophisticated CNN based architectures have…

Image and Video Processing · Electrical Eng. & Systems 2020-05-12 Eshal Zahra , Bostan Ali , Wajahat Siddique

Brain vessel segmentation of MR scans is a critical step in the diagnosis of cerebrovascular diseases. Due to the fine vessel structure, manual vessel segmentation is time consuming. Therefore, automatic deep learning (DL) based…

Image and Video Processing · Electrical Eng. & Systems 2025-03-31 Omini Rathore , Richard Paul , Abigail Morrison , Hanno Scharr , Elisabeth Pfaehler

Cross Entropy (CE) has an important role in machine learning and, in particular, in neural networks. It is commonly used in neural networks as the cost between the known distribution of the label and the Softmax/Sigmoid output. In this…

Machine Learning · Computer Science 2020-07-17 Ron Shoham , Haim Permuter

In this paper, we revisit techniques for uncertainty estimation within deep neural networks and consolidate a suite of techniques to enhance their reliability. Our investigation reveals that an integrated application of diverse…

Computer Vision and Pattern Recognition · Computer Science 2024-03-04 Yuting Li , Yingyi Chen , Xuanlong Yu , Dexiong Chen , Xi Shen

Deep neural networks have achieved outstanding performance over various tasks, but they have a critical issue: over-confident predictions even for completely unknown samples. Many studies have been proposed to successfully filter out these…

Computer Vision and Pattern Recognition · Computer Science 2023-08-02 Jihyo Kim , Jiin Koo , Sangheum Hwang

We present a deep learning framework for probabilistic pixel-wise semantic segmentation, which we term Bayesian SegNet. Semantic segmentation is an important tool for visual scene understanding and a meaningful measure of uncertainty is…

Computer Vision and Pattern Recognition · Computer Science 2016-10-12 Alex Kendall , Vijay Badrinarayanan , Roberto Cipolla

Knowledge about historic landslide event occurrence is important for supporting disaster risk reduction strategies. Building upon findings from 2022 Landslide4Sense Competition, we propose a deep neural network based system for landslide…

Computer Vision and Pattern Recognition · Computer Science 2023-12-29 Cam Le , Lam Pham , Jasmin Lampert , Matthias Schlögl , Alexander Schindler

Deep Neural Networks (DNNs) have achieved remarkable success in a variety of tasks, especially when it comes to prediction accuracy. However, in complex real-world scenarios, particularly in safety-critical applications, high accuracy alone…

Artificial Intelligence · Computer Science 2024-05-31 Han Liu , Peng Cui , Bingning Wang , Jun Zhu , Xiaolin Hu

This work proposes a novel framework, Uncertainty-Guided Cross Attention Ensemble Mean Teacher (UG-CEMT), for achieving state-of-the-art performance in semi-supervised medical image segmentation. UG-CEMT leverages the strengths of…

Computer Vision and Pattern Recognition · Computer Science 2024-12-23 Meghana Karri , Amit Soni Arya , Koushik Biswas , Nicol`o Gennaro , Vedat Cicek , Gorkem Durak , Yuri S. Velichko , Ulas Bagci

Deep Ensembles (DE) are a prominent approach for achieving excellent performance on key metrics such as accuracy, calibration, uncertainty estimation, and out-of-distribution detection. However, hardware limitations of real-world systems…

Neural networks predictions are unreliable when the input sample is out of the training distribution or corrupted by noise. Being able to detect such failures automatically is fundamental to integrate deep learning algorithms into robotics.…

Computer Vision and Pattern Recognition · Computer Science 2020-02-18 Antonio Loquercio , Mattia Segù , Davide Scaramuzza

Deep neural networks (NNs) are powerful black box predictors that have recently achieved impressive performance on a wide spectrum of tasks. Quantifying predictive uncertainty in NNs is a challenging and yet unsolved problem. Bayesian NNs,…

Machine Learning · Statistics 2017-11-07 Balaji Lakshminarayanan , Alexander Pritzel , Charles Blundell

Assessing disease severity with ordinal classes, where each class reflects increasing severity levels, benefits from loss functions designed for this ordinal structure. Traditional categorical loss functions, like Cross-Entropy (CE), often…

Computer Vision and Pattern Recognition · Computer Science 2025-01-14 Gorkem Polat , Ümit Mert Çağlar , Alptekin Temizel

Reliably assessing model confidence in deep learning and predicting errors likely to be made are key elements in providing safety for model deployment, in particular for applications with dire consequences. In this paper, it is first shown…

Machine Learning · Computer Science 2020-10-21 Theodoros Tsiligkaridis

Ensembling a neural network is a widely recognized approach to enhance model performance, estimate uncertainty, and improve robustness in deep supervised learning. However, deep ensembles often come with high computational costs and memory…

Deep neural networks lack interpretability and tend to be overconfident, which poses a serious problem in safety-critical applications like autonomous driving, medical imaging, or machine vision tasks with high demands on reliability.…

Computer Vision and Pattern Recognition · Computer Science 2024-03-27 Steven Landgraf , Kira Wursthorn , Markus Hillemann , Markus Ulrich