English
Related papers

Related papers: U-CE: Uncertainty-aware Cross-Entropy for Semantic…

200 papers

Deep neural network models can learn clinically relevant features from millions of histopathology images. However generating high-quality annotations to train such models for each hospital, each cancer type, and each diagnostic task is…

Vessel segmentation and centerline extraction are two crucial preliminary tasks for many computer-aided diagnosis tools dealing with vascular diseases. Recently, deep-learning based methods have been widely applied to these tasks. However,…

Image and Video Processing · Electrical Eng. & Systems 2024-02-23 Pierre Rougé , Nicolas Passat , Odyssée Merveille

Recent advancements in discrete image generation showed that scaling the VQ codebook size significantly improves reconstruction fidelity. However, training generative models with a large VQ codebook remains challenging, typically requiring…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Shufan Li , Jiuxiang Gu , Kangning Liu , Zhe Lin , Aditya Grover , Jason Kuen

Deep learning models frequently make incorrect predictions with high confidence when presented with test examples that are not well represented in their training dataset. We propose a novel and straightforward approach to estimate…

Machine Learning · Computer Science 2019-10-04 Tiago Ramalho , Miguel Miranda

Although the recent progress is substantial, deep learning methods can be vulnerable to the maliciously generated adversarial examples. In this paper, we present a novel training procedure and a thresholding test strategy, towards robust…

Machine Learning · Computer Science 2018-11-08 Tianyu Pang , Chao Du , Yinpeng Dong , Jun Zhu

A novel method for tackling the problem of imbalanced data in medical image segmentation is proposed in this work. In balanced cross entropy (CE) loss, which is a type of weighted CE loss, the weight assigned to each class is the in-verse…

Image and Video Processing · Electrical Eng. & Systems 2024-12-10 Seyed Mohsen Hosseini , Mahdieh Soleymani Baghshah

We introduce Multi-Frame Cross-Entropy training (MFCE) for convolutional neural network acoustic models. Recognizing that similar to RNNs, CNNs are in nature sequence models that take variable length inputs, we propose to take as input to…

Audio and Speech Processing · Electrical Eng. & Systems 2019-08-01 Tom Sercu , Neil Mallinar

When employing deep neural networks (DNNs) for semantic segmentation in safety-critical applications like automotive perception or medical imaging, it is important to estimate their performance at runtime, e.g. via uncertainty estimates or…

Computer Vision and Pattern Recognition · Computer Science 2024-09-18 Edgar Heinert , Stephan Tilgner , Timo Palm , Matthias Rottmann

Current deep learning solutions are well known for not informing whether they can reliably classify an example during inference. One of the most effective ways to build more reliable deep learning solutions is to improve their performance…

Machine Learning · Computer Science 2022-08-09 David Macêdo

Recent efforts in deploying Deep Neural Networks for object detection in real world applications, such as autonomous driving, assume that all relevant object classes have been observed during training. Quantifying the performance of these…

Computer Vision and Pattern Recognition · Computer Science 2021-11-29 Yimeng Li , Jana Kosecka

Recently, deep neural networks have expanded the state-of-art in various scientific fields and provided solutions to long standing problems across multiple application domains. Nevertheless, they also suffer from weaknesses since their…

Machine Learning · Computer Science 2023-05-03 Felipe Kenji Nakano , Konstantinos Pliakos , Celine Vens

Deep learning models (DLMs) frequently achieve accurate segmentation and classification of tumors from medical images. However, DLMs lacking feedback on their image segmentation mechanisms, such as Dice coefficients and confidence in their…

Image and Video Processing · Electrical Eng. & Systems 2024-12-31 Elhoucine Elfatimi , Pratik Shah

Existing methods for estimating uncertainty in deep learning tend to require multiple forward passes, making them unsuitable for applications where computational resources are limited. To solve this, we perform probabilistic reasoning over…

Machine Learning · Statistics 2020-12-08 Javier Antorán , James Urquhart Allingham , José Miguel Hernández-Lobato

Standard cross-entropy is the default classification loss across virtually all of machine learning, yet it treats all misclassifications equally, ignoring the semantic distances that a class hierarchy encodes. We propose Hierarchy-Aware…

Machine Learning · Computer Science 2026-05-08 April Chan , Davide D'Ascenzo , Sebastiano Cultrera di Montesano

In this paper, we propose a novel method, aggregation cross-entropy (ACE), for sequence recognition from a brand new perspective. The ACE loss function exhibits competitive performance to CTC and the attention mechanism, with much quicker…

Computer Vision and Pattern Recognition · Computer Science 2019-04-19 Zecheng Xie , Yaoxiong Huang , Yuanzhi Zhu , Lianwen Jin , Yuliang Liu , Lele Xie

Learning-based techniques have become popular in both model predictive control (MPC) and reinforcement learning (RL). Probabilistic ensemble (PE) models offer a promising approach for modelling system dynamics, showcasing the ability to…

Machine Learning · Computer Science 2024-05-07 Yuan Zhang , Jasper Hoffmann , Joschka Boedecker

In medical image segmentation tasks, the scarcity of labeled training data poses a significant challenge when training deep neural networks. When using U-Net-style architectures, it is common practice to address this problem by pretraining…

Computer Vision and Pattern Recognition · Computer Science 2025-06-09 Gábor Hidy , Bence Bakos , András Lukács

Modern deep neural networks achieved remarkable progress in medical image segmentation tasks. However, it has recently been observed that they tend to produce overconfident estimates, even in situations of high uncertainty, leading to…

Computer Vision and Pattern Recognition · Computer Science 2023-06-05 Agostina Larrazabal , Cesar Martinez , Jose Dolz , Enzo Ferrante

Despite the power of deep neural networks for a wide range of tasks, an overconfident prediction issue has limited their practical use in many safety-critical applications. Many recent works have been proposed to mitigate this issue, but…

Machine Learning · Computer Science 2020-08-14 Jooyoung Moon , Jihyo Kim , Younghak Shin , Sangheum Hwang

Purpose: The localisation and segmentation of individual bones is an important preprocessing step in many planning and navigation applications. It is, however, a time-consuming and repetitive task if done manually. This is true not only for…

Image and Video Processing · Electrical Eng. & Systems 2022-08-22 Eva Schnider , Antal Huck , Mireille Toranelli , Georg Rauter , Azhar Zam , Magdalena Müller-Gerbl , Philippe Cattin