English
Related papers

Related papers: U-CE: Uncertainty-aware Cross-Entropy for Semantic…

200 papers

In the context of adversarial robustness, a single model does not usually have enough power to defend against all possible adversarial attacks, and as a result, has sub-optimal robustness. Consequently, an emerging line of work has focused…

Machine Learning · Computer Science 2022-06-08 Dinghuai Zhang , Hongyang Zhang , Aaron Courville , Yoshua Bengio , Pradeep Ravikumar , Arun Sai Suggala

Automated medical image segmentation is an important step in many medical procedures. Recently, deep learning networks have been widely used for various medical image segmentation tasks, with U-Net and generative adversarial nets (GANs)…

Image and Video Processing · Electrical Eng. & Systems 2020-01-09 Balamurali Murugesan , Kaushik Sarveswaran , Vijaya Raghavan S , Sharath M Shankaranarayana , Keerthi Ram , Mohanasankar Sivaprakasam

Reliable scene understanding is indispensable for modern autonomous systems. Current learning-based methods typically try to maximize their performance based on segmentation metrics that only consider the quality of the segmentation.…

Computer Vision and Pattern Recognition · Computer Science 2022-12-27 Kshitij Sirohi , Sajad Marvi , Daniel Büscher , Wolfram Burgard

The inability to guarantee robustness is one of the major obstacles to the application of deep learning models in security-demanding domains. We identify that the most commonly used cross-entropy (CE) loss does not guarantee robust boundary…

Machine Learning · Computer Science 2023-02-21 Weiwei Gao , Dazhi Zhang , Yao Li , Zhichang Guo , Ovanes Petrosian

Assessing the predictive uncertainty of deep neural networks is crucial for safety-related applications of deep learning. Although Bayesian deep learning offers a principled framework for estimating model uncertainty, the common approaches…

Machine Learning · Computer Science 2024-03-06 Yookoon Park , David M. Blei

Up-to-date sea ice charts are crucial for safer navigation in ice-infested waters. Recently, Convolutional Neural Network (CNN) models show the potential to accelerate the generation of ice maps for large regions. However, results from CNN…

Computer Vision and Pattern Recognition · Computer Science 2023-10-27 Rafael Pires de Lima , Behzad Vahedi , Morteza Karimzadeh

Due to the importance of uncertainty quantification (UQ), Bayesian approach to inverse problems has recently gained popularity in applied mathematics, physics, and engineering. However, traditional Bayesian inference methods based on Markov…

Computation · Statistics 2022-04-26 Shiwei Lan , Shuyi Li , Babak Shahbaba

This paper investigates the deep learning optimization problem with softmax cross-entropy loss. We propose a layer separation strategy to alleviate the strong nonconvexity encountered during training deep networks. For cross-entropy models…

Machine Learning · Computer Science 2026-04-28 Yaru Liu , Michael K. Ng , Yiqi Gu

Brain lesion and anatomy segmentation in magnetic resonance images are fundamental tasks in neuroimaging research and clinical practice. Given enough training data, convolutional neuronal networks (CNN) proved to outperform all existent…

Computer Vision and Pattern Recognition · Computer Science 2019-04-16 Nicolas Roulet , Diego Fernandez Slezak , Enzo Ferrante

Collecting labeled data for the task of semantic segmentation is expensive and time-consuming, as it requires dense pixel-level annotations. While recent Convolutional Neural Network (CNN) based semantic segmentation approaches have…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Xiangyun Zhao , Raviteja Vemulapalli , Philip Mansfield , Boqing Gong , Bradley Green , Lior Shapira , Ying Wu

With the wide development of black-box machine learning algorithms, particularly deep neural network (DNN), the practical demand for the reliability assessment is rapidly rising. On the basis of the concept that `Bayesian deep learning…

Computer Vision and Pattern Recognition · Computer Science 2019-04-19 Kenta Hama , Takashi Matsubara , Kuniaki Uehara , Jianfei Cai

Bayesian Neural Networks (BNNs) offer a principled and natural framework for proper uncertainty quantification in the context of deep learning. They address the typical challenges associated with conventional deep learning methods, such as…

Computation · Statistics 2024-11-13 Zahra Moslemi , Yang Meng , Shiwei Lan , Babak Shahbaba

We introduce Bayesian QuickNAT for the automated quality control of whole-brain segmentation on MRI T1 scans. Next to the Bayesian fully convolutional neural network, we also present inherent measures of segmentation uncertainty that allow…

Computer Vision and Pattern Recognition · Computer Science 2018-11-27 Abhijit Guha Roy , Sailesh Conjeti , Nassir Navab , Christian Wachinger

State-of-the-art deep neural networks have proven to be highly powerful in a broad range of tasks, including semantic image segmentation. However, these networks are vulnerable against adversarial attacks, i.e., non-perceptible…

Computer Vision and Pattern Recognition · Computer Science 2025-11-27 Kira Maag , Asja Fischer

The requirement to generate robust robotic platforms is a critical enabling step to allow such platforms to permeate safety-critical applications (i.e., the localization of autonomous platforms in urban environments). One of the primary…

Signal Processing · Electrical Eng. & Systems 2019-08-14 Ryan M. Watson , Jason N. Gross , Clark N. Taylor , Robert C. Leishman

Estimated uncertainty by approximate posteriors in Bayesian neural networks are prone to miscalibration, which leads to overconfident predictions in critical tasks that have a clear asymmetric cost or significant losses. Here, we extend the…

Machine Learning · Computer Science 2022-06-17 Biraja Ghoshal , Allan Tucker

Deep Learning-based image super-resolution (SR) has been gaining traction with the aid of Generative Adversarial Networks. Models like SRGAN and ESRGAN are constantly ranked between the best image SR tools. However, they lack principled…

Image and Video Processing · Electrical Eng. & Systems 2024-12-23 Maniraj Sai Adapa , Marco Zullich , Matias Valdenegro-Toro

Soft targets combined with the cross-entropy loss have shown to improve generalization performance of deep neural networks on supervised classification tasks. The standard cross-entropy loss however assumes data to be categorically…

Machine Learning · Computer Science 2024-07-16 Johannes Hugger , Virginie Uhlmann

Accurate Defect detection is crucial for ensuring the trustworthiness of intelligent railway systems. Current approaches rely on single deep-learning models, like CNNs, which employ a large amount of data to capture underlying patterns.…

Computer Vision and Pattern Recognition · Computer Science 2023-11-28 Rahatara Ferdousi , Fedwa Laamarti , Chunsheng Yang , Abdulmotaleb El Saddik

Scene understanding of high resolution aerial images is of great importance for the task of automated monitoring in various remote sensing applications. Due to the large within-class and small between-class variance in pixel values of…

Computer Vision and Pattern Recognition · Computer Science 2020-02-28 Foivos I. Diakogiannis , François Waldner , Peter Caccetta , Chen Wu