English
Related papers

Related papers: Uncertainty Estimation by Fisher Information-based…

200 papers

Deep neural networks (DNNs) have made a revolution in numerous fields during the last decade. However, in tasks with high safety requirements, such as medical or autonomous driving applications, providing an assessment of the models…

Machine Learning · Computer Science 2020-11-20 Omer Achrack , Raizy Kellerman , Ouriel Barzilay

We propose UAPAR, an Uncertainty-Aware Pedestrian Attribute Recognition framework. To the best of our knowledge, this is the first EDL-based uncertainty-aware framework for pedestrian attribute recognition (PAR). Unlike conventional…

Computer Vision and Pattern Recognition · Computer Science 2026-04-30 Zhuofan Lou , Shihang Zhang , Fangle Zhu , Shengjie Ye , Pingyu Wang

Deterministic neural networks (NNs) are increasingly being deployed in safety critical domains, where calibrated, robust, and efficient measures of uncertainty are crucial. In this paper, we propose a novel method for training non-Bayesian…

Machine Learning · Computer Science 2020-11-25 Alexander Amini , Wilko Schwarting , Ava Soleimany , Daniela Rus

In modern federated learning, one of the main challenges is to account for inherent heterogeneity and the diverse nature of data distributions for different clients. This problem is often addressed by introducing personalization of the…

Machine Learning · Statistics 2023-12-19 Nikita Kotelevskii , Samuel Horváth , Karthik Nandakumar , Martin Takáč , Maxim Panov

A set of novel approaches for estimating epistemic uncertainty in deep neural networks with a single forward pass has recently emerged as a valid alternative to Bayesian Neural Networks. On the premise of informative representations, these…

Computer Vision and Pattern Recognition · Computer Science 2022-07-06 Janis Postels , Mattia Segu , Tao Sun , Luca Sieber , Luc Van Gool , Fisher Yu , Federico Tombari

The transductive inference is an effective technique in the few-shot learning task, where query sets update prototypes to improve themselves. However, these methods optimize the model by considering only the classification scores of the…

Computer Vision and Pattern Recognition · Computer Science 2022-05-18 Minglei Yuan , Qian Xu , Chunhao Cai , Yin-Dong Zheng , Tao Wang , Tong Lu

Self-training is a powerful approach to deep learning. The key process is to find a pseudo-label for modeling. However, previous self-training algorithms suffer from the over-confidence issue brought by the hard labels, even some…

Computer Vision and Pattern Recognition · Computer Science 2024-05-03 Zijia Wang , Wenbin Yang , Zhisong Liu , Zhen Jia

Brain vessel segmentation of MR scans is a critical step in the diagnosis of cerebrovascular diseases. Due to the fine vessel structure, manual vessel segmentation is time consuming. Therefore, automatic deep learning (DL) based…

Image and Video Processing · Electrical Eng. & Systems 2025-03-31 Omini Rathore , Richard Paul , Abigail Morrison , Hanno Scharr , Elisabeth Pfaehler

We present a novel class of Physics-Informed Neural Networks that is formulated based on the principles of Evidential Deep Learning, where the model incorporates uncertainty quantification by learning parameters of a higher-order…

Machine Learning · Computer Science 2025-01-28 Hai Siong Tan , Kuancheng Wang , Rafe McBeth

Uncertainty quantification is an important part of many performance critical applications. This paper provides a simple alternative to existing approaches such as ensemble learning and bayesian neural networks. By directly modeling the loss…

Machine Learning · Computer Science 2024-08-28 Yi Hung Lim

Few-Shot Classification(FSC) aims to generalize from base classes to novel classes given very limited labeled samples, which is an important step on the path toward human-like machine learning. State-of-the-art solutions involve learning to…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Xiongkun Linghu , Yan Bai , Yihang Lou , Shengsen Wu , Jinze Li , Jianzhong He , Tao Bai

Existing methods for estimating uncertainty in deep learning tend to require multiple forward passes, making them unsuitable for applications where computational resources are limited. To solve this, we perform probabilistic reasoning over…

Machine Learning · Statistics 2020-12-08 Javier Antorán , James Urquhart Allingham , José Miguel Hernández-Lobato

Pretrained models have become standard in both vision and language, yet they typically do not provide reliable measures of confidence. Existing uncertainty estimation methods, such as deep ensembles and MC dropout, are often too…

Machine Learning · Computer Science 2026-04-13 Yongchan Chun , Chanhee Park , Jeongho Yoon , Jaehyung Seo , Heuiseok Lim

Obtaining labels can be costly and time-consuming. Active learning allows a learning algorithm to intelligently query samples to be labeled for efficient learning. Fisher information ratio (FIR) has been used as an objective for selecting…

Machine Learning · Statistics 2016-10-18 Jamshid Sourati , Murat Akcakaya , Todd K. Leen , Deniz Erdogmus , Jennifer G. Dy

Fisher information and Shannon entropy are fundamental tools for understanding and analyzing dynamical systems from complementary perspectives. They can characterize unknown parameters by quantifying the information contained in variables,…

Information Theory · Computer Science 2025-12-19 Yuxuan Bao , J. Nathan Kutz

Advanced Persistent Threats (APTs) represent a significant challenge in cybersecurity due to their prolonged, multi-stage nature and the sophistication of their operators. Traditional detection systems typically focus on identifying…

Cryptography and Security · Computer Science 2025-08-04 Alessandro Gaudenzi , Lorenzo Nodari , Lance Kaplan , Alessandra Russo , Murat Sensoy , Federico Cerutti

Deep learning has achieved impressive performance on many tasks in recent years. However, it has been found that it is still not enough for deep neural networks to provide only point estimates. For high-risk tasks, we need to assess the…

Machine Learning · Computer Science 2021-04-28 Yuandu Lai , Yucheng Shi , Yahong Han , Yunfeng Shao , Meiyu Qi , Bingshuai Li

There is significant need for principled uncertainty reasoning in machine learning systems as they are increasingly deployed in safety-critical domains. A new approach with uncertainty-aware neural networks (NNs), based on learning…

Machine Learning · Computer Science 2022-02-25 Nis Meinert , Alexander Lavin

Emotion recognition is a key attribute for artificial intelligence systems that need to naturally interact with humans. However, the task definition is still an open problem due to the inherent ambiguity of emotions. In this paper, a novel…

Computation and Language · Computer Science 2024-04-02 Wen Wu , Chao Zhang , Xixin Wu , Philip C. Woodland

Recently, uncertainty-aware methods have attracted increasing attention in semi-supervised medical image segmentation. However, current methods usually suffer from the drawback that it is difficult to balance the computational cost,…

Computer Vision and Pattern Recognition · Computer Science 2023-07-19 Yingyu Chen , Ziyuan Yang , Chenyu Shen , Zhiwen Wang , Yang Qin , Yi Zhang