English
Related papers

Related papers: Evaluating subgroup disparity using epistemic unce…

200 papers

Estimating and disentangling epistemic uncertainty, uncertainty that is reducible with more training data, and aleatoric uncertainty, uncertainty that is inherent to the task at hand, is critically important when applying machine learning…

Machine Learning · Computer Science 2024-11-08 Matthew A. Chan , Maria J. Molina , Christopher A. Metzler

Trusting the predictions of deep learning models in safety critical settings such as the medical domain is still not a viable option. Distentangled uncertainty quantification in the field of medical imaging has received little attention. In…

Image and Video Processing · Electrical Eng. & Systems 2022-11-14 Kumud Lakara , Matias Valdenegro-Toro

Uncertainty estimation is pivotal in machine learning, especially for classification tasks, as it improves the robustness and reliability of models. We introduce a novel `Epistemic Wrapping' methodology aimed at improving uncertainty…

Uncertainty quantification is at the core of the reliability and robustness of machine learning. In this paper, we provide a theoretical framework to dissect the uncertainty, especially the \textit{epistemic} component, in deep learning…

Machine Learning · Computer Science 2023-06-21 Ziyi Huang , Henry Lam , Haofeng Zhang

To facilitate healthcare delivery, language models (LMs) have significant potential for clinical prediction tasks using electronic health records (EHRs). However, in these high-stakes applications, unreliable decisions can result in high…

Computation and Language · Computer Science 2024-11-07 Zizhang Chen , Peizhao Li , Xiaomeng Dong , Pengyu Hong

In a data-scarce field such as healthcare, where models often deliver predictions on patients with rare conditions, the ability to measure the uncertainty of a model's prediction could potentially lead to improved effectiveness of decision…

Machine Learning · Statistics 2020-05-26 Lotta Meijerink , Giovanni Cinà , Michele Tonutti

Deep neural networks has been increasingly applied in fault diagnostics, where it uses historical data to capture systems behavior, bypassing the need for high-fidelity physical models. However, despite their competence in prediction tasks,…

Machine Learning · Computer Science 2025-09-24 Arman Mohammadi , Mattias Krysander , Daniel Jung , Erik Frisk

In machine learning, disparity metrics are often defined by measuring the difference in the performance or outcome of a model, across different sub-populations (groups) of datapoints. Thus, the inputs to disparity quantification consist of…

Computer Vision and Pattern Recognition · Computer Science 2022-04-15 Shervin Ardeshir , Cristina Segalin , Nathan Kallus

Machine Learning (ML) algorithms are vital for supporting clinical decision-making in biomedical informatics. However, their predictive performance can vary across demographic groups, often due to the underrepresentation of historically…

Machine Learning · Computer Science 2025-03-04 Ioannis Bilionis , Ricardo C. Berrios , Luis Fernandez-Luque , Carlos Castillo

The consideration of predictive uncertainty in medical imaging with deep learning is of utmost importance. We apply estimation of both aleatoric and epistemic uncertainty by variational Bayesian inference with Monte Carlo dropout to…

Image and Video Processing · Electrical Eng. & Systems 2021-04-27 Max-Heinrich Laves , Sontje Ihler , Jacob F. Fast , Lüder A. Kahrs , Tobias Ortmaier

Traditional approaches to ensure group fairness in algorithmic decision making aim to equalize ``total'' error rates for different subgroups in the population. In contrast, we argue that the fairness approaches should instead focus only on…

Machine Learning · Computer Science 2021-05-11 Junaid Ali , Preethi Lahoti , Krishna P. Gummadi

We evaluate two different methods for the integration of prediction uncertainty into diagnostic image classifiers to increase patient safety in deep learning. In the first method, Monte Carlo sampling is applied with dropout at test time to…

Image and Video Processing · Electrical Eng. & Systems 2019-08-05 Max-Heinrich Laves , Sontje Ihler , Tobias Ortmaier

We introduce a novel framework for AI-generated image detection through epistemic uncertainty, aiming to address critical security concerns in the era of generative models. Our key insight stems from the observation that distributional…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Jun Nie , Yonggang Zhang , Tongliang Liu , Yiu-ming Cheung , Bo Han , Xinmei Tian

Automated mammography screening plays an important role in early breast cancer detection. However, current machine learning models, developed on some training datasets, may exhibit performance degradation and bias when deployed in…

Computer Vision and Pattern Recognition · Computer Science 2025-02-18 Amit Kumar Kundu , Florence X. Doo , Vaishnavi Patil , Amitabh Varshney , Joseph Jaja

Being uncertain when facing the unknown is key to intelligent decision making. However, machine learning algorithms lack reliable estimates about their predictive uncertainty. This leads to wrong and overly-confident decisions when…

Machine Learning · Computer Science 2021-07-14 Mohamed Ishmael Belghazi , David Lopez-Paz

Although deep learning (DL) models have shown great success in many medical image analysis tasks, deployment of the resulting models into real clinical contexts requires: (1) that they exhibit robustness and fairness across different…

Computer Vision and Pattern Recognition · Computer Science 2023-03-07 Raghav Mehta , Changjian Shui , Tal Arbel

When systems use data-based models that are based on machine learning (ML), errors in their results cannot be ruled out. This is particularly critical if it remains unclear to the user how these models arrived at their decisions and if…

Machine Learning · Computer Science 2023-11-10 Lisa Jöckel , Michael Kläs , Georg Popp , Nadja Hilger , Stephan Fricke

Health care decisions are increasingly informed by clinical decision support algorithms, but these algorithms may perpetuate or increase racial and ethnic disparities in access to and quality of health care. Further complicating the…

Methodology · Statistics 2024-02-28 Solvejg Wastvedt , Joshua Snoke , Denis Agniel , Julie Lai , Marc N. Elliott , Steven C. Martino

Mammographic screening is an effective method for detecting breast cancer, facilitating early diagnosis. However, the current need to manually inspect images places a heavy burden on healthcare systems, spurring a desire for automated…

Image and Video Processing · Electrical Eng. & Systems 2025-01-30 Ciaran Bench , Emir Ahmed , Spencer A. Thomas

Deep Learning sets the state-of-the-art in many challenging tasks showing outstanding performance in a broad range of applications. Despite its success, it still lacks robustness hindering its adoption in medical applications. Modeling…

Computer Vision and Pattern Recognition · Computer Science 2019-09-19 Agnieszka Tomczack , Nassir Navab , Shadi Albarqouni