English
Related papers

Related papers: Clinical Uncertainty Impacts Machine Learning Eval…

200 papers

Uncertainty quantification is crucial to assess prediction quality of a machine learning model. In the case of Extreme Learning Machines (ELM), most methods proposed in the literature make strong assumptions on the data, ignore the…

Machine Learning · Statistics 2020-11-04 Fabian Guignard , Federico Amato , Mikhail Kanevski

Machine learning-based decision support systems are increasingly deployed in clinical settings, where probabilistic scoring functions are used to inform and prioritize patient management decisions. However, widely used scoring rules, such…

Machine Learning · Computer Science 2025-07-01 Gerardo A. Flores , Alyssa H. Smith , Julia A. Fukuyama , Ashia C. Wilson

Classifiers for medical image analysis are often trained with a single consensus label, based on combining labels given by experts or crowds. However, disagreement between annotators may be informative, and thus removing it may not be the…

Computer Vision and Pattern Recognition · Computer Science 2018-08-20 Veronika Cheplygina , Josien P. W. Pluim

For safety, medical AI systems undergo thorough evaluations before deployment, validating their predictions against a ground truth which is assumed to be fixed and certain. However, this ground truth is often curated in the form of…

Measuring cross-sectional areas in ultrasound images is a standard tool to evaluate disease progress or treatment response. Often addressed today with supervised deep-learning segmentation approaches, existing solutions highly depend upon…

Image and Video Processing · Electrical Eng. & Systems 2023-08-21 Vanessa Gonzalez Duque , Leonhard Zirus , Yordanka Velikova , Nassir Navab , Diana Mateus

A data science task can be deemed as making sense of the data or testing a hypothesis about it. The conclusions inferred from data can greatly guide us to make informative decisions. Big data has enabled us to carry out countless prediction…

Machine Learning · Computer Science 2022-01-12 Wenhao Zhang , Ramin Ramezani , Arash Naeim

We demonstrate a validity problem of machine learning in the vital application area of disease diagnosis in medicine. It arises when target labels in training data are determined by an indirect measurement, and the fundamental measurements…

Machine Learning · Computer Science 2023-11-07 Michael Hagmann , Shigehiko Schamoni , Stefan Riezler

While most machine learning models can provide confidence in their predictions, confidence is insufficient to understand a prediction's reliability. For instance, the model may have a low confidence prediction if the input is not…

Machine Learning · Computer Science 2023-10-31 Mert Yuksekgonul , Linjun Zhang , James Zou , Carlos Guestrin

In Computed Tomography, machine learning is often used for automated data processing. However, increasing model complexity is accompanied by increasingly large volume datasets, which in turn increases the cost of model training. Unlike most…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Yaroslav Zharov , Tilo Baumbach , Vincent Heuveline

Accurate medical image segmentation is crucial for diagnosis and analysis. However, the models without calibrated uncertainty estimates might lead to errors in downstream analysis and exhibit low levels of robustness. Estimating the…

Image and Video Processing · Electrical Eng. & Systems 2021-09-16 Yanwu Yang , Xutao Guo , Yiwei Pan , Pengcheng Shi , Haiyan Lv , Ting Ma

Resolving disagreement in manual annotation typically consists of removing unreliable annotators and using a label aggregation strategy such as majority vote or expert opinion to resolve disagreement. These may have the side-effect of…

Computation and Language · Computer Science 2024-12-06 Mugdha Pandya , Nafise Sadat Moosavi , Diana Maynard

Objective: The growing availability of large-scale observational clinical datasets and challenges in conducting randomized controlled trials have spurred enthusiasm in using causal machine learning (ML) for causal inference in observational…

Due to the expensive costs of collecting labels in multi-label classification datasets, partially annotated multi-label classification has become an emerging field in computer vision. One baseline approach to this task is to assume…

Computer Vision and Pattern Recognition · Computer Science 2023-04-05 Youngwook Kim , Jae Myung Kim , Jieun Jeong , Cordelia Schmid , Zeynep Akata , Jungwoo Lee

Cell detection in histopathology images is of great interest to clinical practice and research, and convolutional neural networks (CNNs) have achieved remarkable cell detection results. Typically, to train CNN-based cell detection models,…

Computer Vision and Pattern Recognition · Computer Science 2023-02-17 Zipei Zhao , Fengqian Pang , Yaou Liu , Zhiwen Liu , Chuyang Ye

Facial analysis models are increasingly applied in real-world applications that have significant impact on peoples' lives. However, as literature has shown, models that automatically classify facial attributes might exhibit algorithmic…

Computer Vision and Pattern Recognition · Computer Science 2022-06-15 Camila Kolling , Victor Araujo , Adriano Veloso , Soraia Raupp Musse

In the field of image classification, existing methods often struggle with biased or ambiguous data, a prevalent issue in real-world scenarios. Current strategies, including semi-supervised learning and class blending, offer partial…

Computer Vision and Pattern Recognition · Computer Science 2024-04-30 Lars Schmarje , Vasco Grossmann , Claudius Zelenka , Johannes Brünger , Reinhard Koch

Diagnostic testing provides a unique setting for studying and developing tools in classification theory. In such contexts, the concept of prevalence, i.e. the number of individuals with a given condition, is fundamental, both as an inherent…

Over the past decades, researchers and ML practitioners have come up with better and better ways to build, understand and improve the quality of ML models, but mostly under the key assumption that the training data is distributed…

Machine Learning · Computer Science 2019-10-14 Yeounoh Chung , Peter J. Haas , Eli Upfal , Tim Kraska

A straightforward application of semi-supervised machine learning to the problem of treatment effect estimation would be to consider data as "unlabeled" if treatment assignment and covariates are observed but outcomes are unobserved.…

Methodology · Statistics 2020-09-15 Andrew Herren , P. Richard Hahn

High-quality labeled data is essential for training robust machine learning models, yet obtaining annotations at scale remains expensive. AI-assisted annotation has therefore become standard in large-scale labeling workflows. However, in…

Human-Computer Interaction · Computer Science 2026-05-13 Moussa Kassem Sbeyti , Joshua Holstein , Philipp Spitzer , Nadja Klein , Gerhard Satzger
‹ Prev 1 8 9 10 Next ›