English
Related papers

Related papers: Variability Matters : Evaluating inter-rater varia…

200 papers

Medical imaging, including MRI, CT, and Ultrasound, plays a vital role in clinical decisions. Accurate segmentation is essential to measure the structure of interest from the image. However, manual segmentation is highly operator-dependent,…

Image and Video Processing · Electrical Eng. & Systems 2022-07-07 Jaeik Jeon , Yeonggul Jang , Youngtaek Hong , Hackjoon Shim , Sekeun Kim

Evidence suggests that networks trained on large datasets generalize well not solely because of the numerous training examples, but also class diversity which encourages learning of enriched features. This raises the question of whether…

Semantic segmentation is a crucial task in biomedical image processing, which recent breakthroughs in deep learning have allowed to improve. However, deep learning methods in general are not yet widely used in practice since they require…

Computer Vision and Pattern Recognition · Computer Science 2019-07-12 Melanie Lubrano di Scandalea , Christian S. Perone , Mathieu Boudreau , Julien Cohen-Adad

Annotations in Visual Analytics (VA) have become a common means to support the analysis by integrating additional information into the VA system. That additional information often depends on the current process step in the visual analysis.…

Human-Computer Interaction · Computer Science 2020-08-21 Christoph Schmidt , Paul Rosenthal , Heidrun Schumann

Deep learning methods have shown promise in classifying breast cancer histopathology images, but their performance often declines with limited annotated data, a critical challenge in medical imaging due to the high cost and expertise…

Computer Vision and Pattern Recognition · Computer Science 2025-05-08 Liu Suxing , Byungwon Min

Label aggregation such as majority voting is commonly used to resolve annotator disagreement in dataset creation. However, this may disregard minority values and opinions. Recent studies indicate that learning from individual annotations…

Computation and Language · Computer Science 2023-10-24 Xinpeng Wang , Barbara Plank

The performance of learning-based algorithms improves with the amount of labelled data used for training. Yet, manually annotating data is particularly difficult for medical image segmentation tasks because of the limited expert…

Computer Vision and Pattern Recognition · Computer Science 2023-09-12 Mélanie Gaillochet , Christian Desrosiers , Hervé Lombaert

Errors in labels obtained via human annotation adversely affect a model's performance. Existing approaches propose ways to mitigate the effect of label error on a model's downstream accuracy, yet little is known about its impact on a…

Machine Learning · Computer Science 2023-10-05 Julius Adebayo , Melissa Hall , Bowen Yu , Bobbie Chern

Although the U-Net architecture has been extensively used for segmentation of medical images, we address two of its shortcomings in this work. Firstly, the accuracy of vanilla U-Net degrades when the target regions for segmentation exhibit…

Performance variability is an important measure for a reliable high performance computing (HPC) system. Performance variability is affected by complicated interactions between numerous factors, such as CPU frequency, the number of…

Distributed, Parallel, and Cluster Computing · Computer Science 2020-12-16 Li Xu , Thomas Lux , Tyler Chang , Bo Li , Yili Hong , Layne Watson , Ali Butt , Danfeng Yao , Kirk Cameron

Training a neural network with a large labeled dataset is still a dominant paradigm in computational histopathology. However, obtaining such exhaustive manual annotations is often expensive, laborious, and prone to inter and Intra-observer…

Computer Vision and Pattern Recognition · Computer Science 2021-11-03 Chetan L. Srinidhi , Seung Wook Kim , Fu-Der Chen , Anne L. Martel

Large-scale classification of data where classes are structurally organized in a hierarchy is an important area of research. Top-down approaches that exploit the hierarchy during the learning and prediction phase are efficient for large…

Machine Learning · Computer Science 2017-06-06 Azad Naik , Huzefa Rangwala

Fully annotated large-scale medical image datasets are highly valuable. However, because labeling medical images is tedious and requires specialized knowledge, the large-scale datasets available often have missing annotation issues. For…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Xiaoyu Bai , Yong Xia

Label variability is a major challenge for prostate lesion segmentation. In multi-site datasets, annotations often reflect centre-specific contouring protocols, causing segmentation networks to overfit to local styles and generalise poorly…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Wen Yan , Yipei Wang , Shiqi Huang , Natasha Thorley , Mark Emberton , Vasilis Stavrinides , Yipeng Hu , Dean Barratt

This article discusses how the language of causality can shed new light on the major challenges in machine learning for medical imaging: 1) data scarcity, which is the limited availability of high-quality annotations, and 2) data mismatch,…

Image and Video Processing · Electrical Eng. & Systems 2020-07-23 Daniel C. Castro , Ian Walker , Ben Glocker

Annotator disagreement is ubiquitous in natural language processing (NLP) tasks. There are multiple reasons for such disagreements, including the subjectivity of the task, difficult cases, unclear guidelines, and so on. Rather than simply…

Computation and Language · Computer Science 2023-10-24 Naihao Deng , Xinliang Frederick Zhang , Siyang Liu , Winston Wu , Lu Wang , Rada Mihalcea

Medical image segmentation is inherently uncertain. For a given image, there may be multiple plausible segmentation hypotheses, and physicians will often disagree on lesion and organ boundaries. To be suited to real-world application,…

Computer Vision and Pattern Recognition · Computer Science 2021-09-28 João Lourenço Silva , Arlindo L. Oliveira

Deep learning-based diagnostic performance increases with more annotated data, but large-scale manual annotations are expensive and labour-intensive. Experts evaluate diagnostic images during clinical routine, and write their findings in…

Image and Video Processing · Electrical Eng. & Systems 2024-07-01 Joeran S. Bosma , Anindo Saha , Matin Hosseinzadeh , Ilse Slootweg , Maarten de Rooij , Henkjan Huisman

Recent years have seen increasing use of supervised learning methods for segmentation tasks. However, the predictive performance of these algorithms depends on the quality of labels. This problem is particularly pertinent in the medical…

Computer Vision and Pattern Recognition · Computer Science 2020-10-26 Le Zhang , Ryutaro Tanno , Mou-Cheng Xu , Chen Jin , Joseph Jacob , Olga Ciccarelli , Frederik Barkhof , Daniel C. Alexander

Human annotated data is the cornerstone of today's artificial intelligence efforts, yet data labeling processes can be complicated and expensive, especially when human labelers disagree with each other. The current work practice is to use…

Human-Computer Interaction · Computer Science 2021-12-09 Yisi Sang , Jeffrey Stanton