English
Related papers

Related papers: Variability Matters : Evaluating inter-rater varia…

200 papers

Multi-class cell segmentation in high-resolution Giga-pixel whole slide images (WSI) is critical for various clinical applications. Training such an AI model typically requires labor-intensive pixel-wise manual annotation from experienced…

Cell detection and segmentation are integral parts of automated systems in digital pathology. Encoder-decoder networks have emerged as a promising solution for these tasks. However, training of these networks has typically required full…

While multiple studies have explored the relation between inter-rater variability and deep learning model uncertainty in medical segmentation tasks, little is known about the impact of individual rater style. This study quantifies rater…

Computer Vision and Pattern Recognition · Computer Science 2021-05-06 Olivier Vincent , Charley Gros , Julien Cohen-Adad

Automated medical image segmentation inherently involves a certain degree of uncertainty. One key factor contributing to this uncertainty is the ambiguity that can arise in determining the boundaries of a target region of interest,…

Image and Video Processing · Electrical Eng. & Systems 2023-08-28 Qingqiao Hu , Hao Wang , Jing Luo , Yunhao Luo , Zhiheng Zhangg , Jan S. Kirschke , Benedikt Wiestler , Bjoern Menze , Jianguo Zhang , Hongwei Bran Li

Deep neural network models can learn clinically relevant features from millions of histopathology images. However generating high-quality annotations to train such models for each hospital, each cancer type, and each diagnostic task is…

Medical image segmentation exhibits intra- and inter-annotator variability due to ambiguous object boundaries, annotator preferences, expertise, and tools, among other factors. Lesions with ambiguous boundaries, e.g., spiculated or…

Computer Vision and Pattern Recognition · Computer Science 2025-08-14 Kumar Abhishek , Jeremy Kawahara , Ghassan Hamarneh

When we can not assume a large amount of annotated data , active learning is a good strategy. It consists in learning a model on a small amount of annotated data (annotation budget) and in choosing the best set of points to annotate in…

Computer Vision and Pattern Recognition · Computer Science 2022-01-19 Umang Aggarwal , Adrian Popescu , Céline Hudelot

Current deep learning paradigms largely benefit from the tremendous amount of annotated data. However, the quality of the annotations often varies among labelers. Multi-observer studies have been conducted to study these annotation…

Computer Vision and Pattern Recognition · Computer Science 2020-10-05 Xiaosong Wang , Ziyue Xu , Dong Yang , Leo Tam , Holger Roth , Daguang Xu

Histopathology images are gigapixel-sized and include features and information at different resolutions. Collecting annotations in histopathology requires highly specialized pathologists, making it expensive and time-consuming.…

Computer Vision and Pattern Recognition · Computer Science 2022-11-16 Jin Li , Deepta Rajan , Chintan Shah , Dinkar Juyal , Shreya Chakraborty , Chandan Akiti , Filip Kos , Janani Iyer , Anand Sampat , Ali Behrooz

Intensive Care Units are complex, data-rich environments where critically ill patients are treated using variety of clinical equipment. The data collected using this equipment can be used clinical staff to gain insight into the condition of…

Human-Computer Interaction · Computer Science 2024-10-23 Marceli Wac , Raul Santos-Rodriguez , Chris McWilliams , Christopher Bourdeaux

Uncertainty of labels in clinical data resulting from intra-observer variability can have direct impact on the reliability of assessments made by deep neural networks. In this paper, we propose a method for modelling such uncertainty in the…

As deep networks require large amounts of accurately labeled training data, a strategy to collect sufficiently large and accurate annotations is as important as innovations in recognition methods. This is especially true for building…

Computer Vision and Pattern Recognition · Computer Science 2022-10-03 Tae Soo Kim , Geonwoon Jang , Sanghyup Lee , Thijs Kooi

Image segmentation is a fundamental problem in biomedical image analysis. Recent advances in deep learning have achieved promising results on many biomedical image segmentation benchmarks. However, due to large variations in biomedical…

Computer Vision and Pattern Recognition · Computer Science 2017-06-16 Lin Yang , Yizhe Zhang , Jianxu Chen , Siyuan Zhang , Danny Z. Chen

Deep learning has achieved widespread success in medical image analysis, leading to an increasing demand for large-scale expert-annotated medical image datasets. Yet, the high cost of annotating medical images severely hampers the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-14 Haoran Wang , Qiuye Jin , Shiman Li , Siyu Liu , Manning Wang , Zhijian Song

Cell detection is an essential task in cell image analysis. Recent deep learning-based detection methods have achieved very promising results. In general, these methods require exhaustively annotating the cells in an entire image. If some…

Computer Vision and Pattern Recognition · Computer Science 2021-07-22 Kazuma Fujii , Daiki Suehiro , Kazuya Nishimura , Ryoma Bise

The NLP community has long advocated for the construction of multi-annotator datasets to better capture the nuances of language interpretation, subjectivity, and ambiguity. This paper conducts a retrospective study to show how performance…

Computation and Language · Computer Science 2023-10-24 Pritam Kadasi , Mayank Singh

Recent years witnessed remarkable progress in computational histopathology, largely fueled by deep learning. This brought the clinical adoption of deep learning-based tools within reach, promising significant benefits to healthcare,…

Image and Video Processing · Electrical Eng. & Systems 2024-10-29 Ahmad Obeid , Said Boumaraf , Anabia Sohail , Taimur Hassan , Sajid Javed , Jorge Dias , Mohammed Bennamoun , Naoufel Werghi

In Computed Tomography, machine learning is often used for automated data processing. However, increasing model complexity is accompanied by increasingly large volume datasets, which in turn increases the cost of model training. Unlike most…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Yaroslav Zharov , Tilo Baumbach , Vincent Heuveline

Probably yes. -- Supervised Deep Learning dominates performance scores for many computer vision tasks and defines the state-of-the-art. However, medical image analysis lags behind natural image applications. One of the many reasons is the…

Computer Vision and Pattern Recognition · Computer Science 2021-08-02 Samuel Budd , Thomas Day , John Simpson , Karen Lloyd , Jacqueline Matthew , Emily Skelton , Reza Razavi , Bernhard Kainz