English
Related papers

Related papers: Variability Matters : Evaluating inter-rater varia…

200 papers

Performance metrics for medical image segmentation models are used to measure the agreement between the reference annotation and the predicted segmentation. Usually, overlap metrics, such as the Dice, are used as a metric to evaluate the…

Image and Video Processing · Electrical Eng. & Systems 2024-03-26 Sophie Ostmeier , Brian Axelrod , Jeroen Bertels , Fabian Isensee , Maarten G. Lansberg , Soren Christensen , Gregory W. Albers , Li-Jia Li , Jeremy J. Heit

Research into the detection of human activities from wearable sensors is a highly active field, benefiting numerous applications, from ambulatory monitoring of healthcare patients via fitness coaching to streamlining manual work processes.…

Human-Computer Interaction · Computer Science 2024-07-12 Alexander Hoelzemann , Kristof Van Laerhoven

Generalization is an important attribute of machine learning models, particularly for those that are to be deployed in a medical context, where unreliable predictions can have real world consequences. While the failure of models to…

Computer Vision and Pattern Recognition · Computer Science 2022-12-14 Brennan Nichyporuk , Jillian Cardinell , Justin Szeto , Raghav Mehta , Jean-Pierre R. Falet , Douglas L. Arnold , Sotirios A. Tsaftaris , Tal Arbel

In medical imaging, inter-observer variability among radiologists often introduces label uncertainty, particularly in modalities where visual interpretation is subjective. Lung ultrasound (LUS) is a prime example-it frequently presents a…

Accurate segmentation of tissue in histopathological images can be very beneficial for defining regions of interest (ROI) for streamline of diagnostic and prognostic tasks. Still, adapting to different domains is essential for…

Image and Video Processing · Electrical Eng. & Systems 2023-03-10 Saul Fuster , Farbod Khoraminia , Trygve Eftestøl , Tahlita C. M. Zuiverloon , Kjersti Engan

We consider annotation efficient learning in Digital Pathology (DP), where expert annotations are expensive and thus scarce. We explore the impact of image and input resolution on DP patch classification performance. We use two cancer patch…

Computer Vision and Pattern Recognition · Computer Science 2022-05-02 Eu Wern Teh , Graham W. Taylor

Recent advances in deep learning algorithms have led to significant benefits for solving many medical image analysis problems. Training deep learning models commonly requires large datasets with expert-labeled annotations. However,…

Computer Vision and Pattern Recognition · Computer Science 2023-09-19 Banafshe Felfeliyan , Abhilash Hareendranathan , Gregor Kuntze , Stephanie Wichuk , Nils D. Forkert , Jacob L. Jaremko , Janet L. Ronsky

Well-annotated datasets, as shown in recent top studies, are becoming more important for researchers than ever before in supervised machine learning (ML). However, the dataset annotation process and its related human labor costs remain…

Computation and Language · Computer Science 2021-08-24 Haozhan Sun , Chenchen Xu , Hanna Suominen

Since the behavior of a neural network model is adversely affected by a lack of diversity in training data, we present a method that identifies and explains such deficiencies. When a dataset is labeled, we note that annotations alone are…

Computer Vision and Pattern Recognition · Computer Science 2020-12-17 Dhasarathy Parthasarathy , Anton Johansson

Uncertainty estimation is important for interpreting the trustworthiness of machine learning models in many applications. This is especially critical in the data-driven active learning setting where the goal is to achieve a certain accuracy…

Computer Vision and Pattern Recognition · Computer Science 2020-07-14 Bo Li , Tommy Sonne Alstrøm

The medical imaging literature has witnessed remarkable progress in high-performing segmentation models based on convolutional neural networks. Despite the new performance highs, the recent advanced segmentation models still require large,…

Image and Video Processing · Electrical Eng. & Systems 2020-02-13 Nima Tajbakhsh , Laura Jeyaseelan , Qian Li , Jeffrey Chiang , Zhihao Wu , Xiaowei Ding

Accurate annotation of medical image is the crucial step for image AI clinical application. However, annotating medical image will incur a great deal of annotation effort and expense due to its high complexity and needing experienced…

Machine Learning · Computer Science 2019-01-09 Yang Deng , Yao Sun , Yongpei Zhu , Yue Xu , Qianxi Yang , Shuo Zhang , Mingwang Zhu , Jirang Sun , Weiling Zhao , Xiaobo Zhou , Kehong Yuan

Reliable machine-learning models in biomedical settings depend on accurate labels, yet annotating biomedical time-series data remains challenging. Algorithmic sample selection may support annotation, but evidence from studies involving real…

Machine Learning · Computer Science 2026-03-30 Einari Vaaras , Manu Airaksinen , Okko Räsänen

Image annotation aims to annotate a given image with a variable number of class labels corresponding to diverse visual concepts. In this paper, we address two main issues in large-scale image annotation: 1) how to learn a rich feature…

Computer Vision and Pattern Recognition · Computer Science 2018-10-22 Yulei Niu , Zhiwu Lu , Ji-Rong Wen , Tao Xiang , Shih-Fu Chang

In clinical practice, many diagnosis tasks rely on the identification of cells in histopathology images. While supervised machine learning techniques require labels, providing manual cell annotations is time-consuming due to the large…

Hand-annotated data can vary due to factors such as subjective differences, intra-rater variability, and differing annotator expertise. We study annotations from different experts who labelled the same behavior classes on a set of animal…

Machine Learning · Computer Science 2021-06-14 Megan Tjandrasuwita , Jennifer J. Sun , Ann Kennedy , Swarat Chaudhuri , Yisong Yue

Automatic image-based severity estimation is an important task in computer-aided diagnosis. Severity estimation by deep learning requires a large amount of training data to achieve a high performance. In general, severity estimation uses…

Computer Vision and Pattern Recognition · Computer Science 2024-09-11 Takeaki Kadota , Hideaki Hayashi , Ryoma Bise , Kiyohito Tanaka , Seiichi Uchida

High-quality data annotation is an essential but laborious and costly aspect of developing machine learning-based software. We explore the inherent tradeoff between annotation accuracy and cost by detecting and removing minority reports --…

Machine Learning · Computer Science 2025-04-15 Hsuan Wei Liao , Christopher Klugmann , Daniel Kondermann , Rafid Mahmood

Medical image datasets and their annotations are not growing as fast as their equivalents in the general domain. This makes translation from the newest, more data-intensive methods that have made a large impact on the vision field…

Computer Vision and Pattern Recognition · Computer Science 2022-10-14 Tom van Sonsbeek , Xiantong Zhen , Dwarikanath Mahapatra , Marcel Worring