English
Related papers

Related papers: Leveraging Multi-Rater Annotations to Calibrate Ob…

200 papers

Medical image segmentation annotations suffer from inter- and intra-observer variations even among experts due to intrinsic differences in human annotators and ambiguous boundaries. Leveraging a collection of annotators' opinions for an…

Image and Video Processing · Electrical Eng. & Systems 2021-05-04 Zahra Mirikharaji , Kumar Abhishek , Saeed Izadi , Ghassan Hamarneh

Supervised training of object detectors requires well-annotated large-scale datasets, whose production is costly. Therefore, some efforts have been made to obtain annotations in economical ways, such as cloud sourcing. However, datasets…

Computer Vision and Pattern Recognition · Computer Science 2021-12-08 Jiafeng Mao , Qing Yu , Yoko Yamakata , Kiyoharu Aizawa

The segmentation of optic disc(OD) and optic cup(OC) from fundus images is an important fundamental task for glaucoma diagnosis. In the clinical practice, it is often necessary to collect opinions from multiple experts to obtain the final…

Image and Video Processing · Electrical Eng. & Systems 2022-06-15 Junde Wu , Huihui Fang , Fangxin Shang , Zhaowei Wang , Dalu Yang , Wenshuo Zhou , Yehui Yang , Yanwu Xu

Large-scale datasets are important for the development of deep learning models. Such datasets usually require a heavy workload of annotations, which are extremely time-consuming and expensive. To accelerate the annotation procedure,…

Machine Learning · Computer Science 2024-03-13 Xiaoqian Ruan , Gaoang Wang

Collecting high quality data for object detection tasks is challenging due to the inherent subjectivity in labeling the boundaries of an object. This makes it difficult to not only collect consistent annotations across a dataset but also to…

Computer Vision and Pattern Recognition · Computer Science 2025-05-30 Darryl Hannan , Timothy Doster , Henry Kvinge , Adam Attarian , Yijing Watkins

Mislabeled data is a pervasive issue that undermines the performance of machine learning systems in real-world applications. An effective approach to mitigate this problem is to detect mislabeled instances and subject them to special…

Machine Learning · Computer Science 2025-11-05 Ilies Chibane , Thomas George , Pierre Nodet , Vincent Lemaire

In multi-label classification, each example in a dataset may be annotated as belonging to one or more classes (or none of the classes). Example applications include image (or document) tagging where each possible tag either applies to a…

Machine Learning · Computer Science 2022-11-28 Aditya Thyagarajan , Elías Snorrason , Curtis Northcutt , Jonas Mueller

This paper deals with the multiple annotation problem in medical application of cancer detection in digital images. The main assumption is that though images are labeled by many experts, the number of images read by the same expert is not…

Computer Vision and Pattern Recognition · Computer Science 2014-12-10 Inna Stainvas , Alexandra Manevitch , Isaac Leichter

Recently, the availability of remote sensing imagery from aerial vehicles and satellites constantly improved. For an automated interpretation of such data, deep-learning-based object detectors achieve state-of-the-art performance. However,…

Computer Vision and Pattern Recognition · Computer Science 2022-10-25 Maximilian Bernhard , Matthias Schubert

The predictive performance of supervised learning algorithms depends on the quality of labels. In a typical label collection process, multiple annotators provide subjective noisy estimates of the "truth" under the influence of their varying…

Machine Learning · Computer Science 2019-06-18 Ryutaro Tanno , Ardavan Saeedi , Swami Sankaranarayanan , Daniel C. Alexander , Nathan Silberman

Universal lesion detection has great value for clinical practice as it aims to detect various types of lesions in multiple organs on medical images. Deep learning methods have shown promising results, but demanding large volumes of…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Xiaoyu Bai , Benteng Ma , Changyang Li , Yong Xia

Image segmentation is a fundamental problem in biomedical image analysis. Recent advances in deep learning have achieved promising results on many biomedical image segmentation benchmarks. However, due to large variations in biomedical…

Computer Vision and Pattern Recognition · Computer Science 2017-06-16 Lin Yang , Yizhe Zhang , Jianxu Chen , Siyuan Zhang , Danny Z. Chen

The success of Deep Neural Network (DNN) models significantly depends on the quality of provided annotations. In medical image segmentation, for example, having multiple expert annotations for each data point is common to minimize…

Computer Vision and Pattern Recognition · Computer Science 2025-02-12 Asma Ahmed Hashmi , Aigerim Zhumabayeva , Nikita Kotelevskii , Artem Agafonov , Mohammad Yaqub , Maxim Panov , Martin Takáč

Multi-organ segmentation, which identifies and separates different organs in medical images, is a fundamental task in medical image analysis. Recently, the immense success of deep learning motivated its wide adoption in multi-organ…

Computer Vision and Pattern Recognition · Computer Science 2023-04-17 Jiahua Dong , Guohua Cheng , Yue Zhang , Chengtao Peng , Yu Song , Ruofeng Tong , Lanfen Lin , Yen-Wei Chen

Recent works have shown that deep neural networks can achieve super-human performance in a wide range of image classification tasks in the medical imaging domain. However, these works have primarily focused on classification accuracy,…

Computer Vision and Pattern Recognition · Computer Science 2020-09-10 Gongbo Liang , Yu Zhang , Xiaoqin Wang , Nathan Jacobs

We consider the problem of omni-supervised object detection, which can use unlabeled, fully labeled and weakly labeled annotations, such as image tags, counts, points, etc., for object detection. This is enabled by a unified architecture,…

Computer Vision and Pattern Recognition · Computer Science 2022-03-31 Pei Wang , Zhaowei Cai , Hao Yang , Gurumurthy Swaminathan , Nuno Vasconcelos , Bernt Schiele , Stefano Soatto

High-quality annotations are essential for object detection models, but ensuring label accuracy - especially for bounding boxes - remains both challenging and costly. This paper introduces ClipGrader, a novel approach that leverages…

Computer Vision and Pattern Recognition · Computer Science 2025-03-06 Hong Lu , Yali Bian , Rahul C. Shah

Density of mitotic figures in histologic sections is a prognostically relevant characteristic for many tumours. Due to high inter-pathologist variability, deep learning-based algorithms are a promising solution to improve tumour…

Annotation cost is a bottleneck for collecting massive data in mammography, especially for training deep neural networks. In this paper, we study the use of heterogeneous levels of annotation granularity to improve predictive performances.…

Image and Video Processing · Electrical Eng. & Systems 2019-09-13 Thi-Lam-Thuy Le , Nicolas Thome , Sylvain Bernard , Vincent Bismuth , Fanny Patoureaux