English
Related papers

Related papers: Rethinking Annotator Simulation: Realistic Evaluat…

200 papers

Human annotator simulation (HAS) serves as a cost-effective substitute for human evaluation such as data annotation and system assessment. Human perception and behaviour during human evaluation exhibit inherent variability due to diverse…

Computation and Language · Computer Science 2023-10-03 Wen Wu , Wenlin Chen , Chao Zhang , Philip C. Woodland

The labor-intensive annotation process of semantic segmentation datasets is often prone to errors, since humans struggle to label every pixel correctly. We study algorithms to automatically detect such annotation errors, in particular…

Machine Learning · Computer Science 2023-07-12 Vedang Lad , Jonas Mueller

Imitation learning enables robots to acquire complex manipulation skills from human demonstrations, but current methods rely solely on low-level sensorimotor data while ignoring the rich semantic knowledge humans naturally possess about…

Machine Learning · Computer Science 2026-01-27 Jakob Karalus , Friedhelm Schwenker

Annotating new datasets for machine learning tasks is tedious, time-consuming, and costly. For segmentation applications, the burden is particularly high as manual delineations of relevant image content are often extremely expensive or can…

Computer Vision and Pattern Recognition · Computer Science 2023-03-22 Javier Gamazo Tejero , Martin S. Zinkernagel , Sebastian Wolf , Raphael Sznitman , Pablo Márquez Neila

Manual medical image segmentation is subjective and suffers from annotator-related bias, which can be mimicked or amplified by deep learning methods. Recently, researchers have suggested that such bias is the combination of the annotator…

Computer Vision and Pattern Recognition · Computer Science 2023-06-29 Zehui Liao , Yutong Xie , Shishuai Hu , Yong Xia

Supervised classification algorithms are used to solve a growing number of real-life problems around the globe. Their performance is strictly connected with the quality of labels used in training. Unfortunately, acquiring good-quality…

Machine Learning · Computer Science 2024-07-08 Daniel Kałuża , Andrzej Janusz , Dominik Ślęzak

Sentiment analysis is an important tool for aggregating patient voices, in order to provide targeted improvements in healthcare services. A prerequisite for this is the availability of in-domain data annotated for sentiment. This article…

Computation and Language · Computer Science 2024-04-30 Petter Mæhlum , David Samuel , Rebecka Maria Norman , Elma Jelin , Øyvind Andresen Bjertnæs , Lilja Øvrelid , Erik Velldal

Accurate video annotation plays a vital role in modern retail applications, including customer behavior analysis, product interaction detection, and in-store activity recognition. However, conventional annotation methods heavily rely on…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Varun Mannam , Zhenyu Shi

We aim to reduce the tedious nature of developing and evaluating methods for aligning PET-CT scans from multiple patient visits. Current methods for registration rely on correspondences that are created manually by medical experts with 3D…

Computer Vision and Pattern Recognition · Computer Science 2019-11-26 Teaghan O'Briain , Kyong Hwan Jin , Hongyoon Choi , Erika Chin , Magdalena Bazalova-Carter , Kwang Moo Yi

The growing demands of stroke rehabilitation have increased the need for solutions to support autonomous exercising. Virtual coaches can provide real-time exercise feedback from video data, helping patients improve motor function and keep…

Image and Video Processing · Electrical Eng. & Systems 2025-06-05 Gonçalo Mesquita , Ana Rita Cóias , Artur Dubrawski , Alexandre Bernardino

Automated skin lesion analysis is very crucial in clinical practice, as skin cancer is among the most common human malignancy. Existing approaches with deep learning have achieved remarkable performance on this challenging task, however,…

Computer Vision and Pattern Recognition · Computer Science 2019-09-06 Xueying Shi , Qi Dou , Cheng Xue , Jing Qin , Hao Chen , Pheng-Ann Heng

The image annotation stage is a critical and often the most time-consuming part required for training and evaluating object detection and semantic segmentation models. Deployment of the existing models in novel environments often requires…

Computer Vision and Pattern Recognition · Computer Science 2023-11-21 Yimeng Li , Navid Rajabi , Sulabh Shrestha , Md Alimoor Reza , Jana Kosecka

Accurate ground truth annotations are critical to supervised learning and evaluating the performance of autonomous vehicle systems. These vehicles are typically equipped with active sensors, such as LiDAR, which scan the environment in…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Alexandre Justo Miro , Ludvig af Klinteberg , Bogdan Timus , Aron Asefaw , Ajinkya Khoche , Thomas Gustafsson , Sina Sharif Mansouri , Masoud Daneshtalab

Organ-at-risk contouring is still a bottleneck in radiotherapy, with many deep learning methods falling short of promised results when evaluated on clinical data. We investigate the accuracy and time-savings resulting from the use of an…

Computer Vision and Pattern Recognition · Computer Science 2022-04-06 Abraham George Smith , Jens Petersen , Cynthia Terrones-Campos , Anne Kiil Berthelsen , Nora Jarrett Forbes , Sune Darkner , Lena Specht , Ivan Richter Vogelius

Accurate and automated tumor segmentation is highly desired since it has the great potential to increase the efficiency and reproducibility of computing more complete tumor measurements and imaging biomarkers, comparing to (often partial)…

Image and Video Processing · Electrical Eng. & Systems 2020-08-26 Ling Zhang , Yu Shi , Jiawen Yao , Yun Bian , Kai Cao , Dakai Jin , Jing Xiao , Le Lu

Noisy labels can significantly affect the performance of deep neural networks (DNNs). In medical image segmentation tasks, annotations are error-prone due to the high demand in annotation time and in the annotators' expertise. Existing…

Image and Video Processing · Electrical Eng. & Systems 2023-08-08 Jiachen Yao , Yikai Zhang , Songzhu Zheng , Mayank Goswami , Prateek Prasanna , Chao Chen

Biomedical image segmentation is a crucial part of both scientific research and clinical care. With enough labelled data, deep learning models can be trained to accurately automate specific biomedical image segmentation tasks. However,…

Computer Vision and Pattern Recognition · Computer Science 2024-07-18 Hallee E. Wong , Marianne Rakic , John Guttag , Adrian V. Dalca

Recent research in the field of computer vision strongly focuses on deep learning architectures to tackle image processing problems. Deep neural networks are often considered in complex image processing scenarios since traditional computer…

Computer Vision and Pattern Recognition · Computer Science 2021-11-30 Marcel P. Schilling , Luca Rettenberger , Friedrich Münke , Haijun Cui , Anna A. Popova , Pavel A. Levkin , Ralf Mikut , Markus Reischl

In interactive object segmentation a user collaborates with a computer vision model to segment an object. Recent works employ convolutional neural networks for this task: Given an image and a set of corrections made by the user as input,…

Computer Vision and Pattern Recognition · Computer Science 2020-11-10 Theodora Kontogianni , Michael Gygli , Jasper Uijlings , Vittorio Ferrari

Segmentation in medical imaging is an essential and often preliminary task in the image processing chain, driving numerous efforts towards the design of robust segmentation algorithms. Supervised learning methods achieve excellent…

Image and Video Processing · Electrical Eng. & Systems 2024-04-03 Pierre Rougé , Pierre-Henri Conze , Nicolas Passat , Odyssée Merveille