English
Related papers

Related papers: Easy, Reproducible and Quality-Controlled Data Col…

200 papers

AI evaluations have become critical tools for assessing large language model capabilities and safety. This paper presents practical insights from eight months of maintaining $inspect\_evals$, an open-source repository of 70+…

Computation and Language · Computer Science 2025-07-10 Alexandra Abbas , Celia Waggoner , Justin Olive

Crowdsourcing is a popular approach to collect annotations for unlabeled data instances. It involves collecting a large number of annotations from several, often naive untrained annotators for each data instance which are then combined to…

Machine Learning · Computer Science 2020-05-08 Anil Ramakrishna , Rahul Gupta , Shrikanth Narayanan

Neural approaches have become very popular in Question Answering (QA), however, they require a large amount of annotated data. In this work, we propose a novel approach that combines data augmentation via question-answer generation with…

Computation and Language · Computer Science 2024-09-16 Maximilian Kimmich , Andrea Bartezzaghi , Jasmina Bogojeska , Cristiano Malossi , Ngoc Thang Vu

Evaluating production-level retrieval systems at scale is a crucial yet challenging task due to the limited availability of a large pool of well-trained human annotators. Large Language Models (LLMs) have the potential to address this…

Information Retrieval · Computer Science 2024-09-19 Kasra Hosseini , Thomas Kober , Josip Krapac , Roland Vollgraf , Weiwei Cheng , Ana Peleteiro Ramallo

As the number of applications that use machine learning algorithms increases, the need for labeled data useful for training such algorithms intensifies. Getting labels typically involves employing humans to do the annotation, which directly…

Machine Learning · Computer Science 2013-07-16 Alexandros Ntoulas , Omar Alonso , Vasilis Kandylas

Manually annotated data is key to developing text-mining and information-extraction algorithms. However, human annotation requires considerable time, effort and expertise. Given the rapid growth of biomedical literature, it is paramount to…

Human-Computer Interaction · Computer Science 2020-04-27 Rezarta Islamaj , Dongseop Kwon , Sun Kim , Zhiyong Lu

Note-taking is a critical practice for capturing, organizing, and reflecting on information in both academic and professional settings. The recent success of large language models has accelerated the development of AI-assisted tools, yet…

Computation and Language · Computer Science 2025-09-05 Josh Wisoff , Yao Tang , Zhengyu Fang , Jordan Guzman , YuTang Wang , Alex Yu

Human-annotated data plays a critical role in the fairness of AI systems, including those that deal with life-altering decisions or moderating human-created web/social media content. Conventionally, annotator disagreements are resolved…

Information Retrieval · Computer Science 2023-07-21 Tharindu Cyril Weerasooriya , Sarah Luger , Saloni Poddar , Ashiqur R. KhudaBukhsh , Christopher M. Homan

Methods for automated collection and annotation are changing the cost-structures of sampling surveys for a wide range of applications. Digital samples in the form of images or audio recordings can be collected rapidly, and annotated by…

Computers and Society · Computer Science 2015-08-24 Oscar Beijbom

Collecting and annotating morphological data present significant challenges, requiring linguistic expertise, methodological rigour, and substantial resources. These barriers are particularly acute for low-resource languages and varieties.…

Computation and Language · Computer Science 2026-04-07 Aso Mahmudi , Sina Ahmadi , Kemal Kurniawan , Rico Sennrich , Eduard Hovy , Ekaterina Vylomova

Crowdsourcing systems have been used to accumulate massive amounts of labeled data for applications such as computer vision and natural language processing. However, because crowdsourced labeling is inherently dynamic and uncertain,…

Machine Learning · Computer Science 2023-10-26 Mohammad S. Majdi , Jeffrey J. Rodriguez

Recent years have witnessed the rapid progress of perception algorithms on top of LiDAR, a widely adopted sensor for autonomous driving systems. These LiDAR-based solutions are typically data hungry, requiring a large amount of data to be…

Robotics · Computer Science 2020-11-23 Tai Wang , Conghui He , Zhe Wang , Jianping Shi , Dahua Lin

We present our experience as annotators in the creation of high-quality, adversarial machine-reading-comprehension data for extractive QA for Task 1 of the First Workshop on Dynamic Adversarial Data Collection (DADC). DADC is an emergent…

Computation and Language · Computer Science 2022-06-30 Damian Y. Romero Diaz , Magdalena Anioł , John Culnan

Relying on crowdsourced workers, data crowdsourcing platforms are able to efficiently provide vast amounts of labeled data. Due to the variability in the annotation quality of crowd workers, modern techniques resort to redundant annotations…

Human-Computer Interaction · Computer Science 2023-11-28 Haoyu Liu , Fei Wang , Minmin Lin , Runze Wu , Renyu Zhu , Shiwei Zhao , Kai Wang , Tangjie Lv , Changjie Fan

Crowdsourcing platforms have transformed distributed problem-solving, yet quality control remains a persistent challenge. Traditional quality control measures, such as prescreening workers and refining instructions, often focus solely on…

Human-Computer Interaction · Computer Science 2024-03-18 Chu Li , Zhihan Zhang , Michael Saugstad , Esteban Safranchik , Minchu Kulkarni , Xiaoyu Huang , Shwetak Patel , Vikram Iyer , Tim Althoff , Jon E. Froehlich

Annotated images are required for both supervised model training and evaluation in image classification. Manually annotating images is arduous and expensive, especially for multi-labeled images. A recent trend for conducting such laboursome…

Computer Vision and Pattern Recognition · Computer Science 2022-12-07 Jianzhe Lin , Tianze Yu , Z. Jane Wang

Real-world data for classification is often labeled by multiple annotators. For analyzing such data, we introduce CROWDLAB, a straightforward approach to utilize any trained classifier to estimate: (1) A consensus label for each example…

Machine Learning · Computer Science 2023-01-30 Hui Wen Goh , Ulyana Tkachenko , Jonas Mueller

State-of-the-art question answering (QA) relies upon large amounts of training data for which labeling is time consuming and thus expensive. For this reason, customizing QA systems is challenging. As a remedy, we propose a novel framework…

Computation and Language · Computer Science 2020-11-10 Bernhard Kratzwald , Stefan Feuerriegel , Huan Sun

Crowdsourcing is a popular means to obtain labeled data at moderate costs, for example for tweets, which can then be used in text mining tasks. To alleviate the problem of low-quality labels in this context, multiple human factors have been…

Human-Computer Interaction · Computer Science 2018-08-02 Stefan Räbiger , Yücel Saygın , Myra Spiliopoulou

Crowdsourcing has emerged as a powerful paradigm for efficiently labeling large datasets and performing various learning tasks, by leveraging crowds of human annotators. When additional information is available about the data,…

Machine Learning · Computer Science 2021-07-19 Panagiotis A. Traganitis , Georgios B. Giannakis