English
Related papers

Related papers: Easy, Reproducible and Quality-Controlled Data Col…

200 papers

Crowd-sourcing is a cheap and popular means of creating training and evaluation datasets for machine learning, however it poses the problem of `truth inference', as individual workers cannot be wholly trusted to provide reliable…

Machine Learning · Computer Science 2019-02-26 Yuan Li , Benjamin I. P. Rubinstein , Trevor Cohn

Data annotation underpins the success of modern AI, but the aggregation of crowd-collected datasets can harm the preservation of diverse perspectives in data. Difficult and ambiguous tasks cannot easily be collapsed into unitary labels.…

Human-Computer Interaction · Computer Science 2025-08-14 Malik Khadar , Daniel Runningen , Julia Tang , Stevie Chancellor , Harmanpreet Kaur

Motivation: Bioinformatics is faced with a variety of problems that require human involvement. Tasks like genome annotation, image analysis, knowledge-base construction and protein structure determination all benefit from human input. In…

Quantitative Methods · Quantitative Biology 2013-07-01 Benjamin M. Good , Andrew I. Su

Some complex problems, such as image tagging and natural language processing, are very challenging for computers, where even state-of-the-art technology is yet able to provide satisfactory accuracy. Therefore, rather than relying solely on…

Databases · Computer Science 2012-07-03 Xuan Liu , Meiyu Lu , Beng Chin Ooi , Yanyan Shen , Sai Wu , Meihui Zhang

Human data labeling is an important and expensive task at the heart of supervised learning systems. Hierarchies help humans understand and organize concepts. We ask whether and how concept hierarchies can inform the design of annotation…

Human-Computer Interaction · Computer Science 2023-02-24 Rickard Stureborg , Bhuwan Dhingra , Jun Yang

Modern workflows run on increasingly heterogeneous computing architectures and with this heterogeneity comes additional complexity. We aim to apply the FAIR principles for research reproducibility by developing software to collect metadata…

Distributed, Parallel, and Cluster Computing · Computer Science 2025-06-19 Polina Shpilker , Line Pouchard

Modern machine learning algorithms need large datasets to be trained. Crowdsourcing has become a popular approach to label large datasets in a shorter time as well as at a lower cost comparing to that needed for a limited number of experts.…

Human-Computer Interaction · Computer Science 2019-12-11 Alexey Drutsa , Viktoriya Farafonova , Valentina Fedorova , Olga Megorskaya , Evfrosiniya Zerminova , Olga Zhilinskaya

Obtaining standardized crowdsourced benchmark of computational methods is a major issue in data science communities. Dedicated frameworks enabling fair benchmarking in a unified environment are yet to be developed. Here we introduce…

Machine Learning · Computer Science 2022-06-28 Zhen Xu , Sergio Escalera , Isabelle Guyon , Adrien Pavão , Magali Richard , Wei-Wei Tu , Quanming Yao , Huan Zhao

Recent works of opinion expression identification (OEI) rely heavily on the quality and scale of the manually-constructed training corpus, which could be extremely difficult to satisfy. Crowdsourcing is one practical solution for this…

Computation and Language · Computer Science 2022-04-25 Xin Zhang , Guangwei Xu , Yueheng Sun , Meishan Zhang , Xiaobin Wang , Min Zhang

As the size of the datasets getting larger, accurately annotating such datasets is becoming more impractical due to the expensiveness on both time and economy. Therefore, crowd-sourcing has been widely adopted to alleviate the cost of…

Machine Learning · Computer Science 2024-02-21 Hansong Zhang , Shikun Li , Dan Zeng , Chenggang Yan , Shiming Ge

This paper presents Crowd-Kit, a general-purpose computational quality control toolkit for crowdsourcing. Crowd-Kit provides efficient and convenient implementations of popular quality control algorithms in Python, including methods for…

Human-Computer Interaction · Computer Science 2024-04-09 Dmitry Ustalov , Nikita Pavlichenko , Boris Tseitlin

Many computer scientists use the aggregated answers of online workers to represent ground truth. Prior work has shown that aggregation methods such as majority voting are effective for measuring relatively objective features. For subjective…

Computation and Language · Computer Science 2021-04-06 Jiele Wu , Chau-Wai Wong , Xinyan Zhao , Xianpeng Liu

Typically crowdsourcing-based approaches to gather annotated data use inter-annotator agreement as a measure of quality. However, in many domains, there is ambiguity in the data, as well as a multitude of perspectives of the information…

Human-Computer Interaction · Computer Science 2018-08-21 Anca Dumitrache , Oana Inel , Lora Aroyo , Benjamin Timmermans , Chris Welty

The phenomenal success of certain crowdsourced online platforms, such as Wikipedia, is accredited to their ability to tap the crowd's potential to collaboratively build knowledge. While it is well known that the crowd's collective wisdom…

Computers and Society · Computer Science 2015-08-28 Anamika Chhabra , S. R. S. Iyengar , Poonam Saini , Rajesh Shreedhar Bhat , Vijay Kumar

Measuring user satisfaction level is a challenging task, and a critical component in developing large-scale conversational agent systems serving the needs of real users. An widely used approach to tackle this is to collect human annotation…

In recent years, imitation learning from large-scale human demonstrations has emerged as a promising paradigm for training robot policies. However, the burden of collecting large quantities of human demonstrations is significant in terms of…

Crowdsourcing is regarded as one prospective solution for effective supervised learning, aiming to build large-scale annotated training data by crowd workers. Previous studies focus on reducing the influences from the noises of the…

Computation and Language · Computer Science 2021-11-16 Xin Zhang , Guangwei Xu , Yueheng Sun , Meishan Zhang , Pengjun Xie

We present CrowdHub, a tool for running systematic evaluations of task designs on top of crowdsourcing platforms. The goal is to support the evaluation process, avoiding potential experimental biases that, according to our empirical…

Human-Computer Interaction · Computer Science 2019-09-11 Jorge Ramírez , Simone Degiacomi , Davide Zanella , Marcos Baez , Fabio Casati , Boualem Benatallah

The process of gathering ground truth data through human annotation is a major bottleneck in the use of information extraction methods for populating the Semantic Web. Crowdsourcing-based approaches are gaining popularity in the attempt to…

Human-Computer Interaction · Computer Science 2022-09-21 Anca Dumitrache , Oana Inel , Benjamin Timmermans , Carlos Ortiz , Robert-Jan Sips , Lora Aroyo , Chris Welty

Recent advances in data-centric artificial intelligence highlight inherent limitations in object recognition datasets. One of the primary issues stems from the semantic gap problem, which results in complex many-to-many mappings between…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Xiaolei Diao , Fausto Giunchiglia