English
Related papers

Related papers: Finding the Ground-Truth from Multiple Labellers: …

200 papers

NLP benchmarks rely on standardized datasets for training and evaluating models and are crucial for advancing the field. Traditionally, expert annotations ensure high-quality labels; however, the cost of expert annotation does not scale…

Computation and Language · Computer Science 2025-09-15 Omer Nahum , Nitay Calderon , Orgad Keller , Idan Szpektor , Roi Reichart

Crowdsourced labels play a crucial role in evaluating task-oriented dialogue systems (TDSs). Obtaining high-quality and consistent ground-truth labels from annotators presents challenges. When evaluating a TDS, annotators must fully…

Computation and Language · Computer Science 2024-04-16 Clemencia Siro , Mohammad Aliannejadi , Maarten de Rijke

Supervised machine learning assumes that labeled data provide accurate measurements of the concepts models are meant to learn. Yet in practice, human labeling introduces systematic variation arising from ambiguous items, divergent…

Methodology · Statistics 2026-04-10 Robert Chew , Stephanie Eckman , Christoph Kern , Frauke Kreuter

This paper presents the first systematic investigation of the potential performance gains for crowd work systems, deriving from available information at the requester about individual worker reputation. In particular, we first formalize the…

Human-Computer Interaction · Computer Science 2016-05-27 A. Tarable , A. Nordio , E. Leonardi , M. Ajmone Marsan

Supervised learning, especially supervised deep learning, requires large amounts of labeled data. One approach to collect large amounts of labeled data is by using a crowdsourcing platform where numerous workers perform the annotation…

Machine Learning · Computer Science 2023-08-22 Kosuke Yoshimura , Hisashi Kashima

Crowdsourcing utilizes the wisdom of crowds for collective classification via information (e.g., labels of an item) provided by labelers. Current crowdsourcing algorithms are mainly unsupervised methods that are unaware of the quality of…

Social and Information Networks · Computer Science 2016-11-15 Pin-Yu Chen , Chia-Wei Lien , Fu-Jen Chu , Pai-Shun Ting , Shin-Ming Cheng

Crowdsourcing has been part of the IR toolbox as a cheap and fast mechanism to obtain labels for system development and evaluation. Successful deployment of crowdsourcing at scale involves adjusting many variables, a very important one…

Artificial Intelligence · Computer Science 2016-05-20 Ittai Abraham , Omar Alonso , Vasilis Kandylas , Rajesh Patel , Steven Shelford , Aleksandrs Slivkins

Many machine learning systems today are trained on large amounts of human-annotated data. Data annotation tasks that require a high level of competency make data acquisition expensive, while the resulting labels are often subjective,…

Machine Learning · Computer Science 2020-04-08 Emmanouil Antonios Platanios , Maruan Al-Shedivat , Eric Xing , Tom Mitchell

The recent boom in crowdsourcing has opened up a new avenue for utilizing human intelligence in the realm of data analysis. This innovative approach provides a powerful means for connecting online workers to tasks that cannot effectively be…

Applications · Statistics 2024-02-29 Chen Jason Zhang , Yunrui Liu , Pengcheng Zeng , Ting Wu , Lei Chen , Pan Hui , Fei Hao

Crowd-sourcing is a cheap and popular means of creating training and evaluation datasets for machine learning, however it poses the problem of `truth inference', as individual workers cannot be wholly trusted to provide reliable…

Machine Learning · Computer Science 2019-02-26 Yuan Li , Benjamin I. P. Rubinstein , Trevor Cohn

Whether Large Language Models (LLMs) can outperform crowdsourcing on the data annotation task is attracting interest recently. Some works verified this issue with the average performance of individual crowd workers and LLM workers on some…

Computation and Language · Computer Science 2024-01-19 Jiyi Li

The extensive use of online social media has highlighted the importance of privacy in the digital space. As more scientists analyse the data created in these platforms, privacy concerns have extended to data usage within the academia.…

Human-Computer Interaction · Computer Science 2022-03-04 Giannis Haralabopoulos , Ioannis Anagnostopoulos

For the purpose of efficient and cost-effective large-scale data labeling, crowdsourcing is increasingly being utilized. To guarantee the quality of data labeling, multiple annotations need to be collected for each data sample, and truth…

Human-Computer Interaction · Computer Science 2024-03-15 Fei Wang , Haoyu Liu , Haoyang Bi , Xiangzhuang Shen , Renyu Zhu , Runze Wu , Minmin Lin , Tangjie Lv , Changjie Fan , Qi Liu , Zhenya Huang , Enhong Chen

We investigate the dynamics of increasing the number of model parameters versus the number of labeled examples across a wide variety of tasks. Our exploration reveals that while scaling parameters consistently yields performance…

Computation and Language · Computer Science 2021-10-12 Yuval Kirstain , Patrick Lewis , Sebastian Riedel , Omer Levy

Crowdsourcing information constitutes an important aspect of human-in-the-loop learning for researchers across multiple disciplines such as AI, HCI, and social science. While using crowdsourced data for subjective tasks is not new,…

Human-Computer Interaction · Computer Science 2019-06-19 Ramya Srinivasan , Ajay Chander

Eliciting labels from crowds is a potential way to obtain large labeled data. Despite a variety of methods developed for learning from crowds, a key challenge remains unsolved: \emph{learning from crowds without knowing the information…

Machine Learning · Computer Science 2019-06-04 Peng Cao , Yilun Xu , Yuqing Kong , Yizhou Wang

Crowdsourcing is an online outsourcing mode which can solve the current machine learning algorithm's urge need for massive labeled data. Requester posts tasks on crowdsourcing platforms, which employ online workers over the Internet to…

Human-Computer Interaction · Computer Science 2022-04-28 Guangyang Han , Sufang Li , Runmin Wang , Chunming Wu

The Dawid-Skene model is the most widely assumed model in the analysis of crowdsourcing algorithms that estimate ground-truth labels from noisy worker responses. In this work, we are motivated by crowdsourcing applications where workers…

Machine Learning · Computer Science 2024-08-13 Saptarshi Mandal , Seo Taek Kong , Dimitrios Katselis , R. Srikant

Crowdsourcing is widely used to create data for common natural language understanding tasks. Despite the importance of these datasets for measuring and refining model understanding of language, there has been little focus on the…

Computation and Language · Computer Science 2021-06-03 Nikita Nangia , Saku Sugawara , Harsh Trivedi , Alex Warstadt , Clara Vania , Samuel R. Bowman

Human variation in labeling is often considered noise. Annotation projects for machine learning (ML) aim at minimizing human label variation, with the assumption to maximize data quality and in turn optimize and maximize machine learning…

Computation and Language · Computer Science 2022-11-07 Barbara Plank