English
Related papers

Related papers: Budget-Optimal Task Allocation for Reliable Crowds…

200 papers

Crowdsourcing has emerged as an effective platform for labeling large amounts of data in a cost- and time-efficient manner. Most previous work has focused on designing an efficient algorithm to recover only the ground-truth labels of the…

Human-Computer Interaction · Computer Science 2023-06-01 Hyeonsu Jeong , Hye Won Chung

With the widespread diffusion of smartphones, Spatial Crowdsourcing (SC), which aims to assign spatial tasks to mobile workers, has drawn increasing attention in both academia and industry. One of the major issues is how to best assign…

Social and Information Networks · Computer Science 2022-03-29 Xuanhao Chen , Yan Zhao , Kai Zheng , Bin Yang , Christian S. Jensen

Task selection (picking an appropriate labeling task) and worker selection (assigning the labeling task to a suitable worker) are two major challenges in task assignment for crowdsourcing. Recently, worker selection has been successfully…

Machine Learning · Computer Science 2015-07-28 Hao Zhang , Masashi Sugiyama

We investigate crowdsourcing algorithms for finding the top-quality item within a large collection of objects with unknown intrinsic quality values. This is an important problem with many relevant applications, for example in networked…

Human-Computer Interaction · Computer Science 2017-10-03 Alessandro Nordio , Alberto Tarable , Emilio Leonardi , Marco Ajmone Marsan

Crowdsensing, also known as participatory sensing, is a method of data collection that involves gathering information from a large number of common people (or individuals), often using mobile devices or other personal technologies. This…

Computer Science and Game Theory · Computer Science 2024-05-17 Chattu Bhargavi , Vikash Kumar Singh

Consider designing an effective crowdsourcing system for an $M$-ary classification task. Crowd workers complete simple binary microtasks whose results are aggregated to give the final result. We consider the novel scenario where workers…

Machine Learning · Computer Science 2016-12-14 Qunwei Li , Aditya Vempaty , Lav R. Varshney , Pramod K. Varshney

Context: The success of software crowdsourcing depends on steady tasks supply and active worker pool. Existing analysis reveals an average task failure ratio of 15.7% in software crowdsourcing market. Goal: The objective of this study is to…

Human-Computer Interaction · Computer Science 2020-07-31 Denisse Martinez Mejorado , Razieh Saremi , Ye Yang , Jose E. Ramirez-Marquez

Digital crowdsourcing (CS) is a modern approach to perform certain large projects using small contributions of a large crowd. In CS, a taskmaster typically breaks down the project into small batches of tasks and assigns them to so-called…

Machine Learning · Computer Science 2016-08-29 Farshad Lahouti , Babak Hassibi

Inferring the correct answers to binary tasks based on multiple noisy answers in an unsupervised manner has emerged as the canonical question for micro-task crowdsourcing or more generally aggregating opinions. In graphon estimation, one is…

Machine Learning · Statistics 2019-07-29 Devavrat Shah , Christina Lee Yu

Due to the unreliability of Internet workers, it's difficult to complete a crowdsourcing project satisfactorily, especially when the tasks are multiple and the budget is limited. Recently, meta learning has brought new vitality to few-shot…

Machine Learning · Computer Science 2021-11-09 Guangyang Han , Guoxian Yu , Lizhen Cui , Carlotta Domeniconi , Xiangliang Zhang

In crowdsourcing, a group of common people is asked to execute the tasks and in return will receive some incentives. In this article, one of the crowdsourcing scenarios with multiple heterogeneous tasks and multiple IoT devices (as task…

Computer Science and Game Theory · Computer Science 2023-04-04 Chattu Bhargavi , Vikash Kumar Singh

Worker selection is a significant and challenging issue in crowdsourcing systems. Such selection is usually based on an assessment of the reputation of the individual workers participating in such systems. However, assessing the credibility…

For complex crowdsourcing tasks that require collaboration between multiple individuals, teams should be formed by considering both worker compatibility and expertise. Furthermore, the nature of crowdsourcing dictates the budget for tasks…

Social and Information Networks · Computer Science 2025-11-17 Ryota Yamamoto , Kazushi Okamoto

Low-quality results have been a long-standing problem on microtask crowdsourcing platforms, driving away requesters and justifying low wages for workers. To date, workers have been blamed for low-quality results: they are said to make as…

The prevalence of mobile internet techniques stimulates the emergence of various spatial crowdsourcing applications. Certain of the applications serve for requesters, budget providers, who submit a batch of tasks and a fixed budget to…

Databases · Computer Science 2018-07-27 Jia-Xu Liu , Ke Xu

Spatial crowdsourcing (SC) engages large worker pools for location-based tasks, attracting growing research interest. However, prior SC task allocation approaches exhibit limitations in computational efficiency, balanced matching, and…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-10-20 Kun Li , Shengling Wang , Hongwei Shi , Xiuzhen Cheng , Minghui Xu

We consider crowdsourced labeling under a $d$-type worker-task specialization model, where each worker and task is associated with one particular type among a finite set of types and a worker provides a more reliable answer to tasks of the…

Human-Computer Interaction · Computer Science 2021-06-10 Doyeon Kim , Hye Won Chung

In recent years, crowdsourcing is increasingly applied as a means to enhance data quality. Although the crowd generates insightful information especially for complex problems such as entity resolution (ER), the output quality of crowd…

Databases · Computer Science 2015-12-03 Anja Gruenheid , Besmira Nushi , Tim Kraska , Wolfgang Gatterbauer , Donald Kossmann

With the rapid advancement of mobile networks and the widespread use of mobile devices, spatial crowdsourcing, which involves assigning location-based tasks to mobile workers, has gained significant attention. However, most existing…

Machine Learning · Computer Science 2025-03-28 Jinwen Chen , Jiannan Guo , Dazhuo Qiu , Yawen Li , Guanhua Ye , Yan Zhao , Kai Zheng

We consider effort allocation in crowdsourcing, where we wish to assign labeling tasks to imperfect homogeneous crowd workers to maximize overall accuracy in a continuous-time Bayesian setting, subject to budget and time constraints. The…

Machine Learning · Computer Science 2016-01-01 Weici Hu , Peter I. Frazier