English
Related papers

Related papers: A Survey on Task Assignment in Crowdsourcing

200 papers

The problem of allocating tasks to workers is of long standing fundamental importance. Examples of this include the classical problem of assigning computing tasks to nodes in a distributed computing environment, as well as the more recent…

Computer Science and Game Theory · Computer Science 2017-09-04 Chen Hajaj , Yevgeniy Vorobeychik

Crowdsourcing has become an important tool to collect data for various artificial intelligence applications and auction can be an effective way to allocate work and determine reward in a crowdsourcing platform. In this paper, we focus on…

Computer Science and Game Theory · Computer Science 2022-02-22 Timothy Shin Heng Mak , Albert Y. S. Lam

Very recently crowdsourcing has become the de facto platform for distributing and collecting human computation for a wide range of tasks and applications such as information retrieval, natural language processing and machine learning.…

Machine Learning · Computer Science 2013-05-21 Ittai Abraham , Omar Alonso , Vasilis Kandylas , Aleksandrs Slivkins

With the rapid development of mobile devices and crowdsourcing platforms, the spatial crowdsourcing has attracted much attention from the database community. Specifically, the spatial crowdsourcing refers to sending location-based requests…

Databases · Computer Science 2016-10-27 Peng Cheng , Xiang Lian , Lei Chen , Jinsong Han , Jizhong Zhao

Crowdsourcing with the intelligent agents carrying smart devices is becoming increasingly popular in recent years. It has opened up meeting an extensive list of real life applications such as measuring air pollution level, road traffic…

Computer Science and Game Theory · Computer Science 2022-03-18 Vikash Kumar Singh , Anjani Samhitha Jasti , Sunil Kumar Singh , Sanket Mishra

While microtask crowdsourcing provides a new way to solve large volumes of small tasks at a much lower price compared with traditional in-house solutions, it suffers from quality problems due to the lack of incentives. On the other hand,…

Computer Science and Game Theory · Computer Science 2013-05-30 Yang Gao , Yan Chen , K. J. Ray Liu

Crowdsourcing can solve problems that current fully automated systems cannot. Its effectiveness depends on the reliability, accuracy, and speed of the crowd workers that drive it. These objectives are frequently at odds with one another.…

Human-Computer Interaction · Computer Science 2014-08-29 Walter S. Lasecki , Christopher M. Homan , Jeffrey P. Bigham

Existing research in crowdsourcing has investigated how to recommend tasks to workers based on which task the workers have already completed, referred to as {\em implicit feedback}. We, on the other hand, investigate the task recommendation…

Artificial Intelligence · Computer Science 2016-09-08 Habibur Rahman , Lucas Joppa , Senjuti Basu Roy

Crowdsourcing platforms emerged as popular venues for purchasing human intelligence at low cost for large volume of tasks. As many low-paid workers are prone to give noisy answers, a common practice is to add redundancy by assigning…

Machine Learning · Computer Science 2018-10-09 Jungseul Ok , Sewoong Oh , Yunhun Jang , Jinwoo Shin , Yung Yi

The main goal of this paper is to discuss how to integrate the possibilities of crowdsourcing platforms with systems supporting workflow to enable the engagement and interaction with business tasks of a wider group of people. Thus, this…

Human-Computer Interaction · Computer Science 2021-01-05 Rafał Masłyk , Kinga Skorupska , Piotr Gago , Marcin Niewiński , Barbara Karpowicz , Anna Jaskulska , Katarzyna Abramczuk , Wiesław Kopeć

We study crowdsourcing quality management, that is, given worker responses to a set of tasks, our goal is to jointly estimate the true answers for the tasks, as well as the quality of the workers. Prior work on this problem relies primarily…

Other Computer Science · Computer Science 2015-03-03 Akash Das Sarma , Aditya Parameswaran , Jennifer Widom

Mobile Crowd Sensing (MCS) is the special case of crowdsourcing, which leverages the smartphones with various embedded sensors and user's mobility to sense diverse phenomenon in a city. Task allocation is a fundamental research issue in…

Human-Computer Interaction · Computer Science 2018-08-07 Jiangtao Wang , Leye Wang , Yasha Wang , Daqing Zhang , Linghe Kong

Worker quality control is a crucial aspect of crowdsourcing systems; typically occupying a large fraction of the time and money invested on crowdsourcing. In this work, we devise techniques to generate confidence intervals for worker error…

Databases · Computer Science 2014-11-25 Manas Joglekar , Hector Garcia-Molina , Aditya Parameswaran

This paper explores and offers guidance on a specific and relevant problem in task design for crowdsourcing: how to formulate a complex question used to classify a set of items. In micro-task markets, classification is still among the most…

Human-Computer Interaction · Computer Science 2020-11-19 Jorge Ramírez , Marcos Baez , Fabio Casati , Luca Cernuzzi , Boualem Benatallah , Ekaterina A. Taran , Veronika A. Malanina

Crowd-sourcing deals with solving problems by assigning them to a large number of non-experts called crowd using their spare time. In these systems, the final answer to the question is determined by summing up the votes obtained from the…

Computational Engineering, Finance, and Science · Computer Science 2024-07-04 Samin Nili Ahmadabadi , Maryam Haghifam , Vahid Shah-Mansouri , Sara Ershadmanesh

With the widespread diffusion of smartphones, Spatial Crowdsourcing (SC), which aims to assign spatial tasks to mobile workers, has drawn increasing attention in both academia and industry. One of the major issues is how to best assign…

Social and Information Networks · Computer Science 2022-03-29 Xuanhao Chen , Yan Zhao , Kai Zheng , Bin Yang , Christian S. Jensen

Data fusion has played an important role in data mining because high-quality data is required in a lot of applications. As on-line data may be out-of-date and errors in the data may propagate with copying and referring between sources, it…

Databases · Computer Science 2017-02-03 Yunfan Chen , Lei Chen , Chen Jason Zhang

Crowdsourcing-based content moderation is a platform that hosts content moderation tasks for crowd workers to review user submissions (e.g. text, images and videos) and make decisions regarding the admissibility of the posted content, along…

Computer Science and Game Theory · Computer Science 2021-06-08 Sainath Sanga , Venkata Sriram Siddhardh Nadendla

A main characteristic of crowdsourcing software development (CSD) is the complexity of tasks and skills required by workers to achieve successful software crowdsourcing. The tasks proposed to the crowd in CSD are checked to ensure they are…

Software Engineering · Computer Science 2023-02-13 Abdullah Khanfor

Crowdsourcing system has emerged as an effective platform for labeling data with relatively low cost by using non-expert workers. Inferring correct labels from multiple noisy answers on data, however, has been a challenging problem, since…

Human-Computer Interaction · Computer Science 2023-09-14 Doyeon Kim , Jeonghwan Lee , Hye Won Chung