English
Related papers

Related papers: Dynamic Task Allocation for Crowdsourcing Settings

200 papers

Task selection (picking an appropriate labeling task) and worker selection (assigning the labeling task to a suitable worker) are two major challenges in task assignment for crowdsourcing. Recently, worker selection has been successfully…

Machine Learning · Computer Science 2015-07-28 Hao Zhang , Masashi Sugiyama

Crowdsourcing system has emerged as an effective platform for labeling data with relatively low cost by using non-expert workers. Inferring correct labels from multiple noisy answers on data, however, has been a challenging problem, since…

Human-Computer Interaction · Computer Science 2023-09-14 Doyeon Kim , Jeonghwan Lee , Hye Won Chung

While microtask crowdsourcing provides a new way to solve large volumes of small tasks at a much lower price compared with traditional in-house solutions, it suffers from quality problems due to the lack of incentives. On the other hand,…

Computer Science and Game Theory · Computer Science 2013-05-30 Yang Gao , Yan Chen , K. J. Ray Liu

Spatial crowdsourcing refers to a system that periodically assigns a number of location-based workers with spatial tasks nearby (e.g., taking photos or videos at some spatial locations). Previous works on the spatial crowdsourcing usually…

Databases · Computer Science 2018-02-26 Peng Cheng , Xiang Lian , Lei Chen , Cyrus Shahabi

Spatial crowdsourcing (SC) engages large worker pools for location-based tasks, attracting growing research interest. However, prior SC task allocation approaches exhibit limitations in computational efficiency, balanced matching, and…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-10-20 Kun Li , Shengling Wang , Hongwei Shi , Xiuzhen Cheng , Minghui Xu

Several works related to spatial crowdsourcing have been proposed in the direction where the task executers are to perform the tasks within the stipulated deadlines. Though the deadlines are set, it may be a practical scenario that majority…

Computational Engineering, Finance, and Science · Computer Science 2024-02-08 Naren Debnath , Sajal Mukhopadhyay , Fatos Xhafa

This paper presents the first systematic investigation of the potential performance gains for crowd work systems, deriving from available information at the requester about individual worker reputation. In particular, we first formalize the…

Human-Computer Interaction · Computer Science 2016-05-27 A. Tarable , A. Nordio , E. Leonardi , M. Ajmone Marsan

Over the past decade, crowdsourcing has emerged as a cheap and efficient method of obtaining solutions to simple tasks that are difficult for computers to solve but possible for humans. The popularity and promise of crowdsourcing markets…

Social and Information Networks · Computer Science 2013-11-27 Aleksandrs Slivkins , Jennifer Wortman Vaughan

Crowdsourcing and human computation has been employed in increasingly sophisticated projects that require the solution of a heterogeneous set of tasks. We explore the challenge of building or hiring an effective team, for performing tasks…

Human-Computer Interaction · Computer Science 2015-08-14 Adish Singla , Eric Horvitz , Pushmeet Kohli , Andreas Krause

With the rich set of embedded sensors installed in smartphones and the large number of mobile users, we witness the emergence of many innovative commercial mobile crowdsensing applications that combine the power of mobile technology with…

Computer Science and Game Theory · Computer Science 2015-03-23 Man Hon Cheung , Richard Southwell , Fen Hou , Jianwei Huang

We study crowdsourcing quality management, that is, given worker responses to a set of tasks, our goal is to jointly estimate the true answers for the tasks, as well as the quality of the workers. Prior work on this problem relies primarily…

Other Computer Science · Computer Science 2015-03-03 Akash Das Sarma , Aditya Parameswaran , Jennifer Widom

Crowdsourcing platforms provide marketplaces where task requesters can pay to get labels on their data. Such markets have emerged recently as popular venues for collecting annotations that are crucial in training machine learning models in…

Machine Learning · Computer Science 2017-08-28 Ashish Khetan , Sewoong Oh

Opinions about the 2016 U.S. Presidential Candidates have been expressed in millions of tweets that are challenging to analyze automatically. Crowdsourcing the analysis of political tweets effectively is also difficult, due to large…

Human-Computer Interaction · Computer Science 2017-02-10 Mehrnoosh Sameki , Mattia Gentil , Kate K. Mays , Lei Guo , Margrit Betke

We consider a task assignment problem in crowdsourcing, which is aimed at collecting as many reliable labels as possible within a limited budget. A challenge in this scenario is how to cope with the diversity of tasks and the task-dependent…

Machine Learning · Computer Science 2015-07-22 Hao Zhang , Yao Ma , Masashi Sugiyama

Crowdsourcing can solve problems that current fully automated systems cannot. Its effectiveness depends on the reliability, accuracy, and speed of the crowd workers that drive it. These objectives are frequently at odds with one another.…

Human-Computer Interaction · Computer Science 2014-08-29 Walter S. Lasecki , Christopher M. Homan , Jeffrey P. Bigham

Crowdsourcing is a relatively economic and efficient solution to collect annotations from the crowd through online platforms. Answers collected from workers with different expertise may be noisy and unreliable, and the quality of annotated…

Machine Learning · Computer Science 2020-01-08 Jingzheng Tu , Guoxian Yu , Jun Wang , Carlotta Domeniconi , Xiangliang Zhang

We consider the problem of dynamically allocating tasks to multiple agents under time window constraints and task completion uncertainty. Our objective is to minimize the number of unsuccessful tasks at the end of the operation horizon. We…

Robotics · Computer Science 2020-07-28 Shushman Choudhury , Jayesh K. Gupta , Mykel J. Kochenderfer , Dorsa Sadigh , Jeannette Bohg

In this study, we investigate the resource management challenges in next-generation mobile crowdsensing networks with the goal of minimizing task completion latency while ensuring coverage performance, i.e., an essential metric to ensure…

Networking and Internet Architecture · Computer Science 2025-03-31 Yaru Fu , Yue Zhang , Zheng Shi , Yongna Guo , Yalin Liu

Robot swarms offer the potential to bring several advantages to the real-world applications but deploying them presents challenges in ensuring feasibility across diverse environments. Assessing the feasibility of new tasks for swarms is…

Robotics · Computer Science 2024-05-14 Samratul Fuady , Danesh Tarapore , Shoaib Ehsan , Mohammad D. Soorati

Crowdsourcing refers to the arrangement in which contributions are solicited from a large group of unrelated people. Due to this nature, crowdsourcers (or task requesters) often face uncertainty about the workers' capabilities which, in…

Multiagent Systems · Computer Science 2016-01-25 Han Yu