English
Related papers

Related papers: Budget-Optimal Task Allocation for Reliable Crowds…

200 papers

Mobile Crowdsourcing (MCS) is the generalized act of outsourcing sensing tasks, traditionally performed by employees or contractors, to a large group of smart-phone users by means of an open call. With the increasing complexity of the…

Computers and Society · Computer Science 2020-04-30 Aymen Hamrouni , Hakim Ghazzai , Turki Alelyani , Yehia Massoud

Crowdsourced software development (CSD) offers a series of specified tasks to a large crowd of trustworthy software workers. Topcoder is a leading platform to manage the whole process of CSD. While increasingly accepted as a realistic…

Software Engineering · Computer Science 2016-10-14 Muhammad Rezaul Karim , David Messinger , Ye Yang , Guenther Ruhe

We present Octopus, an AI agent to jointly balance three conflicting task objectives on a micro-crowdsourcing marketplace - the quality of work, total cost incurred, and time to completion. Previous control agents have mostly focused on…

Artificial Intelligence · Computer Science 2017-08-16 Karan Goel , Shreya Rajpal , Mausam

To ensure quality results from crowdsourced tasks, requesters often aggregate worker responses and use one of a plethora of strategies to infer the correct answer from the set of noisy responses. However, all current models assume prior…

Artificial Intelligence · Computer Science 2012-10-19 Christopher H. Lin , Mausam , Daniel Weld

Outsourcing tasks to previously unknown parties is becoming more common. One specific such problem involves matching a set of workers to a set of tasks. Even if the latter have precise requirements, the quality of individual workers is…

Machine Learning · Computer Science 2017-08-01 Philip Ekman , Sebastian Bellevik , Christos Dimitrakakis , Aristide Tossou

We introduce the problem of Task Assignment and Sequencing (TAS), which adds the timeline perspective to expert crowdsourcing optimization. Expert crowdsourcing involves macrotasks, like document writing, product design, or web development,…

Social and Information Networks · Computer Science 2016-01-18 Heinz Schmitz , Ioanna Lykourentzou

Crowdsourcing has emerged as a paradigm for leveraging human intelligence and activity to solve a wide range of tasks. However, strategic workers will find enticement in their self-interest to free-ride and attack in a crowdsourcing contest…

Computer Science and Game Theory · Computer Science 2018-01-01 Jianfeng Lu , Yun Xin , Zhao Zhang , Shaojie Tang , Songyuan Yan , Changbing Tang

We consider the problem of reconstructing a rank-one matrix from a revealed subset of its entries when some of the revealed entries are corrupted with perturbations that are unknown and can be arbitrarily large. It is not known which…

Machine Learning · Computer Science 2020-10-26 Qianqian Ma , Alex Olshevsky

Crowd-sourcing is a cheap and popular means of creating training and evaluation datasets for machine learning, however it poses the problem of `truth inference', as individual workers cannot be wholly trusted to provide reliable…

Machine Learning · Computer Science 2019-02-26 Yuan Li , Benjamin I. P. Rubinstein , Trevor Cohn

This paper presents a distributed algorithm applicable to a wide range of practical multi-robot applications. In such multi-robot applications, the user-defined objectives of the mission can be cast as a general optimization problem,…

Robotics · Computer Science 2021-12-28 Athanasios Ch. Kapoutsis , Savvas A. Chatzichristofis , Elias B. Kosmatopoulos

We consider a crowdsourcing model in which $n$ workers are asked to rate the quality of $n$ items previously generated by other workers. An unknown set of $\alpha n$ workers generate reliable ratings, while the remaining workers may behave…

Human-Computer Interaction · Computer Science 2016-06-20 Jacob Steinhardt , Gregory Valiant , Moses Charikar

Micro-task crowdsourcing has become a successful mean to obtain high-quality data from a large crowd of diverse people. In this context, trust between all the involved actors (i.e. requesters, workers, and platform owners) is a critical…

Social and Information Networks · Computer Science 2017-02-14 Jie Yang , Alessandro Bozzon

Allocating tasks to heterogeneous robot teams in environments with uncertain task requirements is a fundamentally challenging problem. Redundantly assigning multiple robots to such tasks is overly conservative, while purely reactive…

Robotics · Computer Science 2026-03-23 Ben Rossano , Jaein Lim , Jonathan P. How

Crowdsourcing systems commonly face the problem of aggregating multiple judgments provided by potentially unreliable workers. In addition, several aspects of the design of efficient crowdsourcing processes, such as defining worker's…

Artificial Intelligence · Computer Science 2016-04-20 Matteo Venanzi , John Guiver , Pushmeet Kohli , Nick Jennings

In this paper, we study a novel spatial crowdsourcing system where the workers' time availabilities and their spatial locations are known a priori. Consequently, the tasks assignment to workers is performed not only based on the current…

Social and Information Networks · Computer Science 2015-08-03 Faranak Davoodi

Although freelancing work has grown substantially in recent years, in part facilitated by a number of online labor marketplaces, (e.g., Guru, Freelancer, Amazon Mechanical Turk), traditional forms of "in-sourcing" work continue being the…

Optimization and Control · Mathematics 2020-02-19 Aris Anagnostopoulos , Carlos Castillo , Adriano Fazzone , Stefano Leonardi , Evimaria Terzi

Faster and more cost-efficient, crowdsourced delivery is needed to meet the growing customer demands of many industries, including online shopping, on-demand local delivery, and on-demand transportation. The power of crowdsourced delivery…

Multiagent Systems · Computer Science 2018-07-10 Fuat Basik , Bugra Gedik , Hakan Ferhatosmanoglu , Kun-Lung Wu

Crowdsourcing systems are popular for solving large-scale labelling tasks with low-paid workers. We study the problem of recovering the true labels from the possibly erroneous crowdsourced labels under the popular Dawid-Skene model. To…

Machine Learning · Computer Science 2017-01-13 Jungseul Ok , Sewoong Oh , Jinwoo Shin , Yung Yi

We study a single task allocation problem where each worker connects to some other workers to form a network and the task requester only connects to some of the workers. The goal is to design an allocation mechanism such that each worker is…

Computer Science and Game Theory · Computer Science 2022-01-19 Xiuzhen Zhang , Yao Zhang , Dengji Zhao

With the rapid development of Mobile Internet, spatial crowdsourcing is gaining more and more attention from both academia and industry. In spatial crowdsourcing, spatial tasks are sent to workers based on their locations. A wide kind of…

Databases · Computer Science 2018-04-23 Tianshu Song , Feng Zhu , Ke Xu