English
Related papers

Related papers: Study on Patterns and Effect of Task Diversity in …

200 papers

This paper explores mobile crowdsensing, which leverages mobile devices and their users for collective sensing tasks under the coordination of a central requester. The primary challenge here is the variability in the sensing capabilities of…

Machine Learning · Computer Science 2023-12-27 Abdalaziz Sawwan , Jie Wu

Allowing members of the crowd to propose novel microtasks for one another is an effective way to combine the efficiencies of traditional microtask work with the inventiveness and hypothesis generation potential of human workers. However,…

Human-Computer Interaction · Computer Science 2020-12-23 Abigail Hotaling , James P. Bagrow

Crowdsourcing systems often have crowd workers that perform unreliable work on the task they are assigned. In this paper, we propose the use of error-control codes and decoding algorithms to design crowdsourcing systems for reliable…

Information Theory · Computer Science 2015-06-17 Aditya Vempaty , Lav R. Varshney , Pramod K. Varshney

An exciting application of crowdsourcing is to use social networks in complex task execution. In this paper, we address the problem of a planner who needs to incentivize agents within a network in order to seek their help in executing an…

Computer Science and Game Theory · Computer Science 2012-08-09 Swaprava Nath , Pankaj Dayama , Dinesh Garg , Y. Narahari , James Zou

In this paper, we aim to gain a better understanding into how paid microtask crowdsourcing could leverage its appeal and scaling power by using contests to boost crowd performance and engagement. We introduce our microtask-based annotation…

Computers and Society · Computer Science 2019-01-18 Oluwaseyi Feyisetan , Elena Simperl

In this paper we study the trustworthiness of the crowd for crowdsourced software development. Through the study of literature from various domains, we present the risks that impact the trustworthiness in an enterprise context. We survey…

Software Engineering · Computer Science 2018-09-26 Anurag Dwarakanath , Shrikanth N. C. , Kumar Abhinav , Alex Kass

With the widespread diffusion of smartphones, Spatial Crowdsourcing (SC), which aims to assign spatial tasks to mobile workers, has drawn increasing attention in both academia and industry. One of the major issues is how to best assign…

Social and Information Networks · Computer Science 2022-03-29 Xuanhao Chen , Yan Zhao , Kai Zheng , Bin Yang , Christian S. Jensen

Crowdsourcing offers unprecedented potential for solving tasks efficiently by tapping into the skills of large groups of people. A salient feature of crowdsourcing---its openness of entry---makes it vulnerable to malicious behavior. Such…

Social and Information Networks · Computer Science 2014-02-25 Victor Naroditskiy , Nicholas R. Jennings , Pascal Van Hentenryck , Manuel Cebrian

We consider a task assignment problem in crowdsourcing, which is aimed at collecting as many reliable labels as possible within a limited budget. A challenge in this scenario is how to cope with the diversity of tasks and the task-dependent…

Machine Learning · Computer Science 2015-07-22 Hao Zhang , Yao Ma , Masashi Sugiyama

Crowdsourcing offers a practical method for ranking and scoring large amounts of items. To investigate the algorithms and incentives that can be used in crowdsourcing quality evaluations, we built CrowdGrader, a tool that lets students…

Social and Information Networks · Computer Science 2013-08-27 Luca de Alfaro , Michael Shavlovsky

General-purpose crowdsourcing platforms are increasingly being harnessed for creative work. The platforms' potential for creative work is clearly identified, but the workers' perspectives on such work have not been extensively documented.…

Human-Computer Interaction · Computer Science 2020-01-22 Jonas Oppenlaender , Kristy Milland , Aku Visuri , Panos Ipeirotis , Simo Hosio

Context: Task interdependence is a work design factor that expresses the mutual dependency between tasks that compose a whole work. In software development, task interdependencies are created by the technical dependencies between the…

Software Engineering · Computer Science 2023-04-20 Mayara Benício de Barros Souza , Fabio Q. B. da Silva , Carolyn Seaman

Crowdsourcing can solve problems that current fully automated systems cannot. Its effectiveness depends on the reliability, accuracy, and speed of the crowd workers that drive it. These objectives are frequently at odds with one another.…

Human-Computer Interaction · Computer Science 2014-08-29 Walter S. Lasecki , Christopher M. Homan , Jeffrey P. Bigham

We study the causal effects of financial incentives on the quality of crowdwork. We focus on performance-based payments (PBPs), bonus payments awarded to workers for producing high quality work. We design and run randomized behavioral…

Computer Science and Game Theory · Computer Science 2015-03-20 Chien-Ju Ho , Aleksandrs Slivkins , Siddharth Suri , Jennifer Wortman Vaughan

Crowdsourced Software Engineering (CSE) offers outsourcing work to software practitioners by leveraging a global online workforce. However, these software practitioners struggle to identify suitable tasks due to the variety of options…

Software Engineering · Computer Science 2025-03-19 Shashiwadana Nirmani , Mojtaba Shahin , Hourieh Khalajzadeh , Xiao Liu

Crowdsourcing has emerged as a paradigm for leveraging human intelligence and activity to solve a wide range of tasks. However, strategic workers will find enticement in their self-interest to free-ride and attack in a crowdsourcing contest…

Computer Science and Game Theory · Computer Science 2018-01-01 Jianfeng Lu , Yun Xin , Zhao Zhang , Shaojie Tang , Songyuan Yan , Changbing Tang

For decades, the crowdsourcing has gained much attention from both academia and industry, which outsources a number of tasks to human workers. Existing works considered improving the task accuracy through voting or learning methods, they…

Databases · Computer Science 2018-02-26 Peng Cheng , Xiang Lian , Xun Jian , Lei Chen

Existing research in crowdsourcing has investigated how to recommend tasks to workers based on which task the workers have already completed, referred to as {\em implicit feedback}. We, on the other hand, investigate the task recommendation…

Artificial Intelligence · Computer Science 2016-09-08 Habibur Rahman , Lucas Joppa , Senjuti Basu Roy

Crowdsourcing has become an important tool to collect data for various artificial intelligence applications and auction can be an effective way to allocate work and determine reward in a crowdsourcing platform. In this paper, we focus on…

Computer Science and Game Theory · Computer Science 2022-02-22 Timothy Shin Heng Mak , Albert Y. S. Lam

Worker selection is a significant and challenging issue in crowdsourcing systems. Such selection is usually based on an assessment of the reputation of the individual workers participating in such systems. However, assessing the credibility…