English
Related papers

Related papers: Evaluating Collaborative and Autonomous Agents in …

200 papers

Crowdsourcing allows to instantly recruit workers on the web to annotate image, web page, or document databases. However, worker unreliability prevents taking a workers responses at face value. Thus, responses from multiple workers are…

Information Retrieval · Computer Science 2013-07-31 Aditya Kurve , David J Miller , George Kesidis

With the rapid development of Mobile Internet, spatial crowdsourcing is gaining more and more attention from both academia and industry. In spatial crowdsourcing, spatial tasks are sent to workers based on their locations. A wide kind of…

Databases · Computer Science 2018-04-23 Tianshu Song , Feng Zhu , Ke Xu

Crowdsourcing provides a popular paradigm for data collection at scale. We study the problem of selecting subsets of workers from a given worker pool to maximize the accuracy under a budget constraint. One natural question is whether we…

Machine Learning · Statistics 2015-02-04 Hongwei Li , Qiang Liu

As the use of crowdsourcing increases, it is important to think about performance optimization. For this purpose, it is possible to think about each worker as a HPU(Human Processing Unit), and to draw inspiration from performance…

Human-Computer Interaction · Computer Science 2016-10-17 Chen Cao , Zheng Liu , Lei Chen , H. V. Jagadish

For decades, the crowdsourcing has gained much attention from both academia and industry, which outsources a number of tasks to human workers. Existing works considered improving the task accuracy through voting or learning methods, they…

Databases · Computer Science 2018-02-26 Peng Cheng , Xiang Lian , Xun Jian , Lei Chen

Crowdsourcing has been widely used to efficiently obtain labeled datasets for supervised learning from large numbers of human resources at low cost. However, one of the technical challenges in obtaining high-quality results from…

Human-Computer Interaction · Computer Science 2023-02-28 Ryosuke Ueda , Koh Takeuchi , Hisashi Kashima

The wide spread of mobile devices has enabled a new paradigm of innovation called Mobile Crowdsourcing (MCS) where the concept is to allow entities, e.g., individuals or local authorities, to hire workers to help from the crowd of connected…

Social and Information Networks · Computer Science 2020-04-29 Aymen Hamrouni , Hakim Ghazzai , Turki Alelyani , Yehia Massoud

With the widespread diffusion of smartphones, Spatial Crowdsourcing (SC), which aims to assign spatial tasks to mobile workers, has drawn increasing attention in both academia and industry. One of the major issues is how to best assign…

Social and Information Networks · Computer Science 2022-03-29 Xuanhao Chen , Yan Zhao , Kai Zheng , Bin Yang , Christian S. Jensen

Mobile Crowdsourcing (MCS) is a novel distributed computing paradigm that recruits skilled workers to perform location-dependent tasks. A number of mature incentive mechanisms have been proposed to address the worker recruitment problem in…

Social and Information Networks · Computer Science 2023-09-01 Jianxiong Guo , Qiufen Ni , Weili Wu , Ding-Zhu Du

Low-quality results have been a long-standing problem on microtask crowdsourcing platforms, driving away requesters and justifying low wages for workers. To date, workers have been blamed for low-quality results: they are said to make as…

With the rapid development of crowdsourcing platforms that aggregate the intelligence of Internet workers, crowdsourcing has been widely utilized to address problems that require human cognitive abilities. Considering great dynamics of…

Databases · Computer Science 2018-06-05 Jiayang Tu , Peng Cheng , Lei Chen

Crowdsourcing has emerged as an alternative solution for collecting large scale labels. However, the majority of recruited workers are not domain experts, so their contributed labels could be noisy. In this paper, we propose a two-stage…

Methodology · Statistics 2023-09-28 Qi Xu , Yubai Yuan , Junhui Wang , Annie Qu

Crowdsourcing system has emerged as an effective platform for labeling data with relatively low cost by using non-expert workers. Inferring correct labels from multiple noisy answers on data, however, has been a challenging problem, since…

Human-Computer Interaction · Computer Science 2023-09-14 Doyeon Kim , Jeonghwan Lee , Hye Won Chung

This paper introduces a crowd modeling and motion control approach that employs diffusion adaptation within an adaptive network. In the network, nodes collaboratively address specific estimation problems while simultaneously moving as…

Multiagent Systems · Computer Science 2023-10-25 Zirui Wan , Saeid Sanei

With the rich set of embedded sensors installed in smartphones and the large number of mobile users, we witness the emergence of many innovative commercial mobile crowdsensing applications that combine the power of mobile technology with…

Computer Science and Game Theory · Computer Science 2015-03-23 Man Hon Cheung , Richard Southwell , Fen Hou , Jianwei Huang

When predicting trajectories of road agents, motion predictors usually approximate the future distribution by a limited number of samples. This constraint requires the predictors to generate samples that best support the task given task…

Robotics · Computer Science 2022-05-27 Xin Huang , Guy Rosman , Ashkan Jasour , Stephen G. McGill , John J. Leonard , Brian C. Williams

A critical issue in software development projects in IT service companies is finding the right people at the right time. By enabling assignments of tasks to people to be more fluid, the use of crowdsourcing approaches within a company…

Software Engineering · Computer Science 2020-09-14 Shinobu Saito , Yukako Iimura , Emad Aghayi , Thomas D. LaToza

For robots to be a part of our daily life, they need to be able to navigate among crowds not only safely but also in a socially compliant fashion. This is a challenging problem because humans tend to navigate by implicitly cooperating with…

Robotics · Computer Science 2017-05-18 Anirudh Vemula , Katharina Muelling , Jean Oh

We describe methods to predict a crowd worker's accuracy on new tasks based on his accuracy on past tasks. Such prediction provides a foundation for identifying the best workers to route work to in order to maximize accuracy on the new…

Computers and Society · Computer Science 2013-10-22 Hyun Joon Jung , Matthew Lease

Crowd algorithms often assume workers are inexperienced and thus fail to adapt as workers in the crowd learn a task. These assumptions fundamentally limit the types of tasks that systems based on such algorithms can handle. This paper…

Social and Information Networks · Computer Science 2012-04-20 Walter S. Lasecki , Samuel C. White , Kyle I. Murray , Jeffrey P. Bigham