English
Related papers

Related papers: Crowd Coach: Peer Coaching for Crowd Workers' Skil…

200 papers

With the increasing deployment of artificial intelligence (AI) technologies, the potential of humans working with AI agents has been growing at a great speed. Human-AI teaming is an important paradigm for studying various aspects when…

Human-Computer Interaction · Computer Science 2025-01-03 Lingyu Zhang , Zhengran Ji , Boyuan Chen

A critical issue in software development projects in IT service companies is finding the right people at the right time. By enabling assignments of tasks to people to be more fluid, the use of crowdsourcing approaches within a company…

Software Engineering · Computer Science 2020-09-14 Shinobu Saito , Yukako Iimura , Emad Aghayi , Thomas D. LaToza

Computations related to learning processes within an organizational social network area require some network model preparation and specific algorithms in order to implement human behaviors in simulated environments. The proposals in this…

Computers and Society · Computer Science 2015-05-13 Przemyslaw Rozewski , Jaroslaw Jankowski , Piotr Brodka , Radoslaw Michalski

Crowdsourcing enables the solicitation of forecasts on a variety of prediction tasks from distributed groups of people. How to aggregate the solicited forecasts, which may vary in quality, into an accurate final prediction remains a…

Methodology · Statistics 2022-03-31 Juntao Wang , Yang Liu , Yiling Chen

Crowdsourcing has emerged as an alternative solution for collecting large scale labels. However, the majority of recruited workers are not domain experts, so their contributed labels could be noisy. In this paper, we propose a two-stage…

Methodology · Statistics 2023-09-28 Qi Xu , Yubai Yuan , Junhui Wang , Annie Qu

A growing number of people are working as part of on-line crowd work, which has been characterized by its low wages; yet, we know little about wage distribution and causes of low/high earnings. We recorded 2,676 workers performing 3.8…

Computers and Society · Computer Science 2017-12-29 Kotaro Hara , Abi Adams , Kristy Milland , Saiph Savage , Chris Callison-Burch , Jeffrey Bigham

Mobile Crowdsensing has become main stream paradigm for researchers to collect behavioral data from citizens in large scales. This valuable data can be leveraged to create centralized repositories that can be used to train advanced…

Computers and Society · Computer Science 2022-01-21 Michael Cho , Afra Mashhadi

Very recently crowdsourcing has become the de facto platform for distributing and collecting human computation for a wide range of tasks and applications such as information retrieval, natural language processing and machine learning.…

Machine Learning · Computer Science 2013-05-21 Ittai Abraham , Omar Alonso , Vasilis Kandylas , Aleksandrs Slivkins

Worker quality control is a crucial aspect of crowdsourcing systems; typically occupying a large fraction of the time and money invested on crowdsourcing. In this work, we devise techniques to generate confidence intervals for worker error…

Databases · Computer Science 2014-11-25 Manas Joglekar , Hector Garcia-Molina , Aditya Parameswaran

As freelancing work keeps on growing almost everywhere due to a sharp decrease in communication costs and to the widespread of Internet-based labour marketplaces (e.g., guru.com, feelancer.com, mturk.com, upwork.com), many researchers and…

Computers and Society · Computer Science 2020-02-27 Giorgio Barnabò , Adriano Fazzone , Stefano Leonardi , Chris Schwiegelshohn

Crowdsensing is a promising sensing paradigm for smart city applications (e.g., traffic and environment monitoring) with the prevalence of smart mobile devices and advanced network infrastructure. Meanwhile, as tasks are performed by…

Cryptography and Security · Computer Science 2020-11-09 Leye Wang , Han Yu , Xiao Han

Internet-connected smart devices are increasing at an exponential rate. These powerful devices have created a yet-untapped pool of idle resources that can be utilised, among others, for processing data in resource-depleted environments. The…

Software Engineering · Computer Science 2023-02-14 Niroshinie Fernando , Chetan Arora , Seng W. Loke , Lubna Alam , Stephen La Macchia , Helen Graesser

We propose an improved algorithm by identifying and encouraging cooperative behavior in multi-agent environments. First, we analyze the shortcomings of existing algorithms in addressing multi-agent reinforcement learning problems. Then,…

Multiagent Systems · Computer Science 2025-08-21 Junjie Qi , Siqi Mao , Tianyi Tan

Crowdsensing is an emerging paradigm of ubiquitous sensing, through which a crowd of workers are recruited to perform sensing tasks collaboratively. Although it has stimulated many applications, an open fundamental problem is how to select…

Computers and Society · Computer Science 2022-05-09 Feng Li , Jichao Zhao , Dongxiao Yu , Xiuzhen Cheng , Weifeng Lv

The growing spread of online misinformation has created an urgent need for scalable, reliable fact-checking solutions. Crowdsourced fact-checking - where non-experts evaluate claim veracity - offers a cost-effective alternative to expert…

Computation and Language · Computer Science 2025-10-28 Luigia Costabile , Gian Marco Orlando , Valerio La Gatta , Vincenzo Moscato

Traditionally, psychophysical experiments are conducted by repeated measurements on a few well-trained participants under well-controlled conditions, often resulting in, if done properly, high quality data. In recent years, however,…

Machine Learning · Computer Science 2019-07-29 Siavash Haghiri , Patricia Rubisch , Robert Geirhos , Felix Wichmann , Ulrike von Luxburg

Hybrid human/computer systems promise to greatly expand the usefulness of query processing by incorporating the crowd for data gathering and other tasks. Such systems raise many database system implementation questions. Perhaps most…

Databases · Computer Science 2012-02-13 Beth Trushkowsky , Tim Kraska , Michael J. Franklin , Purnamrita Sarkar

Crowdsourced mobile edge caching and sharing (Crowd-MECS) is emerging as a promising content delivery paradigm by employing a large crowd of existing edge devices (EDs) to cache and share popular contents. The successful technology adoption…

Computer Science and Game Theory · Computer Science 2020-03-11 Changkun Jiang , Lin Gao , Tong Wang , Yufei Jiang , Jianqiang Li

Distilling advanced Large Language Models' instruction-following capabilities into smaller models using a selected subset has become a mainstream approach in model training. While existing synthetic instruction data selection strategies…

Computation and Language · Computer Science 2025-03-04 Yisen Li , Lingfeng Yang , Wenxuan Shen , Pan Zhou , Yao Wan , Weiwei Lin , Dongping Chen

We initiate a principled study of algorithmic collective action on digital platforms that deploy machine learning algorithms. We propose a simple theoretical model of a collective interacting with a firm's learning algorithm. The collective…

Machine Learning · Computer Science 2024-08-08 Moritz Hardt , Eric Mazumdar , Celestine Mendler-Dünner , Tijana Zrnic