English
Related papers

Related papers: A Data-Driven Analysis of Workers' Earnings on Ama…

200 papers

Recent studies indicated GPT-4 outperforms online crowd workers in data labeling accuracy, notably workers from Amazon Mechanical Turk (MTurk). However, these studies were criticized for deviating from standard crowdsourcing practices and…

Human-Computer Interaction · Computer Science 2024-07-02 Zeyu He , Chieh-Yang Huang , Chien-Kuang Cornelia Ding , Shaurya Rohatgi , Ting-Hao 'Kenneth' Huang

Social media has shaken the foundations of our society, unlikely as it may seem. Many of the popular tools used to moderate harmful digital content, however, have received widespread criticism from both the academic community and the public…

Social and Information Networks · Computer Science 2020-10-21 Jiachen Jiang , Soroush Vosoughi

The report highlights the role of Egyptian data workers in the global value chains of Artificial Intelligence (AI). These workers generate and annotate data for machine learning, check outputs, and they connect with overseas AI producers…

Computers and Society · Computer Science 2026-01-14 Myriam Raymond , Lucy Neveux , Antonio A. Casilli , Paola Tubaro

Crowdsourcing systems accomplish large tasks with scale and speed by breaking work down into independent parts. However, many types of complex creative work, such as fiction writing, have remained out of reach for crowds because work is…

Human-Computer Interaction · Computer Science 2016-11-09 Joy Kim , Sarah Sterman , Allegra Argent Beal Cohen , Michael S. Bernstein

Can advanced multi-modal models effectively tackle complex web-based tasks? Such tasks are often found on crowdsourcing platforms, where crowdworkers engage in challenging micro-tasks within web-based environments. Building on this idea, we…

Artificial Intelligence · Computer Science 2025-02-25 Kevin Xu , Yeganeh Kordi , Tanay Nayak , Adi Asija , Yizhong Wang , Kate Sanders , Adam Byerly , Jingyu Zhang , Benjamin Van Durme , Daniel Khashabi

Artificial Intelligence (AI) will change human work by taking over specific job tasks, but there is a debate which tasks are susceptible to automation, and whether AI will augment or replace workers and affect wages. By combining data on…

General Economics · Economics 2024-04-10 Pelin Ozgul , Marie-Christine Fregin , Michael Stops , Simon Janssen , Mark Levels

In this work, we initiate the investigation of optimization opportunities in collaborative crowdsourcing. Many popular applications, such as collaborative document editing, sentence translation, or citizen science resort to this special…

We consider a simple form of pricing for a crowdsourcing system, where pricing policy is published a priori, and workers then decide their task acceptance. Such a pricing form is widely adopted in practice for its simplicity, e.g., Amazon…

Computer Science and Game Theory · Computer Science 2021-10-28 Suho Shin , Hoyong Choi , Yung Yi , Jungseul Ok

We use algorithmic and network-based tools to build and analyze the bipartite network connecting jobs with the skills they require. We quantify and represent the relatedness between jobs and skills by using statistically validated networks.…

General Economics · Economics 2023-04-12 Sabrina Aufiero , Giordano De Marzo , Angelica Sbardella , Andrea Zaccaria

Workers who earn at or below the minimum wage in the United States are mostly either less educated, young, or female. Little is known, however, concerning the extent to which the minimum wage influences wage differentials among workers with…

General Economics · Economics 2022-06-13 Tatsushi Oka , Ken Yamada

We conduct a study of hiring bias on a simulation platform where we ask Amazon MTurk participants to make hiring decisions for a mathematically intensive task. Our findings suggest hiring biases against Black workers and less attractive…

Computers and Society · Computer Science 2020-01-28 Weiwen Leung , Zheng Zhang , Daviti Jibuti , Jinhao Zhao , Maximillian Klein , Casey Pierce , Lionel Robert , Haiyi Zhu

The goal of our research is to contribute information about how useful the crowd is at anticipating stereotypes that may be biasing a data set without a researcher's knowledge. The results of the crowd's prediction can potentially be used…

Human-Computer Interaction · Computer Science 2018-01-11 Zeyuan Hu , Julia Strout

Online volunteers are an uncompensated yet valuable labor force for many social platforms. For example, volunteer content moderators perform a vast amount of labor to maintain online communities. However, as social platforms like Reddit…

Human-Computer Interaction · Computer Science 2022-06-07 Hanlin Li , Brent Hecht , Stevie Chancellor

Microwork platforms allocate fragmented tasks to crowds of providers with remunerations as low as few cents. Instrumental to the development of today's artificial intelligence, these micro-tasks push to the extreme the logic of…

General Economics · Economics 2019-01-15 Clément Le Ludec , Paola Tubaro , Antonio A. Casilli

A central socioeconomic concern about Artificial Intelligence is that it will lower wages by depressing the labor share - the fraction of economic output paid to labor. We show that declining labor share is more likely to raise wages. In a…

General Economics · Economics 2026-01-13 David Autor , B. N. Kausik

Modern online platforms rely on effective rating systems to learn about items. We consider the optimal design of rating systems that collect binary feedback after transactions. We make three contributions. First, we formalize the…

Machine Learning · Computer Science 2019-04-09 Nikhil Garg , Ramesh Johari

AI generates both enthusiasm and disillusionment, with promises that often go unfulfilled. It is therefore not surprising that human labor, which is its fundamental component, is also subject to these same deceptions. The development of…

Human-Computer Interaction · Computer Science 2024-10-08 Matheus Viana Braz , Paola Tubaro , Antonio A. Casilli

Software crowdsourcing platforms employ extrinsic rewards such as rating or ranking systems to motivate workers. Such rating systems are noisy and provide limited knowledge about workers' preferences and performance. To develop better…

Software Engineering · Computer Science 2022-01-20 Razieh Saremi , Hamid Shamszare , Marzieh Lotfalian Saremi , Ye Yang

Existing literature predominantly focuses on how freelancers individually complete tasks and projects. Our study examines freelancers' willingness to work collaboratively. We report results from a survey of 122 freelancers on a leading…

Human-Computer Interaction · Computer Science 2024-11-13 Zachary Fulker , Christoph Riedl

Contract workers constitute half of India's automotive employment but earn substantially less than permanent workers. Using ASI data (2002-2019), I develop an estimator of labor supply and demand schedules to explain this wage premium. The…

General Economics · Economics 2025-10-28 Davide Luparello