English
Related papers

Related papers: How Much Should I Pay? An Empirical Analysis on Mo…

200 papers

We study the design and approximation of optimal crowdsourcing contests. Crowdsourcing contests can be modeled as all-pay auctions because entrants must exert effort up-front to enter. Unlike all-pay auctions where a usual design objective…

Computer Science and Game Theory · Computer Science 2011-11-15 Shuchi Chawla , Jason D. Hartline , Balasubramanian Sivan

Crowdsourcing is a form of "peer production" in which work traditionally performed by an employee is outsourced to an "undefined, generally large group of people in the form of an open call." We present a model of workers supplying labor to…

Human-Computer Interaction · Computer Science 2010-04-19 John Horton , Lydia Chilton

In this paper we consider a mechanism design problem in the context of large-scale crowdsourcing markets such as Amazon's Mechanical Turk, ClickWorker, CrowdFlower. In these markets, there is a requester who wants to hire workers to…

Computer Science and Game Theory · Computer Science 2014-08-14 Nima Anari , Gagan Goel , Afshin Nikzad

Peer prediction incentive mechanisms for crowdsourcing are generally limited to eliciting samples from categorical distributions. Prior work on extending peer prediction to arbitrary distributions has largely relied on assumptions on the…

Computer Science and Game Theory · Computer Science 2023-12-20 Adam Richardson , Boi Faltings

Modern machine learning algorithms need large datasets to be trained. Crowdsourcing has become a popular approach to label large datasets in a shorter time as well as at a lower cost comparing to that needed for a limited number of experts.…

Human-Computer Interaction · Computer Science 2019-12-11 Alexey Drutsa , Viktoriya Farafonova , Valentina Fedorova , Olga Megorskaya , Evfrosiniya Zerminova , Olga Zhilinskaya

Crowdsourcing has emerged as a paradigm for leveraging human intelligence and activity to solve a wide range of tasks. However, strategic workers will find enticement in their self-interest to free-ride and attack in a crowdsourcing contest…

Computer Science and Game Theory · Computer Science 2018-01-01 Jianfeng Lu , Yun Xin , Zhao Zhang , Shaojie Tang , Songyuan Yan , Changbing Tang

Multi-Access edge computing (MEC) is an emerging paradigm where users offload computationally intensive jobs to the Access Point (AP). Given that the AP's resources are shared by selfish users, pricing is a useful tool for incentivising…

Information Theory · Computer Science 2020-09-01 Lingxiang Li , Marie Siew , Tony Q. S. Quek , Zhi Chen

An important class of game-theoretic incentive mechanisms for eliciting effort from a crowd are the peer based mechanisms, in which workers are paid by matching their answers with one another. The other classic mechanism is to have the…

Computer Science and Game Theory · Computer Science 2018-11-16 Naman Goel , Boi Faltings

Crowdsourcing platforms provide marketplaces where task requesters can pay to get labels on their data. Such markets have emerged recently as popular venues for collecting annotations that are crucial in training machine learning models in…

Machine Learning · Computer Science 2017-08-28 Ashish Khetan , Sewoong Oh

Crowdsourcing utilizes the wisdom of crowds for collective classification via information (e.g., labels of an item) provided by labelers. Current crowdsourcing algorithms are mainly unsupervised methods that are unaware of the quality of…

Social and Information Networks · Computer Science 2016-11-15 Pin-Yu Chen , Chia-Wei Lien , Fu-Jen Chu , Pai-Shun Ting , Shin-Ming Cheng

Crowdsourcing is an online outsourcing mode which can solve the current machine learning algorithm's urge need for massive labeled data. Requester posts tasks on crowdsourcing platforms, which employ online workers over the Internet to…

Human-Computer Interaction · Computer Science 2022-04-28 Guangyang Han , Sufang Li , Runmin Wang , Chunming Wu

We describe methods to predict a crowd worker's accuracy on new tasks based on his accuracy on past tasks. Such prediction provides a foundation for identifying the best workers to route work to in order to maximize accuracy on the new…

Computers and Society · Computer Science 2013-10-22 Hyun Joon Jung , Matthew Lease

We investigate crowdsourcing algorithms for finding the top-quality item within a large collection of objects with unknown intrinsic quality values. This is an important problem with many relevant applications, for example in networked…

Human-Computer Interaction · Computer Science 2017-10-03 Alessandro Nordio , Alberto Tarable , Emilio Leonardi , Marco Ajmone Marsan

Stock price prediction is a complicated and interesting task. Noisy trends make stock pricing sensitive and complicated while the economical motivation behind, keeps it interesting for researchers and investors. In this paper we are to…

Optimization and Control · Mathematics 2023-12-19 Negin Bagherpour

The Triple Scoring Task at the WSDM Cup 2017 involves the prediction of the relevance scores between persons and professions/nationalities. The ground truth of the relevance scores was obtained by counting the vote of seven crowdworkers. I…

Information Retrieval · Computer Science 2017-12-25 Masahiro Sato

Artificial intelligence algorithms are increasingly used by firms to set prices. Previous research shows that they can exhibit collusive behaviour, but how quickly they can do so has so far remained an open question. I show that a modern…

General Economics · Economics 2026-04-20 Kevin Michael Frick

This paper proposes a novel method for demand forecasting in a pricing context. Here, modeling the causal relationship between price as an input variable to demand is crucial because retailers aim to set prices in a (profit) optimal manner…

Incentives are key to the success of crowdsourcing which heavily depends on the level of user participation. This paper designs an incentive mechanism to motivate a heterogeneous crowd of users to actively participate in crowdsourcing…

Multiagent Systems · Computer Science 2018-12-13 Tie Luo , Salil S. Kanhere , Sajal K. Das , Hwee-Pink Tan

We consider a crowdsourcing model in which $n$ workers are asked to rate the quality of $n$ items previously generated by other workers. An unknown set of $\alpha n$ workers generate reliable ratings, while the remaining workers may behave…

Human-Computer Interaction · Computer Science 2016-06-20 Jacob Steinhardt , Gregory Valiant , Moses Charikar

Crowdsourced software development (CSD) offers a series of specified tasks to a large crowd of trustworthy software workers. Topcoder is a leading platform to manage the whole process of CSD. While increasingly accepted as a realistic…

Software Engineering · Computer Science 2016-10-14 Muhammad Rezaul Karim , David Messinger , Ye Yang , Guenther Ruhe