English
Related papers

Related papers: Crowdsourced Outcome Determination in Prediction M…

200 papers

Conventional automated decision-support systems often prioritize predictive accuracy, overlooking the complexities of real-world settings where stakeholders' preferences may diverge or conflict. This can lead to outcomes that disadvantage…

Machine Learning · Computer Science 2025-11-25 Vittoria Vineis , Giuseppe Perelli , Gabriele Tolomei

We consider a crowdsourcing model in which $n$ workers are asked to rate the quality of $n$ items previously generated by other workers. An unknown set of $\alpha n$ workers generate reliable ratings, while the remaining workers may behave…

Human-Computer Interaction · Computer Science 2016-06-20 Jacob Steinhardt , Gregory Valiant , Moses Charikar

Crowdsourcing is the primary means to generate training data at scale, and when combined with sophisticated machine learning algorithms, crowdsourcing is an enabler for a variety of emergent automated applications impacting all spheres of…

Human-Computer Interaction · Computer Science 2016-10-19 Aditya Parameswaran , Akash Das Sarma , Vipul Venkataraman

Empirical evidence suggests that even the most competitive markets are not strictly efficient. Price histories can be used to predict near future returns with a probability better than random chance. Many markets can be considered as {\it…

Statistical Mechanics · Physics 2009-10-31 Yi-Cheng Zhang

Reputation is generally defined as the opinion of a group on an aspect of a thing. This paper presents a reputation model that follows a probabilistic modelling of opinions based on three main concepts: (1) the value of an opinion decays…

Multiagent Systems · Computer Science 2015-04-01 Nardine Osman , Alessandro Provetti , Valerio Riggi , Carles Sierra

We model competition on a credence goods market governed by an imperfect label, signaling high quality, as a rank-order tournament between firms. In this market interaction, asymmetric firms jointly and competitively control the aggregate…

Theoretical Economics · Economics 2025-08-28 Daniel Rehsmann , Béatrice Roussillon , Paul Schweinzer

Every prediction is ultimately used in a downstream task. Consequently, evaluating prediction quality is more meaningful when considered in the context of its downstream use. Metrics based solely on predictive performance often diverge from…

Machine Learning · Computer Science 2025-08-26 Novin Shahroudi , Viacheslav Komisarenko , Meelis Kull

We consider the problem of cost-optimal utilization of a crowdsourcing platform for binary, unsupervised classification of a collection of items, given a prescribed error threshold. Workers on the crowdsourcing platform are assumed to be…

Machine Learning · Computer Science 2022-07-06 Yashvardhan Didwania , Jayakrishnan Nair , N. Hemachandra

Hierarchies of concepts are useful in many applications from navigation to organization of objects. Usually, a hierarchy is created in a centralized manner by employing a group of domain experts, a time-consuming and expensive process. The…

Artificial Intelligence · Computer Science 2015-08-04 Yuyin Sun , Adish Singla , Dieter Fox , Andreas Krause

Public models offer predictions to a variety of downstream tasks and have played a crucial role in various AI applications, showcasing their proficiency in accurate predictions. However, the exclusive emphasis on prediction accuracy may not…

Machine Learning · Computer Science 2024-06-06 Yejia Liu , Jianyi Yang , Pengfei Li , Tongxin Li , Shaolei Ren

Collective intelligence is the ability of a group to perform more effectively than any individual alone. Diversity among group members is a key condition for the emergence of collective intelligence, but maintaining diversity is challenging…

Computer Science and Game Theory · Computer Science 2017-10-18 Richard P. Mann , Dirk Helbing

The large majority of inferences drawn in empirical political research follow from model-based associations (e.g. regression). Here, we articulate the benefits of predictive modeling as a complement to this approach. Predictive models aim…

Methodology · Statistics 2016-12-20 Skyler J. Cranmer , Bruce A. Desmarais

A public decision-making problem consists of a set of issues, each with multiple possible alternatives, and a set of competing agents, each with a preferred alternative for each issue. We study adaptations of market economies to this…

Computer Science and Game Theory · Computer Science 2019-07-23 Nikhil Garg , Ashish Goel , Benjamin Plaut

In markets where algorithmic data processing is increasingly prevalent, recommendation algorithms can substantially affect trade and welfare. We consider a setting in which an algorithm recommends a product based on its value to the buyer…

Theoretical Economics · Economics 2025-06-17 Shota Ichihashi , Alex Smolin

We examine two types of binary betting markets, whose primary goal is for profit (such as sports gambling) or to gain information (such as prediction markets). We articulate the interplay between belief and price-setting to analyse both…

Computer Science and Game Theory · Computer Science 2024-06-07 Haiqing Zhu , Alexander Soen , Yun Kuen Cheung , Lexing Xie

Aggregating signals from a collection of noisy sources is a fundamental problem in many domains including crowd-sourcing, multi-agent planning, sensor networks, signal processing, voting, ensemble learning, and federated learning. The core…

Machine Learning · Computer Science 2022-06-07 Ben Abramowitz , Nicholas Mattei

We propose a probabilistic model to aggregate the answers of respondents answering multiple-choice questions. The model does not assume that everyone has access to the same information, and so does not assume that the consensus answer is…

Machine Learning · Statistics 2017-03-16 John McCoy , Drazen Prelec

We apply the potential force estimation method to artificial time series of market price produced by a deterministic dealer model. We find that dealers' feedback of linear prediction of market price based on the latest mean price changes…

General Finance · Quantitative Finance 2009-11-13 Kenta Yamada , Hideki Takayasu , Misako Takayasu

Automated negotiation can be an efficient method for resolving conflict and redistributing resources in a coalition setting. Automated negotiation has already seen increased usage in fields such as e-commerce and power distribution in smart…

Artificial Intelligence · Computer Science 2020-04-28 Sam Vente , Angelika Kimmig , Alun Preece , Federico Cerutti

Prediction markets are long known for prediction accuracy. This study systematically explores the fundamental properties of prediction markets, addressing questions about their information aggregation process and the factors contributing to…

Trading and Market Microstructure · Quantitative Finance 2023-11-10 Dian Yu , Jianjun Gao , Weiping Wu , Zizhuo Wang