English
Related papers

Related papers: Strictly Proper Scoring Mechanisms Without Expecte…

200 papers

Algorithmic decision making systems are ubiquitous across a wide variety of online as well as offline services. These systems rely on complex learning methods and vast amounts of data to optimize the service functionality, satisfaction of…

Machine Learning · Statistics 2017-03-27 Muhammad Bilal Zafar , Isabel Valera , Manuel Gomez Rodriguez , Krishna P. Gummadi

Proportionality is an attractive fairness concept that has been applied to a range of problems including the facility location problem, a classic problem in social choice. In our work, we propose a concept called Strong Proportionality,…

Computer Science and Game Theory · Computer Science 2022-06-15 Haris Aziz , Alexander Lam , Mashbat Suzuki , Toby Walsh

Bayesian experts who are exposed to different evidence often make contradictory probabilistic forecasts. An aggregator, ignorant of the underlying model, uses this to calculate her own forecast. We use the notions of scoring rules and…

Economics · Quantitative Finance 2018-02-13 Itai Areili , Yakov Babichenko , Rann Smorodinsky

Wagering mechanisms are one-shot betting mechanisms that elicit agents' predictions of an event. For deterministic wagering mechanisms, an existing impossibility result has shown incompatibility of some desirable theoretical properties. In…

Computer Science and Game Theory · Computer Science 2022-03-31 Yiling Chen , Yang Liu , Juntao Wang

We are interested in probabilistic prediction in online settings in which data does not follow a probability distribution. Our work seeks to achieve two goals: (1) producing valid probabilities that accurately reflect model confidence; and…

Machine Learning · Computer Science 2024-06-06 Shachi Deshpande , Charles Marx , Volodymyr Kuleshov

Algorithmic fairness is a new interdisciplinary field of study focused on how to measure whether a process, or algorithm, may unintentionally produce unfair outcomes, as well as whether or how the potential unfairness of such processes can…

Theoretical Economics · Economics 2022-08-18 John W. Patty , Elizabeth Maggie Penn

Probabilistic forecasting in combination with stochastic programming is a key tool for handling the growing uncertainties in future energy systems. Derived from a general stochastic programming formulation for the optimal scheduling and…

Systems and Control · Electrical Eng. & Systems 2022-03-25 Mario Beykirch , Tim Janke , Florian Steinke

Should prediction models always deliver a prediction? In the pursuit of maximum predictive performance, critical considerations of reliability and fairness are often overshadowed, particularly when it comes to the role of uncertainty.…

Machine Learning · Computer Science 2024-10-29 Anna Sokol , Nuno Moniz , Nitesh Chawla

Algorithms with predictions is a recent framework for decision-making under uncertainty that leverages the power of machine-learned predictions without making any assumption about their quality. The goal in this framework is for algorithms…

Machine Learning · Computer Science 2025-01-22 Eric Balkanski , Will Ma , Andreas Maggiori

We provide self-contained proof of a theorem relating probabilistic coherence of forecasts to their non-domination by rival forecasts with respect to any proper scoring rule. The theorem appears to be new but is closely related to results…

Machine Learning · Statistics 2016-11-15 Joel Predd , Robert Seiringer , Elliott H. Lieb , Daniel Osherson , Vincent Poor , Sanjeev Kulkarni

Fairness in predictions is of direct importance in practice due to legal, ethical, and societal reasons. This is often accomplished through counterfactual fairness, which ensures that the prediction for an individual is the same as that in…

Machine Learning · Computer Science 2025-10-03 Yuchen Ma , Valentyn Melnychuk , Dennis Frauen , Stefan Feuerriegel

Machine learning algorithms for prediction are increasingly being used in critical decisions affecting human lives. Various fairness formalizations, with no firm consensus yet, are employed to prevent such algorithms from systematically…

Machine Learning · Computer Science 2018-05-29 Pratik Gajane , Mykola Pechenizkiy

We design online algorithms for the fair allocation of public goods to a set of $N$ agents over a sequence of $T$ rounds and focus on improving their performance using predictions. In the basic model, a public good arrives in each round,…

Computer Science and Game Theory · Computer Science 2022-10-03 Siddhartha Banerjee , Vasilis Gkatzelis , Safwan Hossain , Billy Jin , Evi Micha , Nisarg Shah

Estimating accurate and well-calibrated predictive uncertainty is important for enhancing the reliability of computer vision models, especially in safety-critical applications like traffic scene perception. While ensemble methods are…

Computer Vision and Pattern Recognition · Computer Science 2025-09-08 Svetlana Pavlitska , Beyza Keskin , Alwin Faßbender , Christian Hubschneider , J. Marius Zöllner

People are commonly interested in predicting a statistical property of a random event such as mean and variance. Proper scoring rules assess the quality of predictions and require that the expected score gets uniquely maximized at the…

Machine Learning · Computer Science 2025-06-24 Lingfang Hu , Ian A. Kash

In decision-making methods, it is common to assume that the experts are honest and professional. However, this is not the case when one or more experts in the group decision making framework, such as the group analytic hierarchy process…

Artificial Intelligence · Computer Science 2023-12-08 Konrad Kułakowski , Jacek Szybowski , Jiri Mazurek , Sebastian Ernst

Across machine learning (ML) sub-disciplines, researchers make explicit mathematical assumptions in order to facilitate proof-writing. We note that, specifically in the area of fairness-accuracy trade-off optimization scholarship, similar…

Computers and Society · Computer Science 2021-09-09 A. Feder Cooper , Ellen Abrams

Algorithmic predictions are increasingly informing societal resource allocations by identifying individuals for targeting. Policymakers often build these systems with the assumption that by gathering more observations on individuals, they…

Machine Learning · Computer Science 2025-03-04 Ali Shirali , Ariel Procaccia , Rediet Abebe

We study a problem where a group of agents has to decide how a joint reward should be shared among them. We focus on settings where the share that each agent receives depends on the subjective opinions of its peers concerning that agent's…

Computer Science and Game Theory · Computer Science 2013-05-23 Arthur Carvalho , Kate Larson

Common sense suggests that when individuals explain why they believe something, we can arrive at more accurate conclusions than when they simply state what they believe. Yet, there is no known mechanism that provides incentives to elicit…

Computer Science and Game Theory · Computer Science 2025-02-20 Siddarth Srinivasan , Ezra Karger , Michiel Bakker , Yiling Chen