English
Related papers

Related papers: Malicious Experts versus the multiplicative weight…

200 papers

We consider the problem of binary prediction with expert advice in settings where experts have agency and seek to maximize their credibility. This paper makes three main contributions. First, it defines a model to reason formally about…

Computer Science and Game Theory · Computer Science 2021-03-16 Tim Roughgarden , Okke Schrijvers

We present a new online learning algorithm for cumulative discounted gain. This learning algorithm does not use exponential weights on the experts. Instead, it uses a weighting scheme that depends on the regret of the master algorithm…

Computer Science and Game Theory · Computer Science 2008-07-01 Yoav Freund , Daniel Hsu

We apply the method of defensive forecasting, based on the use of game-theoretic supermartingales, to prediction with expert advice. In the traditional setting of a countable number of experts and a finite number of outcomes, the Defensive…

Machine Learning · Computer Science 2010-03-12 Alexey Chernov , Yuri Kalnishkan , Fedor Zhdanov , Vladimir Vovk

We study the classical problem of prediction with expert advice in the adversarial setting with a geometric stopping time. In 1965, Cover gave the optimal algorithm for the case of 2 experts. In this paper, we design the optimal algorithm,…

Machine Learning · Computer Science 2016-07-12 Nick Gravin , Yuval Peres , Balasubramanian Sivan

This paper studies theoretically and empirically a method of turning machine-learning algorithms into probabilistic predictors that automatically enjoys a property of validity (perfect calibration) and is computationally efficient. The…

Machine Learning · Computer Science 2015-11-16 Vladimir Vovk , Ivan Petej , Valentina Fedorova

Many practical learning systems aggregate data across many users, while learning theory traditionally considers a single learner who trusts all of their observations. A case in point is the foundational learning problem of prediction with…

Machine Learning · Computer Science 2016-04-11 Paul Christiano

For the prediction with experts' advice setting, we construct forecasting algorithms that suffer loss not much more than any expert in the pool. In contrast to the standard approach, we investigate the case of long-term forecasting of time…

Machine Learning · Computer Science 2019-02-28 Alexander Korotin , Vladimir V'yugin , Evgeny Burnaev

Recent works have shown that agents facing independent instances of a stochastic $K$-armed bandit can collaborate to decrease regret. However, these works assume that each agent always recommends their individual best-arm estimates to other…

Machine Learning · Computer Science 2022-03-02 Daniel Vial , Sanjay Shakkottai , R. Srikant

We investigate online classification with paid stochastic experts. Here, before making their prediction, each expert must be paid. The amount that we pay each expert directly influences the accuracy of their prediction through some unknown…

Machine Learning · Statistics 2023-07-04 Dirk van der Hoeven , Ciara Pike-Burke , Hao Qiu , Nicolo Cesa-Bianchi

We study the interplay between sequential decision making and avoiding discrimination against protected groups, when examples arrive online and do not follow distributional assumptions. We consider the most basic extension of classical…

Machine Learning · Computer Science 2019-04-02 Avrim Blum , Suriya Gunasekar , Thodoris Lykouris , Nathan Srebro

We study the problem of prediction with expert advice when the number of experts in question may be extremely large or even infinite. We devise an algorithm that obtains a tight regret bound of $\widetilde{O}(\epsilon T + N + \sqrt{NT})$,…

Machine Learning · Computer Science 2017-02-28 Alon Cohen , Shie Mannor

The extension of classical online algorithms when provided with predictions is a new and active research area. In this paper, we extend the primal-dual method for online algorithms in order to incorporate predictions that advise the online…

Machine Learning · Computer Science 2020-10-23 Étienne Bamas , Andreas Maggiori , Ola Svensson

The research area of algorithms with predictions has seen recent success showing how to incorporate machine learning into algorithm design to improve performance when the predictions are correct, while retaining worst-case guarantees when…

Machine Learning · Computer Science 2022-12-06 Michael Dinitz , Sungjin Im , Thomas Lavastida , Benjamin Moseley , Sergei Vassilvitskii

Mixture of experts is a prediction aggregation method in machine learning that aggregates the predictions of specialized experts. This method often outperforms Bayesian methods despite the Bayesian having stronger inductive guarantees. We…

Machine Learning · Computer Science 2026-01-26 Bruce Rushing

Accurately predicting the outcome of sporting events has been a goal for many groups who seek to maximize profit. What makes this challenging is that the outcome of an event can be influenced by many factors that dynamically change across…

Applications · Statistics 2017-10-23 Erik J. Schlicht

In this paper, we initiate the study of the weighted paging problem with predictions. This continues the recent line of work in online algorithms with predictions, particularly that of Lykouris and Vassilvitski (ICML 2018) and Rohatgi (SODA…

Data Structures and Algorithms · Computer Science 2020-06-18 Zhihao Jiang , Debmalya Panigrahi , Kevin Sun

We study how we can adapt a predictor to a non-stationary environment with advises from multiple experts. We study the problem under complete feedback when the best expert changes over time from a decision theoretic point of view. Proposed…

Machine Learning · Computer Science 2017-08-08 Vishnu Raj , Sheetal Kalyani

We introduce algorithms for online, full-information prediction that are competitive with contextual tree experts of unknown complexity, in both probabilistic and adversarial settings. We show that by incorporating a probabilistic framework…

Machine Learning · Computer Science 2018-05-23 Vidya Muthukumar , Mitas Ray , Anant Sahai , Peter L. Bartlett

We study online algorithms with predictions using distributional advice, a type of prediction that arises when leveraging expert knowledge or historical data. To demonstrate the usefulness and versatility of this framework, we focus on the…

Data Structures and Algorithms · Computer Science 2025-09-09 Clément L. Canonne , Kenny Chen , Julián Mestre

Bayesian experts who are exposed to different evidence often make contradictory probabilistic forecasts. An aggregator, ignorant of the underlying model, uses this to calculate her own forecast. We use the notions of scoring rules and…

Economics · Quantitative Finance 2018-02-13 Itai Areili , Yakov Babichenko , Rann Smorodinsky