English
Related papers

Related papers: Prediction with Expert Advice under Discounted Los…

200 papers

We introduce a Loss Discounting Framework for model and forecast combination which generalises and combines Bayesian model synthesis and generalized Bayes methodologies. We use a loss function to score the performance of different models…

Methodology · Statistics 2024-03-29 Dawid Bernaciak , Jim E. Griffin

In the framework of prediction with expert advice, we consider a recently introduced kind of regret bounds: the bounds that depend on the effective instead of nominal number of experts. In contrast to the Normal- Hedge bound, which mainly…

Machine Learning · Computer Science 2014-08-12 Alexey Chernov , Vladimir Vovk

Advice-efficient prediction with expert advice (in analogy to label-efficient prediction) is a variant of prediction with expert advice game, where on each round of the game we are allowed to ask for advice of a limited number $M$ out of…

Machine Learning · Computer Science 2013-04-15 Yevgeny Seldin , Peter Bartlett , Koby Crammer

The article is devoted to investigating the application of aggregating algorithms to the problem of the long-term forecasting. We examine the classic aggregating algorithms based on the exponential reweighing. For the general Vovk's…

Machine Learning · Computer Science 2019-02-27 Alexander Korotin , Vladimir V'yugin , Evgeny Burnaev

Online learning with expert advice is a fundamental problem of sequential prediction. In this problem, the algorithm has access to a set of $n$ "experts" who make predictions on each day. The goal on each day is to process these…

Data Structures and Algorithms · Computer Science 2022-04-22 Vaidehi Srinivas , David P. Woodruff , Ziyu Xu , Samson Zhou

We study online algorithms with predictions using distributional advice, a type of prediction that arises when leveraging expert knowledge or historical data. To demonstrate the usefulness and versatility of this framework, we focus on the…

Data Structures and Algorithms · Computer Science 2025-09-09 Clément L. Canonne , Kenny Chen , Julián Mestre

This paper shows how universal learning can be achieved with expert advice. To this aim, we specify an experts algorithm with the following characteristics: (a) it uses only feedback from the actions actually chosen (bandit setup), (b) it…

Machine Learning · Computer Science 2007-05-23 Jan Poland , Marcus Hutter

Forecasts support decision making in a variety of applications. Statistical models can produce accurate forecasts given abundant training data, but when data is sparse, rapidly changing, or unavailable, statistical models may not be able to…

Applications · Statistics 2020-05-19 Thomas McAndrew , Nutcha Wattanachit , G. Casey Gibson , Nicholas G. Reich

We study the problem of prediction with expert advice when the number of experts in question may be extremely large or even infinite. We devise an algorithm that obtains a tight regret bound of $\widetilde{O}(\epsilon T + N + \sqrt{NT})$,…

Machine Learning · Computer Science 2017-02-28 Alon Cohen , Shie Mannor

In this paper the sequential prediction problem with expert advice is considered for the case where losses of experts suffered at each step cannot be bounded in advance. We present some modification of Kalai and Vempala algorithm of…

Machine Learning · Computer Science 2010-08-26 Vladimir V. V'yugin

We consider adaptive decision-making problems where an agent optimizes a cumulative performance objective by repeatedly choosing among a finite set of options. Compared to the classical prediction-with-expert-advice set-up, we consider…

Machine Learning · Computer Science 2023-04-10 Michael Muehlebach

The games of prediction with expert advice are considered in this paper. We present some modification of Kalai and Vempala algorithm of following the perturbed leader for the case of unrestrictedly large one-step gains. We show that in…

Machine Learning · Computer Science 2008-06-30 Vladimir V. V'yugin

We study the classic problem of prediction with expert advice under bandit feedback. Our model assumes that one action, corresponding to the learner's abstention from play, has no reward or loss on every trial. We propose the CBA algorithm,…

Machine Learning · Computer Science 2024-11-13 Stephen Pasteris , Alberto Rumi , Maximilian Thiessen , Shota Saito , Atsushi Miyauchi , Fabio Vitale , Mark Herbster

In the framework of prediction with expert advice, we consider a recently introduced kind of regret bounds: the bounds that depend on the effective instead of nominal number of experts. In contrast to the NormalHedge bound, which mainly…

Machine Learning · Computer Science 2015-03-17 Alexey Chernov , Vladimir Vovk

This paper considers the task of learning how to make a prognosis of a patient based on his/her micro-array expression levels. The method is an application of the aggregation method as recently proposed in the literature on theoretical…

Methodology · Statistics 2020-02-21 Kristiaan Pelckmans , Liu Yang

We consider the problem of imitation learning from a finite set of expert trajectories, without access to reinforcement signals. The classical approach of extracting the expert's reward function via inverse reinforcement learning, followed…

Machine Learning · Computer Science 2019-06-10 Ruohan Wang , Carlo Ciliberto , Pierluigi Amadori , Yiannis Demiris

The note presents a modified proof of a loss bound for the exponentially weighted average forecaster with time-varying potential. The regret term of the algorithm is upper-bounded by sqrt{n ln(N)} (uniformly in n), where N is the number of…

Machine Learning · Computer Science 2010-11-29 Alexey Chernov

We specify an experts algorithm with the following characteristics: (a) it uses only feedback from the actions actually chosen (bandit setup), (b) it can be applied with countably infinite expert classes, and (c) it copes with losses that…

Machine Learning · Computer Science 2007-05-23 Jan Poland , Marcus Hutter

Supervised learning has gone beyond the expected risk minimization framework. Central to most of these developments is the introduction of more general aggregation functions for losses incurred by the learner. In this paper, we turn towards…

Machine Learning · Computer Science 2024-06-05 Armando J. Cabrera Pacheco , Rabanus Derr , Robert C. Williamson

This paper investigates how to incorporate expert observations (without explicit information on expert actions) into a deep reinforcement learning setting to improve sample efficiency. First, we formulate an augmented policy loss combining…

Machine Learning · Computer Science 2025-02-28 Erhan Can Ozcan , Vittorio Giammarino , James Queeney , Ioannis Ch. Paschalidis