English
Related papers

Related papers: Prediction with Expert Advice under Discounted Los…

200 papers

Learning algorithms are often used in conjunction with expert decision makers in practical scenarios, however this fact is largely ignored when designing these algorithms. In this paper we explore how to learn predictors that can either…

Machine Learning · Computer Science 2021-01-26 Hussein Mozannar , David Sontag

We revisit the fundamental problem of prediction with expert advice, in a setting where the environment is benign and generates losses stochastically, but the feedback observed by the learner is subject to a moderate adversarial corruption.…

Machine Learning · Computer Science 2021-07-05 Idan Amir , Idan Attias , Tomer Koren , Roi Livni , Yishay Mansour

We consider online prediction of a binary sequence with expert advice. For this setting, we devise label-efficient forecasting algorithms, which use a selective sampling scheme that enables collecting much fewer labels than standard…

Machine Learning · Statistics 2023-10-23 Rui M. Castro , Fredrik Hellström , Tim van Erven

We consider a general framework of online learning with expert advice where regret is defined with respect to sequences of experts accepted by a weighted automaton. Our framework covers several problems previously studied, including…

Machine Learning · Computer Science 2017-10-24 Mehryar Mohri , Scott Yang

Prediction with experts' advice is one of the most fundamental problems in online learning and captures many of its technical challenges. A recent line of work has looked at online learning through the lens of differential equations and…

Machine Learning · Computer Science 2022-10-04 Victor Sanches Portella , Christopher Liaw , Nicholas J. A. Harvey

This paper presents a new approach based on optimization model to determine the weights of experts in the multi-attribute group decision. Firstly, by minimizing the sum of differences between individual evaluations and the overall…

Optimization and Control · Mathematics 2023-11-22 Yuetong Liu , Chaolang Hu , Shiquan Zhang , Qixiao Hu

We tackle the problem of online optimization with a general, possibly unbounded, loss function. It is well known that when the loss is bounded, the exponentially weighted aggregation strategy (EWA) leads to a regret in $\sqrt{T}$ after $T$…

Machine Learning · Statistics 2022-01-17 Pierre Alquier

We study a variant of decision-theoretic online learning in which the set of experts that are available to Learner can shrink over time. This is a restricted version of the well-studied sleeping experts problem, itself a generalization of…

Machine Learning · Computer Science 2019-10-31 Hamid Shayestehmanesh , Sajjad Azami , Nishant A. Mehta

We consider on-line density estimation with a parameterized density from the exponential family. The on-line algorithm receives one example at a time and maintains a parameter that is essentially an average of the past examples. After…

Machine Learning · Computer Science 2013-01-30 Katy S. Azoury , Manfred K. Warmuth

We study the problem of online learning with primary and secondary losses. For example, a recruiter making decisions of which job applicants to hire might weigh false positives and false negatives equally (the primary loss) but the…

Machine Learning · Computer Science 2020-10-29 Avrim Blum , Han Shao

The paper deals with on-line regression settings with signals belonging to a Banach lattice. Our algorithms work in a semi-online setting where all the inputs are known in advance and outcomes are unknown and given step by step. We apply…

Machine Learning · Computer Science 2010-02-04 Fedor Zhdanov , Alexey Chernov , Yuri Kalnishkan

A standard introduction to online learning might place Online Gradient Descent at its center and then proceed to develop generalizations and extensions like Online Mirror Descent and second-order methods. Here we explore the alternative…

Machine Learning · Statistics 2021-08-31 Dirk van der Hoeven , Tim van Erven , Wojciech Kotłowski

Prediction with expert advice is a foundational problem in online learning. In instances with $T$ rounds and $n$ experts, the classical Multiplicative Weights Update method suffers at most $\sqrt{(T/2)\ln n}$ regret when $T$ is known…

Machine Learning · Computer Science 2022-03-16 Laura Greenstreet , Nicholas J. A. Harvey , Victor Sanches Portella

In the context of advertising auctions, finding good reserve prices is a notoriously challenging learning problem. This is due to the heterogeneity of ad opportunity types and the non-convexity of the objective function. In this work, we…

Machine Learning · Computer Science 2017-11-07 Andrés Muñoz Medina , Sergei Vassilvitskii

Learning to defer with multiple experts is a framework where the learner can choose to defer the prediction to several experts. While this problem has received significant attention in classification contexts, it presents unique challenges…

Machine Learning · Computer Science 2024-03-29 Anqi Mao , Mehryar Mohri , Yutao Zhong

We present distributed algorithms that can be used by multiple agents to align their estimates with a particular value over a network with time-varying connectivity. Our framework is general in that this value can represent a consensus…

Optimization and Control · Mathematics 2010-04-20 Angelia Nedić , Asuman Ozdaglar , Pablo A. Parrilo

Consider a sequence of bits where we are trying to predict the next bit from the previous bits. Assume we are allowed to say 'predict 0' or 'predict 1', and our payoff is +1 if the prediction is correct and -1 otherwise. We will say that at…

Data Structures and Algorithms · Computer Science 2012-10-11 Michael Kapralov , Rina Panigrahy

We study a variant of prediction with expert advice where the learner's action at round $t$ is only allowed to depend on losses on a specific subset of the rounds (where the structure of which rounds' losses are visible at time $t$ is…

Machine Learning · Computer Science 2024-07-02 Khashayar Gatmiry , Jon Schneider

Accurate prediction over long time horizons is crucial for modeling complex physical processes such as wave propagation. Although deep neural networks show promise for real-time forecasting, they often struggle with accumulating phase and…

Machine Learning · Computer Science 2024-12-05 Indu Kant Deo , Rajeev Jaiman

Training machine learning interatomic potentials often requires optimizing a loss function composed of three variables: potential energies, forces, and stress. The contribution of each variable to the total loss is typically weighted using…

Computational Physics · Physics 2024-03-29 Daniel Ocampo , Daniela Posso , Reza Namakian , Wei Gao