English
Related papers

Related papers: Online Learning in Case of Unbounded Losses Using …

200 papers

We consider distributed online learning protocols that control the exchange of information between local learners in a round-based learning scenario. The learning performance of such a protocol is intuitively optimal if approximately the…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-12-02 Michael Kamp , Mario Boley , Michael Mock , Daniel Keren , Assaf Schuster , Izchak Sharfman

We investigate the problem of online learning, which has gained significant attention in recent years due to its applicability in a wide range of fields from machine learning to game theory. Specifically, we study the online optimization of…

Machine Learning · Computer Science 2021-09-29 Kaan Gokcesu , Hakan Gokcesu

Evolutions of the trading landscape lead to the capability to exchange the same financial instrument on different venues. Because of liquidity issues, the trading firms split large orders across several trading destinations to optimize…

Trading and Market Microstructure · Quantitative Finance 2010-07-28 Sophie Laruelle , Charles-Albert Lehalle , Gilles Pagès

In the online (time-series) search problem, a player is presented with a sequence of prices which are revealed in an online manner. In the standard definition of the problem, for each revealed price, the player must decide irrevocably…

Data Structures and Algorithms · Computer Science 2021-12-06 Spyros Angelopoulos , Shahin Kamali , Dehou Zhang

This paper proposes to leverage the emerging~learning techniques and devise a multi-agent online source {seeking} algorithm under unknown environment. Of particular significance in our problem setups are: i) the underlying environment is…

Systems and Control · Electrical Eng. & Systems 2023-05-02 Bin Du , Kun Qian , Christian Claudel , Dengfeng Sun

We consider online learning problems in the realizable setting, where there is a zero-loss solution, and propose new Differentially Private (DP) algorithms that obtain near-optimal regret bounds. For the problem of online prediction from…

Machine Learning · Computer Science 2023-03-01 Hilal Asi , Vitaly Feldman , Tomer Koren , Kunal Talwar

In continual learning, knowledge must be preserved and re-used between tasks, maintaining good transfer to future tasks and minimizing forgetting of previously learned ones. While several practical algorithms have been devised for this…

Machine Learning · Computer Science 2025-08-19 Lior Friedman , Ron Meir

Consider a sequence of bits where we are trying to predict the next bit from the previous bits. Assume we are allowed to say 'predict 0' or 'predict 1', and our payoff is +1 if the prediction is correct and -1 otherwise. We will say that at…

Data Structures and Algorithms · Computer Science 2012-10-11 Michael Kapralov , Rina Panigrahy

The problem of continuous machine learning is studied. Within the framework of the game-theoretic approach, when for calculating the next forecast, no assumptions about the stochastic nature of the source that generates the data flow are…

Machine Learning · Computer Science 2023-10-31 Vladimir V'yugin , Vladimir Trunov

Loss of trainability refers to a phenomenon in continual learning where parameter updates no longer make progress on the optimization objective, so accuracy stalls or degrades as the learning problem changes over time. In this paper, we…

Machine Learning · Computer Science 2025-12-11 Gunbir Singh Baveja , Alex Lewandowski , Mark Schmidt

We study the sequential general online regression, known also as the sequential probability assignments, under logarithmic loss when compared against a broad class of experts. We focus on obtaining tight, often matching, lower and upper…

Machine Learning · Computer Science 2023-02-02 Changlong Wu , Mohsen Heidari , Ananth Grama , Wojciech Szpankowski

Partially observable stochastic games provide a rich mathematical paradigm for modeling multi-agent dynamic decision making under uncertainty and partial information. However, they generally do not admit closed-form solutions and are…

Optimization and Control · Mathematics 2020-04-15 Yanling Chang , Chelsea C. White

This paper studies the performative prediction problem which optimizes a stochastic loss function with data distribution that depends on the decision variable. We consider a setting where the agent(s) provides samples adapted to the…

Optimization and Control · Mathematics 2021-10-05 Qiang Li , Hoi-To Wai

In this paper, we consider the problem of predicting unknown targets from data. We propose Online Residual Learning (ORL), a method that combines online adaptation with offline-trained predictions. At a lower level, we employ multiple…

Systems and Control · Electrical Eng. & Systems 2024-09-10 Anastasios Vlachos , Anastasios Tsiamis , Aren Karapetyan , Efe C. Balta , John Lygeros

In this article, we provide a flexible framework for optimal trading in an asset listed on different venues. We take into account the dependencies between the imbalance and spread of the venues, and allow for partial execution of limit…

Trading and Market Microstructure · Quantitative Finance 2020-08-19 Bastien Baldacci , Iuliia Manziuk

This work studies the parameter identification problem of a generalized non-cooperative game, where each player's cost function is influenced by an observable signal and some unknown parameters. We consider the scenario where equilibrium of…

Computer Science and Game Theory · Computer Science 2023-10-17 Jianguo Chen , Jinlong Lei , Hongsheng Qi , Yiguang Hong

Machine learning pipelines often rely on optimization procedures to make discrete decisions (e.g., sorting, picking closest neighbors, or shortest paths). Although these discrete decisions are easily computed, they break the…

Machine Learning · Computer Science 2020-06-11 Quentin Berthet , Mathieu Blondel , Olivier Teboul , Marco Cuturi , Jean-Philippe Vert , Francis Bach

We study the problem of expert advice under partial bandit feedback setting and create a sequential minimax optimal algorithm. Our algorithm works with a more general partial monitoring setting, where, in contrast to the classical bandit…

Machine Learning · Computer Science 2022-04-15 Kaan Gokcesu , Hakan Gokcesu

We investigate the problem of online learning, which has gained significant attention in recent years due to its applicability in a wide range of fields from machine learning to game theory. Specifically, we study the online optimization of…

Machine Learning · Computer Science 2021-08-17 Kaan Gokcesu , Hakan Gokcesu

Most learning algorithms with formal regret guarantees assume that all mistakes are recoverable and essentially rely on trying all possible behaviors. This approach is problematic when some mistakes are "catastrophic", i.e., irreparable. We…

Machine Learning · Computer Science 2025-08-07 Benjamin Plaut , Hanlin Zhu , Stuart Russell