English
Related papers

Related papers: Robust No-Regret Learning in Min-Max Stackelberg G…

200 papers

We study last-iterate convergence properties of algorithms for solving two-player zero-sum games based on Regret Matching$^+$ (RM$^+$). Despite their widespread use for solving real games, virtually nothing is known about their last-iterate…

Computer Science and Game Theory · Computer Science 2025-03-05 Yang Cai , Gabriele Farina , Julien Grand-Clément , Christian Kroer , Chung-Wei Lee , Haipeng Luo , Weiqiang Zheng

In Bayesian single-item auctions, a monotone bidding strategy--one that prescribes a higher bid for a higher value type--can be equivalently represented as a partition of the quantile space into consecutive intervals corresponding to…

Computer Science and Game Theory · Computer Science 2026-02-10 Junyao Zhao

We revisit the problem of online learning with sleeping experts/bandits: in each time step, only a subset of the actions are available for the algorithm to choose from (and learn about). The work of Kleinberg et al. (2010) showed that there…

Machine Learning · Computer Science 2021-04-27 Ehsan Emamjomeh-Zadeh , Chen-Yu Wei , Haipeng Luo , David Kempe

We consider regret minimization in repeated games with non-convex loss functions. Minimizing the standard notion of regret is computationally intractable. Thus, we define a natural notion of regret which permits efficient optimization and…

Machine Learning · Computer Science 2017-11-06 Elad Hazan , Karan Singh , Cyril Zhang

Obtaining no-regret guarantees for reinforcement learning (RL) in the case of problems with continuous state and/or action spaces is still one of the major open challenges in the field. Recently, a variety of solutions have been proposed,…

Machine Learning · Computer Science 2024-02-07 Davide Maran , Alberto Maria Metelli , Matteo Papini , Marcello Restell

We consider the problem of distributed online optimization, with a group of learners connected via a dynamic communication graph. The goal of the learners is to track the global minimizer of a sum of time-varying loss functions in a…

Optimization and Control · Mathematics 2021-12-08 Nima Eshraghi , Ben Liang

On-policy imitation learning algorithms such as DAgger evolve a robot control policy by executing it, measuring performance (loss), obtaining corrective feedback from a supervisor, and generating the next policy. As the loss between…

Robotics · Computer Science 2019-07-10 Jonathan N. Lee , Michael Laskey , Ajay Kumar Tanwani , Anil Aswani , Ken Goldberg

Scale-invariance in games has recently emerged as a widely valued desirable property. Yet, almost all fast convergence guarantees in learning in games require prior knowledge of the utility scale. To address this, we develop learning…

Computer Science and Game Theory · Computer Science 2026-02-13 Taira Tsuchiya , Haipeng Luo , Shinji Ito

We investigate online convex optimization in non-stationary environments and choose the dynamic regret as the performance measure, defined as the difference between cumulative loss incurred by the online algorithm and that of any feasible…

Machine Learning · Computer Science 2020-12-01 Peng Zhao , Yu-Jie Zhang , Lijun Zhang , Zhi-Hua Zhou

Adaptive gradient algorithms such as ADAGRAD and its variants have gained popularity in the training of deep neural networks. While many works as for adaptive methods have focused on the static regret as a performance metric to achieve a…

Machine Learning · Computer Science 2022-09-07 Parvin Nazari , Esmaile Khorram

The long-run behavior of multi-agent learning - and, in particular, no-regret learning - is relatively well-understood in potential games, where players have aligned interests. By contrast, in harmonic games - the strategic counterpart of…

Computer Science and Game Theory · Computer Science 2024-12-31 Davide Legacci , Panayotis Mertikopoulos , Christos H. Papadimitriou , Georgios Piliouras , Bary S. R. Pradelski

The notion of \emph{policy regret} in online learning is a well defined? performance measure for the common scenario of adaptive adversaries, which more traditional quantities such as external regret do not take into account. We revisit the…

Machine Learning · Computer Science 2020-03-24 Raman Arora , Michael Dinitz , Teodor V. Marinov , Mehryar Mohri

In this paper, we consider a distributed learning problem in a subnetwork zero-sum game, where agents are competing in different subnetworks. These agents are connected through time-varying graphs where each agent has its own cost function…

Optimization and Control · Mathematics 2021-08-05 Shijie Huang , Jinlong Lei , Yiguang Hong , Uday V. Shanbhag , Jie Chen

We study online learning problems in which the learner has extra knowledge about the adversary's behaviour, i.e., in game-theoretic settings where opponents typically follow some no-external regret learning algorithms. Under this…

Machine Learning · Computer Science 2023-02-15 Le Cong Dinh , Tri-Dung Nguyen , Alain Zemkoho , Long Tran-Thanh

This paper examines the convergence of no-regret learning in Cournot games with continuous actions. Cournot games are the essential model for many socio-economic systems, where players compete by strategically setting their output quantity.…

Computer Science and Game Theory · Computer Science 2020-02-12 Yuanyuan Shi , Baosen Zhang

The connection between games and no-regret algorithms has been widely studied in the literature. A fundamental result is that when all players play no-regret strategies, this produces a sequence of actions whose time-average is a…

Computer Science and Game Theory · Computer Science 2020-09-15 Zhe Feng , Guru Guruganesh , Christopher Liaw , Aranyak Mehta , Abhishek Sethi

Existing algorithms for online conformal prediction -- guaranteeing marginal coverage in adversarial settings -- are variants of online gradient descent (OGD), but their analyses of worst-case coverage do not follow from the regret…

Machine Learning · Computer Science 2025-02-18 Ramya Ramalingam , Shayan Kiyani , Aaron Roth

Recent literature on online learning has focused on developing adaptive algorithms that take advantage of a regularity of the sequence of observations, yet retain worst-case performance guarantees. A complementary direction is to develop…

Machine Learning · Computer Science 2015-01-27 Ali Jadbabaie , Alexander Rakhlin , Shahin Shahrampour , Karthik Sridharan

Recently, much work has been done on extending the scope of online learning and incremental stochastic optimization algorithms. In this paper we contribute to this effort in two ways: First, based on a new regret decomposition and a…

Machine Learning · Computer Science 2017-09-12 Pooria Joulani , András György , Csaba Szepesvári

Min-max optimization problems (i.e., min-max games) have been attracting a great deal of attention because of their applicability to a wide range of machine learning problems. Although significant progress has been made recently, the…

Computer Science and Game Theory · Computer Science 2023-07-07 Denizalp Goktas , Amy Greenwald