English
Related papers

Related papers: Consensus Multiplicative Weights Update: Learning …

200 papers

The convergence of online learning algorithms in games under self-play is a fundamental question in game theory and machine learning. Among various notions of convergence, last-iterate convergence is particularly desirable, as it reflects…

Computer Science and Game Theory · Computer Science 2025-11-11 Yang Cai , Haipeng Luo , Chen-Yu Wei , Weiqiang Zheng

Multi-Agent Reinforcement Learning (MARL) -- where multiple agents learn to interact in a shared dynamic environment -- permeates across a wide range of critical applications. While there has been substantial progress on understanding the…

Computer Science and Game Theory · Computer Science 2022-10-05 Shicong Cen , Yuejie Chi , Simon S. Du , Lin Xiao

We study online convex optimization where the possible actions are trace-one elements in a symmetric cone, generalizing the extensively-studied experts setup and its quantum counterpart. Symmetric cones provide a unifying framework for some…

Optimization and Control · Mathematics 2023-07-07 Ilayda Canyakmaz , Wayne Lin , Georgios Piliouras , Antonios Varvitsiotis

This paper studies policy optimization algorithms for multi-agent reinforcement learning. We begin by proposing an algorithm framework for two-player zero-sum Markov Games in the full-information setting, where each iteration consists of a…

Machine Learning · Computer Science 2022-07-26 Runyu Zhang , Qinghua Liu , Huan Wang , Caiming Xiong , Na Li , Yu Bai

In this paper, we study the problem of learning in quantum games - and other classes of semidefinite games - with scalar, payoff-based feedback. For concreteness, we focus on the widely used matrix multiplicative weights (MMW) algorithm…

Computer Science and Game Theory · Computer Science 2023-11-07 Kyriakos Lotidis , Panayotis Mertikopoulos , Nicholas Bambos , Jose Blanchet

Non-concave maximization has been the subject of much recent study in the optimization and machine learning communities, specifically in deep learning. Recent papers Ge et al, Lee et al (and references therein) indicate that first order…

Optimization and Control · Mathematics 2020-01-14 Ioannis Panageas , Georgios Piliouras , Xiao Wang

Recently, Daskalakis, Fishelson, and Golowich (DFG) (NeurIPS`21) showed that if all agents in a multi-player general-sum normal-form game employ Optimistic Multiplicative Weights Update (OMWU), the external regret of every player is…

We develop provably efficient reinforcement learning algorithms for two-player zero-sum finite-horizon Markov games with simultaneous moves. To incorporate function approximation, we consider a family of Markov games where the reward…

Machine Learning · Computer Science 2020-06-25 Qiaomin Xie , Yudong Chen , Zhaoran Wang , Zhuoran Yang

The Matrix Multiplicative Weight Update (MMWU) is a seminal online learning algorithm with numerous applications. Applied to the matrix version of the Learning from Expert Advice (LEA) problem on the $d$-dimensional spectraplex, it is well…

Machine Learning · Computer Science 2025-09-12 Weiyuan Gong , Tongyang Li , Xinzhao Wang , Zhiyu Zhang

We study online learning problems in which the learner has extra knowledge about the adversary's behaviour, i.e., in game-theoretic settings where opponents typically follow some no-external regret learning algorithms. Under this…

Machine Learning · Computer Science 2023-02-15 Le Cong Dinh , Tri-Dung Nguyen , Alain Zemkoho , Long Tran-Thanh

Learning and equilibrium computation in games are fundamental problems across computer science and economics, with applications ranging from politics to machine learning. Much of the work in this area revolves around a simple algorithm…

Computer Science and Game Theory · Computer Science 2022-07-19 Daniel Beaglehole , Max Hopkins , Daniel Kane , Sihan Liu , Shachar Lovett

We consider nonconvex optimization problem over simplex, and more generally, a product of simplices. We provide an algorithm, Langevin Multiplicative Weights Update (LMWU) for solving global optimization problems by adding a noise scaling…

Optimization and Control · Mathematics 2025-03-04 Yi Feng , Xiao Wang , Tian Xie

In this work, we introduce the concept of non-negative weighted regret, an extension of non-negative regret \cite{anagnostides2022last} in games. Investigating games with non-negative weighted regret helps us to understand games with…

Computer Science and Game Theory · Computer Science 2025-05-22 Nanxiang Zhou , Jing Dong , Baoxiang Wang

Neural networks are widespread due to their powerful performance. Yet, they degrade in the presence of noisy labels at training time. Inspired by the setting of learning with expert advice, where multiplicative weights (MW) updates were…

Machine Learning · Computer Science 2025-11-12 Noga Bar , Tomer Koren , Raja Giryes

The framework of uncoupled online learning in multiplayer games has made significant progress in recent years. In particular, the development of time-varying games has considerably expanded its modeling capabilities. However, current regret…

Computer Science and Game Theory · Computer Science 2025-08-18 Aymeric Capitaine , Etienne Boursier , Eric Moulines , Michael I. Jordan , Alain Durmus

We study reinforcement learning for two-player zero-sum Markov games with simultaneous moves in the finite-horizon setting, where the transition kernel of the underlying Markov games can be parameterized by a linear function over the…

Machine Learning · Computer Science 2022-04-21 Zixiang Chen , Dongruo Zhou , Quanquan Gu

Reinforcement learning from self-play has recently reported many successes. Self-play, where the agents compete with themselves, is often used to generate training data for iterative policy improvement. In previous work, heuristic rules are…

Machine Learning · Computer Science 2020-09-15 Yuanyi Zhong , Yuan Zhou , Jian Peng

Most existing results about \emph{last-iterate convergence} of learning dynamics are limited to two-player zero-sum games, and only apply under rigid assumptions about what dynamics the players follow. In this paper we provide new results…

Computer Science and Game Theory · Computer Science 2022-03-24 Ioannis Anagnostides , Ioannis Panageas , Gabriele Farina , Tuomas Sandholm

In this paper, we present a novel consensus-based zeroth-order algorithm tailored for non-convex multiplayer games. The proposed method leverages a metaheuristic approach using concepts from swarm intelligence to reliably identify global…

Dynamical Systems · Mathematics 2024-07-30 Enis Chenchene , Hui Huang , Jinniao Qiu

Several multiagent reinforcement learning (MARL) algorithms have been proposed to optimize agents decisions. Due to the complexity of the problem, the majority of the previously developed MARL algorithms assumed agents either had some…

Machine Learning · Computer Science 2014-01-16 Sherief Abdallah , Victor Lesser