English
Related papers

Related papers: Achieving Pareto Optimality in Games via Single-bi…

200 papers

We study the combinatorial semi-bandit problem where an agent selects a subset of base arms and receives individual feedback. While this generalizes the classical multi-armed bandit and has broad applicability, its scalability is limited by…

Machine Learning · Statistics 2025-10-27 Jung-hun Kim , Milan Vojnović , Min-hwan Oh

The Colonel Blotto game is a renowned resource allocation problem with a long-standing literature in game theory (almost 100 years). However, its scope of application is still restricted by the lack of studies on the incomplete-information…

Computer Science and Game Theory · Computer Science 2019-09-12 Dong Quan Vu , Patrick Loiseau , Alonso Silva

In this paper, we study last-iterate convergence of learning algorithms in bilinear saddle-point problems, a preferable notion of convergence that captures the day-to-day behavior of learning dynamics. We focus on the challenging setting…

This paper investigates distributed zeroth-order feedback optimization in multi-agent systems with coupled constraints, where each agent operates its local action vector and observes only zeroth-order information to minimize a global cost…

Optimization and Control · Mathematics 2024-10-17 Yingpeng Duan , Yujie Tang

We formulate the novel class of contextual games, a type of repeated games driven by contextual information at each round. By means of kernel-based regularity assumptions, we model the correlation between different contexts and game…

Computer Science and Game Theory · Computer Science 2021-07-15 Pier Giuseppe Sessa , Ilija Bogunovic , Andreas Krause , Maryam Kamgarpour

We introduce one-way games, a framework motivated by applications in large-scale power restoration, humanitarian logistics, and integrated supply-chains. The distinguishable feature of the games is that the payoff of some player is…

Computer Science and Game Theory · Computer Science 2015-07-28 Andres Abeliuk , Gerardo Berbeglia , Pascal Van Hentenryck

Consider a decision-maker that can pick one out of $K$ actions to control an unknown system, for $T$ turns. The actions are interpreted as different configurations or policies. Holding the same action fixed, the system asymptotically…

Machine Learning · Computer Science 2023-02-28 Siddharth Chandak , Ilai Bistritz , Nicholas Bambos

Reinforcement learning (RL) has achieved promising results on most robotic control tasks. Safety of learning-based controllers is an essential notion of ensuring the effectiveness of the controllers. Current methods adopt whole consistency…

Robotics · Computer Science 2023-07-31 Haotian Xu , Shengjie Wang , Zhaolei Wang , Yunzhe Zhang , Qing Zhuo , Yang Gao , Tao Zhang

Safety and performance are often two competing objectives in sequential decision-making problems. Existing performant controllers, such as controllers derived from reinforcement learning algorithms, often fall short of safety guarantees. On…

Systems and Control · Electrical Eng. & Systems 2020-08-03 Parham Gohari , Franck Djeumou , Abraham P. Vinod , Ufuk Topcu

In common-interest stochastic games all players receive an identical payoff. Players participating in such games must learn to coordinate with each other in order to receive the highest-possible value. A number of reinforcement learning…

Artificial Intelligence · Computer Science 2011-06-28 R. I. Brafman , M. Tennenholtz

We study federated contextual linear bandits, where $M$ agents cooperate with each other to solve a global contextual linear bandit problem with the help of a central server. We consider the asynchronous setting, where all agents work…

Machine Learning · Computer Science 2022-07-08 Jiafan He , Tianhao Wang , Yifei Min , Quanquan Gu

We consider the problem where $N$ agents collaboratively interact with an instance of a stochastic $K$ arm bandit problem for $K \gg N$. The agents aim to simultaneously minimize the cumulative regret over all the agents for a total of $T$…

Machine Learning · Computer Science 2021-02-18 Mridul Agarwal , Vaneet Aggarwal , Kamyar Azizzadenesheli

In cooperative bandits, a framework that captures essential features of collective sequential decision making, agents can minimize group regret, and thereby improve performance, by leveraging shared information. However, sharing information…

Machine Learning · Statistics 2021-10-12 Udari Madhushani , Naomi Leonard

In this paper we propose a novel experimental design-based algorithm to minimize regret in online stochastic linear and combinatorial bandits. While existing literature tends to focus on optimism-based algorithms--which have been shown to…

Machine Learning · Computer Science 2021-03-02 Andrew Wagenmaker , Julian Katz-Samuels , Kevin Jamieson

We study online learning in constrained Markov decision processes (CMDPs) in which rewards and constraints may be either stochastic or adversarial. In such settings, Stradi et al.(2024) proposed the first best-of-both-worlds algorithm able…

Machine Learning · Computer Science 2025-02-10 Francesco Emanuele Stradi , Anna Lunghi , Matteo Castiglioni , Alberto Marchesi , Nicola Gatti

Motivated by a plethora of practical examples where bias is induced by automated-decision making algorithms, there has been strong recent interest in the design of fair algorithms. However, there is often a dichotomy between fairness and…

Artificial Intelligence · Computer Science 2023-07-13 April Niu , Agnes Totschnig , Adrian Vetta

The restless bandit problem is one of the most well-studied generalizations of the celebrated stochastic multi-armed bandit problem in decision theory. In its ultimate generality, the restless bandit problem is known to be PSPACE-Hard to…

Data Structures and Algorithms · Computer Science 2009-02-03 Sudipto Guha , Kamesh Munagala , Peng Shi

We examine normal-form games in which players may \emph{pre-commit} to outcome-contingent transfers before choosing their actions. In the one-shot version of this model, Jackson and Wilkie showed that side contracting can backfire: even a…

Computer Science and Game Theory · Computer Science 2025-08-12 Ivan Geffner , Caspar Oesterheld , Vincent Conitzer

Combinatorial bandits with semi-bandit feedback generalize multi-armed bandits, where the agent chooses sets of arms and observes a noisy reward for each arm contained in the chosen set. The action set satisfies a given structure such as…

Machine Learning · Statistics 2021-01-22 Marc Jourdan , Mojmír Mutný , Johannes Kirschner , Andreas Krause

Scalable decentralized optimization in large-scale systems hinges on efficient communication. A common way to reduce communication overhead is to perform multiple local updates between two communication rounds, as in federated learning.…

Optimization and Control · Mathematics 2025-11-10 Jie Liu , Zuang Wang , Yongqiang Wang