English
Related papers

Related papers: Strategic Behavior and No-Regret Learning in Queue…

200 papers

We use ideas from distributed computing to study dynamic environments in which computational nodes, or decision makers, follow adaptive heuristics (Hart 2005), i.e., simple and unsophisticated rules of behavior, e.g., repeatedly "best…

Distributed, Parallel, and Cluster Computing · Computer Science 2010-10-13 Aaron D. Jaggard , Michael Schapira , Rebecca N. Wright

We consider the classical multi-armed bandit problem, but with strategic arms. In this context, each arm is characterized by a bounded support reward distribution and strategically aims to maximize its own utility by potentially retaining a…

Machine Learning · Computer Science 2025-01-28 Ahmed Ben Yahmed , Clément Calauzènes , Vianney Perchet

In this work, we study model-based reinforcement learning (RL) in unknown stabilizable linear dynamical systems. When learning a dynamical system, one needs to stabilize the unknown dynamics in order to avoid system blow-ups. We propose an…

Machine Learning · Computer Science 2022-06-06 Sahin Lale , Kamyar Azizzadenesheli , Babak Hassibi , Anima Anandkumar

We consider stability and network capacity in discrete time queueing systems. Relationships between four common notions of stability are described. Specifically, we consider rate stability, mean rate stability, steady state stability, and…

Networking and Internet Architecture · Computer Science 2010-03-18 Michael J. Neely

We consider the restless multi-armed bandit (RMAB) problem with unknown dynamics in which a player chooses M out of N arms to play at each time. The reward state of each arm transits according to an unknown Markovian rule when it is played…

Optimization and Control · Mathematics 2011-12-30 Haoyang Liu , Keqin Liu , Qing Zhao

The stochastic multi-armed bandit setting has been recently studied in the non-stationary regime, where the mean payoff of each action is a non-decreasing function of the number of rounds passed since it was last played. This model captures…

Machine Learning · Computer Science 2022-10-13 Orestis Papadigenopoulos , Constantine Caramanis , Sanjay Shakkottai

Mechanism design for fully strategic agents commonly assumes broadcast nature of communication between agents of the system. Moreover, for mechanism design, the stability of Nash equilibrium (NE) is demonstrated by showing convergence of…

Computer Science and Game Theory · Computer Science 2017-04-05 Abhinav Sinha , Achilleas Anastasopoulos

We consider the problem of simultaneous learning in stochastic games with many players in the finite-horizon setting. While the typical target solution for a stochastic game is a Nash equilibrium, this is intractable with many players. We…

Computer Science and Game Theory · Computer Science 2022-10-27 William Brown

We study the multi-player stochastic multiarmed bandit (MAB) problem in an abruptly changing environment. We consider a collision model in which a player receives reward at an arm if it is the only player to select the arm. We design two…

Machine Learning · Statistics 2018-12-14 Lai Wei , Vaibhav Srivastava

How should a player who repeatedly plays a game against a no-regret learner strategize to maximize his utility? We study this question and show that under some mild assumptions, the player can always guarantee himself a utility of at least…

Computer Science and Game Theory · Computer Science 2025-11-12 Yuan Deng , Jon Schneider , Balusubramanian Sivan

We initiate the study of game dynamics in the population protocol model: $n$ agents each maintain a current local strategy and interact in pairs uniformly at random. Upon each interaction, the agents play a two-person game and receive a…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-05-21 Dan Alistarh , Krishnendu Chatterjee , Mehrdad Karrabi , John Lazarsfeld

Learning in games has been widely used to solve many cooperative multi-agent problems such as coverage control, consensus, self-reconfiguration or vehicle-target assignment. One standard approach in this domain is to formulate the problem…

Systems and Control · Electrical Eng. & Systems 2022-09-07 Abbasali Koochakzadeh , Yasin Yazıcıoğlu

We investigate a multi-agent decision-making problem where a large population of agents is responsible for carrying out a set of assigned tasks. The amount of jobs in each task varies over time governed by a dynamical system model. Each…

Systems and Control · Electrical Eng. & Systems 2023-09-19 Shinkyu Park , Julian Barreiro-Gomez

Making an informed decision -- for example, when choosing a career or housing -- requires knowledge about the available options. Such knowledge is generally acquired through costly trial and error, but this learning process can be disrupted…

Machine Learning · Computer Science 2022-04-15 Sarah H. Cen , Devavrat Shah

We study population dynamics under which each revising agent tests each strategy k times, with each trial being against a newly drawn opponent, and chooses the strategy whose mean payoff was highest. When k = 1, defection is globally stable…

Theoretical Economics · Economics 2021-01-05 Srinivas Arigapudi , Yuval Heller , Igal Milchtaich

Learning in zero-sum games studies a situation where multiple agents competitively learn their strategy. In such multi-agent learning, we often see that the strategies cycle around their optimum, i.e., Nash equilibrium. When a game…

Computer Science and Game Theory · Computer Science 2025-03-06 Yuma Fujimoto , Kaito Ariu , Kenshi Abe

When users can benefit from certain predictive outcomes, they may be prone to act to achieve those outcome, e.g., by strategically modifying their features. The goal in strategic classification is therefore to train predictive models that…

Machine Learning · Computer Science 2023-06-12 Guy Horowitz , Nir Rosenfeld

Learning algorithm design for state-based games is investigated. A heuristic uncoupled learning algorithm, which is a two memory better reply with inertia dynamics, is proposed. Under certain reasonable conditions it is proved that for any…

Optimization and Control · Mathematics 2018-09-18 Changxi Li , Yu Xing , Fenghua He , Daizhan Cheng

We consider a discrete-time system comprising a first-come-first-served queue, a non-preemptive server, and a stationary non-work-conserving scheduler. New tasks enter the queue according to a Bernoulli process with a pre-specified arrival…

Applications · Statistics 2020-08-05 Michael Lin , Nuno C. Martins , Richard J. La

A major limitation of existing routing algorithms for multi-agent systems is that they are designed without considering the potential presence of adversarial agents in the decision-making loop, which could lead to severe performance…

Multiagent Systems · Computer Science 2025-12-23 Roee M. Francos , Daniel Garces , Orhan Eren Akgün , Stephanie Gil