English
Related papers

Related papers: Path Planning Problems with Side Observations-When…

200 papers

Colonel Blotto games with discrete strategy spaces effectively illustrate the intricate nature of multidimensional strategic reasoning. This paper studies the equilibrium set of such games where, in line with prior experimental work, the…

Computer Science and Game Theory · Computer Science 2024-03-28 Christian Ewerhart , Stanisław Kaźmierowski

We study an online decision making problem where on each round a learner chooses a list of items based on some side information, receives a scalar feedback value for each individual item, and a reward that is linearly related to this…

Machine Learning · Computer Science 2016-11-07 Akshay Krishnamurthy , Alekh Agarwal , Miroslav Dudik

This paper explores the application of bandit algorithms in both stochastic and adversarial settings, with a focus on theoretical analysis and practical applications. The study begins by introducing bandit problems, distinguishing between…

Machine Learning · Computer Science 2025-03-14 Samih Karroum , Saad Mazhar

People routinely infer the goals of others by observing their actions over time. Remarkably, we can do so even when those actions lead to failure, enabling us to assist others when we detect that they might not achieve their goals. How…

Artificial Intelligence · Computer Science 2020-10-27 Tan Zhi-Xuan , Jordyn L. Mann , Tom Silver , Joshua B. Tenenbaum , Vikash K. Mansinghka

We consider a collaborative online learning paradigm, wherein a group of agents connected through a social network are engaged in playing a stochastic multi-armed bandit game. Each time an agent takes an action, the corresponding reward is…

Machine Learning · Computer Science 2016-07-12 Ravi Kumar Kolla , Krishna Jagannathan , Aditya Gopalan

Self-play, where the algorithm learns by playing against itself without requiring any direct supervision, has become the new weapon in modern Reinforcement Learning (RL) for achieving superhuman performance in practice. However, the…

Machine Learning · Computer Science 2020-07-10 Yu Bai , Chi Jin

We consider the problem of routing for logistics purposes, in a contested environment where an adversary attempts to disrupt the vehicle along the chosen route. We construct a game-theoretic model that captures the problem of optimal…

Computer Science and Game Theory · Computer Science 2025-08-15 Jakub Černý , Garud Iyengar , Christian Kroer

We study online learning in unknown Markov games, a problem that arises in episodic multi-agent reinforcement learning where the actions of the opponents are unobservable. We show that in this challenging setting, achieving sublinear regret…

Machine Learning · Computer Science 2021-02-09 Yi Tian , Yuanhao Wang , Tiancheng Yu , Suvrit Sra

We study the problem of linear contextual bandits with paid observations, where at each round the learner selects an action in order to minimize its loss in a given context, and can then decide to pay a fixed cost to observe the loss of any…

Machine Learning · Computer Science 2025-10-17 Nathan Boyer , Dorian Baudry , Patrick Rebeschini

This paper introduces an extension to the Orienteering Problem (OP), called Clustered Orienteering Problem with Subgroups (COPS). In this variant, nodes are arranged into subgroups, and the subgroups are organized into clusters. A reward is…

Artificial Intelligence · Computer Science 2023-12-29 Luciano E. Almeida , Douglas G. Macharet

Smart cities must integrate a number of interdependent cyber-physical systems that operate in a coordinated manner to improve the well-being of the city's residents. A cyber-physical system (CPS) is a system of computational elements…

Computer Science and Game Theory · Computer Science 2017-07-18 Aidin Ferdowsi , Walid Saad , Behrouz Maham , Narayan B. Mandayam

We study a variant of the bandit problem where side information in the form of bounds on the mean of each arm is provided. We prove that these translate to tighter estimates of subgaussian factors and develop novel algorithms that exploit…

Machine Learning · Computer Science 2024-10-29 Nihal Sharma , Soumya Basu , Karthikeyan Shanmugam , Sanjay Shakkottai

We study a new stochastic multi-player multi-armed bandits (MP-MAB) problem, where the reward distribution changes if a collision occurs on the arm. Existing literature always assumes a zero reward for involved players if collision happens,…

Information Theory · Computer Science 2021-09-01 Chengshuai Shi , Cong Shen

We study an online stochastic matching problem in which an algorithm sequentially matches $U$ users to $K$ arms, aiming to maximize cumulative reward over $T$ rounds under budget constraints. Without structural assumptions, computing the…

Machine Learning · Computer Science 2026-02-11 Omer Ben-Porat , Gur Keinan , Rotem Torkan

In a competitive game scenario, a set of agents have to learn decisions that maximize their goals and minimize their adversaries' goals at the same time. Besides dealing with the increased dynamics of the scenarios due to the opponents'…

Artificial Intelligence · Computer Science 2023-10-03 Pablo Barros , Alessandra Sciutti

We consider surveillance-evasion differential games, where a pursuer must try to constantly maintain visibility of a moving evader. The pursuer loses as soon as the evader becomes occluded. Optimal controls for game can be formulated as a…

Artificial Intelligence · Computer Science 2022-03-29 Louis Ly , Yen-Hsi Richard Tsai

We study the multi-player stochastic multiarmed bandit (MAB) problem in an abruptly changing environment. We consider a collision model in which a player receives reward at an arm if it is the only player to select the arm. We design two…

Machine Learning · Statistics 2018-12-14 Lai Wei , Vaibhav Srivastava

Bandit-style algorithms have been studied extensively in stochastic and adversarial settings. Such algorithms have been shown to be useful in multiplayer settings, e.g. to solve the wireless network selection problem, which can be…

Networking and Internet Architecture · Computer Science 2019-04-30 Shunhao Oh , Anuja Meetoo Appavoo , Seth Gilbert

We study the problem of online learning in a two-player decentralized cooperative Stackelberg game. In each round, the leader first takes an action, followed by the follower who takes their action after observing the leader's move. The goal…

Machine Learning · Computer Science 2023-04-13 Geng Zhao , Banghua Zhu , Jiantao Jiao , Michael I. Jordan

We study small-loss bounds for adversarial multi-armed bandits with graph feedback, that is, adaptive regret bounds that depend on the loss of the best arm or related quantities, instead of the total number of rounds. We derive the first…

Machine Learning · Computer Science 2020-06-24 Chung-Wei Lee , Haipeng Luo , Mengxiao Zhang