English
Related papers

Related papers: Path Planning Problems with Side Observations-When…

200 papers

Humans learn to play video games significantly faster than the state-of-the-art reinforcement learning (RL) algorithms. People seem to build simple models that are easy to learn to support planning and strategic exploration. Inspired by…

Artificial Intelligence · Computer Science 2018-11-27 Ramtin Keramati , Jay Whang , Patrick Cho , Emma Brunskill

In many areas of medicine, security, and life sciences, we want to allocate limited resources to different sources in order to detect extreme values. In this paper, we study an efficient way to allocate these resources sequentially under…

Machine Learning · Statistics 2026-04-28 Alexandra Carpentier , Michal Valko

We study online learning in Bayesian Stackelberg games, where a leader repeatedly interacts with a follower whose unknown private type is independently drawn at each round from an unknown probability distribution. The goal is to design…

Computer Science and Game Theory · Computer Science 2026-02-03 Matteo Bollini , Francesco Bacchiocchi , Samuel Coutts , Matteo Castiglioni , Alberto Marchesi

We study the problem of minimizing swap regret in structured normal-form games. Players have a very large (potentially infinite) number of pure actions, but each action has an embedding into $d$-dimensional space and payoffs are given by…

Machine Learning · Computer Science 2025-02-14 Maxwell Fishelson , Robert Kleinberg , Princewill Okoroafor , Renato Paes Leme , Jon Schneider , Yifeng Teng

Learning and equilibrium computation in games are fundamental problems across computer science and economics, with applications ranging from politics to machine learning. Much of the work in this area revolves around a simple algorithm…

Computer Science and Game Theory · Computer Science 2022-07-19 Daniel Beaglehole , Max Hopkins , Daniel Kane , Sihan Liu , Shachar Lovett

The multiple-path orienteering problem asks for paths for a team of robots that maximize the total reward collected while satisfying budget constraints on the path length. This problem models many multi-robot routing tasks such as exploring…

Robotics · Computer Science 2021-12-02 Guangyao Shi , Lifeng Zhou , Pratap Tokekar

This work addresses competitive resource allocation in a sequential setting, where two players allocate resources across objects or locations of shared interest. Departing from the simultaneous Colonel Blotto game, our framework introduces…

Computer Science and Game Theory · Computer Science 2025-04-24 Omkar Thakoor , Rajgopal Kannan , Victor Prasanna

We consider an adversarial online learning setting where a decision maker can choose an action in every stage of the game. In addition to observing the reward of the chosen action, the decision maker gets side observations on the reward he…

Machine Learning · Computer Science 2011-10-26 Shie Mannor , Ohad Shamir

This paper studies multi-stage systems with end-to-end bandit feedback. In such systems, each job needs to go through multiple stages, each managed by a different agent, before generating an outcome. Each agent can only control its own…

Machine Learning · Computer Science 2024-08-20 I-Hong Hou

We consider an online version of a longest path problem in an undirected and planar graph that is motivated by a location and routing problem occurring in the board game "Turn & Taxis". Path extensions have to be selected based on only…

Optimization and Control · Mathematics 2023-05-23 Konstantin Kraus , Kathrin Klamroth , Michael Stiglmayr

Adversarial environments require agents to navigate a key strategic trade-off: acquiring information enhances situational awareness, but may simultaneously expose them to threats. To investigate this tension, we formulate a…

Artificial Intelligence · Computer Science 2025-10-10 Valerio La Gatta , Dolev Mutzari , Sarit Kraus , VS Subrahmanian

Algorithm selection is typically based on models of algorithm performance, learned during a separate offline training sequence, which can be prohibitively expensive. In recent work, we adopted an online approach, in which a performance…

Artificial Intelligence · Computer Science 2013-01-31 Matteo Gagliolo , Juergen Schmidhuber

Online learning is a powerful tool for analyzing iterative algorithms. However, the classic adversarial setup sometimes fails to capture certain regularity in online problems in practice. Motivated by this, we establish a new setup, called…

Machine Learning · Computer Science 2022-04-06 Ching-An Cheng , Jonathan Lee , Ken Goldberg , Byron Boots

Reinforcement learning (RL) has achieved promising results on most robotic control tasks. Safety of learning-based controllers is an essential notion of ensuring the effectiveness of the controllers. Current methods adopt whole consistency…

Robotics · Computer Science 2023-07-31 Haotian Xu , Shengjie Wang , Zhaolei Wang , Yunzhe Zhang , Qing Zhuo , Yang Gao , Tao Zhang

This study considers the partial monitoring problem with $k$-actions and $d$-outcomes and provides the first best-of-both-worlds algorithms, whose regrets are favorably bounded both in the stochastic and adversarial regimes. In particular,…

Machine Learning · Computer Science 2022-10-11 Taira Tsuchiya , Shinji Ito , Junya Honda

We consider a resource-aware variant of the classical multi-armed bandit problem: In each round, the learner selects an arm and determines a resource limit. It then observes a corresponding (random) reward, provided the (random) amount of…

Machine Learning · Computer Science 2022-10-18 Viktor Bengs , Eyke Hüllermeier

Online learning algorithms that minimize regret provide strong guarantees in situations that involve repeatedly making decisions in an uncertain environment, e.g. a driver deciding what route to drive to work every day. While regret…

Computer Science and Game Theory · Computer Science 2013-09-06 Jeremiah Blocki , Nicolas Christin , Anupam Datta , Arunesh Sinha

We present a novel algorithm for game-theoretic trajectory planning, tailored for settings in which agents can only observe one another in specific regions of the state space. Such problems arise naturally in the context of multi-robot…

Multiagent Systems · Computer Science 2024-06-18 Kushagra Gupta , David Fridovich-Keil

In this paper, we study the multi-objective bandits (MOB) problem, where a learner repeatedly selects one arm to play and then receives a reward vector consisting of multiple objectives. MOB has found many real-world applications as varied…

Machine Learning · Computer Science 2019-05-31 Shiyin Lu , Guanghui Wang , Yao Hu , Lijun Zhang

The current state of the art in playing many important perfect information games, including Chess and Go, combines planning and deep reinforcement learning with self-play. We extend this approach to imperfect information games and present…

Artificial Intelligence · Computer Science 2018-10-26 Andy Kitchen , Michela Benedetti