English
Related papers

Related papers: Exploring an Infinite Space with Finite Memory Sco…

200 papers

We study incentivized exploration in multi-armed bandit (MAB) settings with infinitely many arms modeled as elements in continuous metric spaces. Unlike classical bandit models, we consider scenarios where the decision-maker (principal)…

Machine Learning · Computer Science 2025-08-28 Sourav Chakraborty , Amit Kiran Rege , Claire Monteleoni , Lijun Chen

We investigate the terminating grid exploration for autonomous myopic luminous robots. Myopic robots mean that they can observe nodes only within a certain fixed distance, and luminous robots mean that they have light devices that can emit…

Distributed, Parallel, and Cluster Computing · Computer Science 2021-02-12 Shota Nagahama , Fukuhito Ooshita , Michiko Inoue

We generalize the classical cow-path problem [7, 14, 38, 39] into a question that is relevant for collective foraging in animal groups. Specifically, we consider a setting in which k identical (probabilistic) agents, initially placed at…

Distributed, Parallel, and Cluster Computing · Computer Science 2017-01-25 Ofer Feinerman , Amos Korman , Zvi Lotker , Jean-Sébastien Sereni

In this article, we look at a hat-guessing game, in which each player must guess the color of their own hat while only seeing the hats of the other players. We focus on the case of two hat colors and a countably infinite number of players.…

Probability · Mathematics 2025-10-28 Nathaniel Eldredge

Time-constrained decision processes have been ubiquitous in many fundamental applications in physics, biology and computer science. Recently, restart strategies have gained significant attention for boosting the efficiency of…

Machine Learning · Computer Science 2020-07-02 Semih Cayci , Atilla Eryilmaz , R. Srikant

We consider a variant of the target defense problem where a single defender is tasked to capture a sequence of incoming intruders. The intruders' objective is to breach the target boundary without being captured by the defender. As soon as…

Robotics · Computer Science 2022-12-14 Arman Pourghorban , Michael Dorothy , Daigo Shishika , Alexander Von Moll , Dipankar Maity

Stochastic two-player games model systems with an environment that is both adversarial and stochastic. The adversarial part of the environment is modeled by a player (Player 2) who tries to prevent the system (Player 1) from achieving its…

Computer Science and Game Theory · Computer Science 2025-06-11 Laurent Doyen , Pranshu Gaba , Shibashis Guha

The task of searching for and tracking of multiple targets is a challenging one. However, most works in this area do not consider evasive targets that move faster than the agents comprising the multi-robot system. This is due to the…

Multiagent Systems · Computer Science 2022-07-19 Hian Lee Kwa , Jabez Leong Kit , Roland Bouffanais

We study the problem of dynamic batch learning in high-dimensional sparse linear contextual bandits, where a decision maker, under a given maximum-number-of-batch constraint and only able to observe rewards at the end of each batch, can…

Machine Learning · Statistics 2022-07-19 Zhimei Ren , Zhengyuan Zhou

We deal with a set of autonomous robots moving on an infinite grid. Those robots are opaque, have limited visibility capabilities, and run using synchronous Look-Compute-Move cycles. They all agree on a common chirality, but have no global…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-07-03 Quentin Bramas , Stephane Devismes , Pascal Lafourcade

Learning a diverse set of skills by interacting with an environment without any external supervision is an important challenge. In particular, obtaining a goal-conditioned agent that can reach any given state is useful in many applications.…

Machine Learning · Computer Science 2022-06-24 Lina Mezghani , Sainbayar Sukhbaatar , Piotr Bojanowski , Karteek Alahari

In the classic version of the game of firefighter, on the first turn a fire breaks out on a vertex in a graph $G$ and then $k$ firefighters protect $k$ vertices. On each subsequent turn, the fire spreads to the collective unburnt…

Combinatorics · Mathematics 2024-08-01 Andrea Burgess , John Marcoux , David Pike

There are $n\geq 3$ unit speed mobile agents placed at the origin of the infinite line. In as little time as possible, the agents must find and evacuate from an exit placed at an initially unknown location on the line. The agents can…

Data Structures and Algorithms · Computer Science 2026-05-12 J. Czyzowicz , R. Killick , E. Kranakis , G. Stachowiak

Consider a region that requires to be protected from unauthorized penetrations. The border of the region, modeled as a unit line segment, consists of high priority segments that require the highest level of protection separated by low…

Distributed, Parallel, and Cluster Computing · Computer Science 2019-10-04 Oscar Morales-Ponce

This paper studies the problem of defending (1D and 2D) boundaries against a large number of continuous attacks with a heterogeneous group of defenders. The defender team has perfect information of the attack events within some time (finite…

Robotics · Computer Science 2023-02-21 Si Wei Feng , Jingjin Yu

Multi-player multi-armed bandit is an increasingly relevant decision-making problem, motivated by applications to cognitive radio systems. Most research for this problem focuses exclusively on the settings that players have \textit{full…

Machine Learning · Computer Science 2022-12-14 Guojun Xiong , Jian Li

The gathering over meeting nodes problem asks the robots to gather at one of the pre-defined meeting nodes. The robots are deployed on the nodes of an anonymous two-dimensional infinite grid which has a subset of nodes marked as meeting…

Distributed, Parallel, and Cluster Computing · Computer Science 2023-06-22 Subhash Bhagat , Abhinav Chakraborty , Bibhuti Das , Krishnendu Mukhopadhyaya

We study 2-player turn-based perfect-information stochastic games with countably infinite state space. The players aim at maximizing/minimizing the probability of a given event (i.e., measurable set of infinite plays), such as reachability,…

Computer Science and Game Theory · Computer Science 2017-04-18 Stefan Kiefer , Richard Mayr , Mahsa Shirmohammadi , Dominik Wojtczak

We study the experimentation dynamics of a decision maker (DM) in a two-armed bandit setup (Bolton and Harris (1999)), where the agent holds ambiguous beliefs regarding the distribution of the return process of one arm and is certain about…

Theoretical Economics · Economics 2021-04-02 Farzad Pourbabaee

We give lower bounds on the amount of memory required by one-pass streaming algorithms for solving several natural learning problems. In a setting where examples lie in $\{0,1\}^d$ and the optimal classifier can be encoded using $\kappa$…

Machine Learning · Computer Science 2022-06-13 Gavin Brown , Mark Bun , Adam Smith