中文
相关论文

相关论文: Finding the bandit in a graph: Sequential search-a…

200 篇论文

We study the problem of reducing test-time acquisition costs in classification systems. Our goal is to learn decision rules that adaptively select sensors for each example as necessary to make a confident prediction. We model our system as…

机器学习 · 统计学 2015-10-27 Joseph Wang , Kirill Trapeznikov , Venkatesh Saligrama

This paper proposes a new architecture for multi-agent systems to cover an unknowingly distributed fast, safely, and decentralizedly. The inter-agent communication is organized by a directed graph with fixed topology, and we model agent…

系统与控制 · 电气工程与系统科学 2023-07-11 Hossein Rastgoftar

A finite-horizon variant of the quickest change detection problem is investigated, which is motivated by a change detection problem that arises in piecewise stationary bandits. The goal is to minimize the \emph{latency}, which is smallest…

信息论 · 计算机科学 2025-06-19 Yu-Han Huang , Venugopal V. Veeravalli

We address a problem of area protection in graph-based scenarios with multiple agents. The problem consists of two adversarial teams of agents that move in an undirected graph shared by both teams. Agents are placed in vertices of the…

人工智能 · 计算机科学 2017-08-25 Marika Ivanová , Pavel Surynek

We consider the problem of finding an edge in a hidden undirected graph $G = (V, E)$ with $n$ vertices, in a model where we only allowed queries that ask whether or not a subset of vertices contains an edge. We study the non-adaptive model…

数据结构与算法 · 计算机科学 2022-07-07 Ron Kupfer , Noam Nisan

Bandit algorithms are guaranteed to solve diverse sequential decision-making problems, provided that a sufficient exploration budget is available. However, learning from scratch is often too costly for personalization tasks where a single…

机器学习 · 计算机科学 2025-08-08 Newton Mwai , Emil Carlsson , Fredrik D. Johansson

We investigate the interrelation between graph searching games and games with imperfect information. As key consequence we obtain that parity games with bounded imperfect information can be solved in PTIME on graphs of bounded DAG-width…

计算机科学与博弈论 · 计算机科学 2015-03-19 Bernd Puchala , Roman Rabinovich

We address a problem of area protection in graph-based scenarios with multiple mobile agents where connectivity is maintained among agents to ensure they can communicate. The problem consists of two adversarial teams of agents that move in…

多智能体系统 · 计算机科学 2017-09-06 Marika Ivanová , Pavel Surynek , Diep Thi Ngoc Nguyen

We study a multi-objective pure exploration problem in a multi-armed bandit model. Each arm is associated to an unknown multi-variate distribution and the goal is to identify the distributions whose mean is not uniformly worse than that of…

机器学习 · 统计学 2025-01-15 Cyrille Kone , Emilie Kaufmann , Laura Richert

The causal bandit problem seeks to identify, through sequential experimentation, an intervention that maximizes the expected reward in a causal system modeled by a directed acyclic graph (DAG). Existing methods typically assume that the…

机器学习 · 计算机科学 2026-04-07 Yijia Zhao , Qing Zhou

Learning a faithful directed acyclic graph (DAG) from samples of a joint distribution is a challenging combinatorial problem, owing to the intractable search space superexponential in the number of graph nodes. A recent breakthrough…

机器学习 · 计算机科学 2019-04-24 Yue Yu , Jie Chen , Tian Gao , Mo Yu

We consider the problem of sequentially allocating resources in a censored semi-bandits setup, where the learner allocates resources at each step to the arms and observes loss. The loss depends on two hidden parameters, one specific to the…

机器学习 · 计算机科学 2021-04-14 Arun Verma , Manjesh K. Hanawal , Arun Rajkumar , Raman Sankaran

Contextual bandits are widely-used in the study of learning-based control policies for finite action spaces. While the problem is well-studied for bandits with perfectly observed context vectors, little is known about the case of…

机器学习 · 统计学 2022-02-03 Hongju Park , Mohamad Kazem Shirani Faradonbeh

The multi-armed bandit problem is a core framework for sequential decision-making under uncertainty, but classical algorithms often fail in environments with hidden, time-varying states that confound reward estimation and optimal action…

机器学习 · 计算机科学 2026-02-19 Jikai Jin , Kenneth Hung , Sanath Kumar Krishnamurthy , Baoyi Shi , Congshan Zhang

In this paper, we formulate the multi-agent graph bandit problem as a multi-agent extension of the graph bandit problem introduced by Zhang, Johansson, and Li [CISS 57, 1-6 (2023)]. In our formulation, $N$ cooperative agents travel on a…

机器学习 · 计算机科学 2024-11-05 Phevos Paschalidis , Runyu Zhang , Na Li

Best arm identification (or, pure exploration) in multi-armed bandits is a fundamental problem in machine learning. In this paper we study the distributed version of this problem where we have multiple agents, and they want to learn the…

机器学习 · 计算机科学 2019-09-02 Chao Tao , Qin Zhang , Yuan Zhou

Directed acyclic graphs (DAGs) are commonly used to model causal relationships among random variables. In general, learning the DAG structure is both computationally and statistically challenging. Moreover, without additional information,…

机器学习 · 统计学 2024-03-26 Ali Shojaie , Wenyu Chen

While sequential task assignment for a single agent has been widely studied, such problems in a multi-agent setting, where the agents have heterogeneous task preferences or capabilities, remain less well-characterized. We study a…

多智能体系统 · 计算机科学 2025-10-21 Qinshuang Wei , Vaibhav Srivastava , Vijay Gupta

We study the problem of patrolling the nodes of a network collaboratively by a team of mobile agents, such that each node of the network is visited by at least one agent once in every $I(n)$ time units, with the objective of minimizing the…

分布式、并行与集群计算 · 计算机科学 2018-08-14 Shantanu Das , Giuseppe Antonio Di Luna , Leszek A. Gasieniec

This paper studies the Best-of-K Bandit game: At each time the player chooses a subset S among all N-choose-K possible options and observes reward max(X(i) : i in S) where X is a random vector drawn from a joint distribution. The objective…

机器学习 · 计算机科学 2016-03-22 Max Simchowitz , Kevin Jamieson , Benjamin Recht