中文
相关论文

相关论文: Combinatorial Multi-armed Bandits for Real-Time St…

200 篇论文

The Multi-Armed Bandits (MAB) framework highlights the tension between acquiring new knowledge (Exploration) and leveraging available knowledge (Exploitation). In the classical MAB problem, a decision maker must choose an arm at each time…

机器学习 · 统计学 2017-11-03 Nir Levine , Koby Crammer , Shie Mannor

For a wireless avionics communication system, a Multi-arm bandit game is mathematically formulated, which includes channel states, strategies, and rewards. The simple case includes only two agents sharing the spectrum which is fully studied…

信号处理 · 电气工程与系统科学 2017-11-15 Jingyang Lu , Lun Li , Dan Shen , Genshe Chen , Bin Jia , Erik Blasch , Khanh Pham

This paper studies a multi-armed bandit (MAB) version of the range-searching problem. In its basic form, range searching considers as input a set of points (on the real line) and a collection of (real) intervals. Here, with each specified…

机器学习 · 计算机科学 2021-05-05 Siddharth Barman , Ramakrishnan Krishnamurthy , Saladi Rahul

This paper focuses on building personalized player models solely from player behavior in the context of adaptive games. We present two main contributions: The first is a novel approach to player modeling based on multi-armed bandits (MABs).…

人工智能 · 计算机科学 2021-02-11 Robert C. Gray , Jichen Zhu , Dannielle Arigo , Evan Forman , Santiago Ontañón

The combination of Monte-Carlo Tree Search (MCTS) and deep reinforcement learning is state-of-the-art in two-player perfect-information games. In this paper, we describe a search algorithm that uses a variant of MCTS which we enhanced by 1)…

机器学习 · 计算机科学 2020-05-26 Arta Seify , Michael Buro

Many efficient algorithms with strong theoretical guarantees have been proposed for the contextual multi-armed bandit problem. However, applying these algorithms in practice can be difficult because they require domain expertise to build…

机器学习 · 计算机科学 2018-10-23 Adam N. Elmachtoub , Ryan McNellis , Sechan Oh , Marek Petrik

In Reinforcement Learning (RL), multi-armed Bandit (MAB) problems have found applications across diverse domains such as recommender systems, healthcare, and finance. Traditional MAB algorithms typically assume stationary reward…

人工智能 · 计算机科学 2024-10-10 Gustavo de Freitas Fonseca , Lucas Coelho e Silva , Paulo André Lima de Castro

The multi-armed bandit (MAB) problem is a ubiquitous decision-making problem that exemplifies the exploration-exploitation tradeoff. Standard formulations exclude risk in decision making. Risk notably complicates the basic reward-maximising…

机器学习 · 计算机科学 2021-02-05 Joel Q. L. Chang , Qiuyu Zhu , Vincent Y. F. Tan

Combinatorial linear semi-bandits (CLS) are widely applicable frameworks of sequential decision-making, in which a learner chooses a subset of arms from a given set of arms associated with feature vectors. Existing algorithms work poorly…

机器学习 · 统计学 2019-09-11 Kei Takemura , Shinji Ito

A popular computer puzzle, the game of Minesweeper requires its human players to have a mix of both luck and strategy to succeed. Analyzing these aspects more formally, in our research we assessed the feasibility of a novel methodology…

机器学习 · 计算机科学 2021-06-21 Igor Q. Lordeiro , Diego B. Haddad , Douglas O. Cardoso

In this work we study a well-known and challenging problem of Multi-agent Pathfinding, when a set of agents is confined to a graph, each agent is assigned a unique start and goal vertices and the task is to find a set of collision-free…

人工智能 · 计算机科学 2023-07-26 Yelisey Pitanov , Alexey Skrynnik , Anton Andreychuk , Konstantin Yakovlev , Aleksandr Panov

We consider the popular tree-based search strategy within the framework of reinforcement learning, the Monte Carlo Tree Search (MCTS), in the context of finite-horizon Markov decision process. We propose a dynamic sampling tree policy that…

人工智能 · 计算机科学 2023-05-09 Gongbo Zhang , Yijie Peng , Yilong Xu

Monte-Carlo Tree Search (MCTS) is a powerful tool for many non-differentiable search related problems such as adversarial games. However, the performance of such approach highly depends on the order of the nodes that are considered at each…

计算机视觉与模式识别 · 计算机科学 2025-03-28 Mehraveh Javan Roshtkhari , Matthew Toews , Marco Pedersoli

Multi-player multi-armed bandits (MMAB) study how decentralized players cooperatively play the same multi-armed bandit so as to maximize their total cumulative rewards. Existing MMAB models mostly assume when more than one player pulls the…

机器学习 · 计算机科学 2022-04-29 Xuchuang Wang , Hong Xie , John C. S. Lui

In many games, moves consist of several decisions made by the player. These decisions can be viewed as separate moves, which is already a common practice in multi-action games for efficiency reasons. Such division of a player move into a…

This paper proposes a new game-search algorithm, PN-MCTS, which combines Monte-Carlo Tree Search (MCTS) and Proof-Number Search (PNS). These two algorithms have been successfully applied for decision making in a range of domains. We define…

人工智能 · 计算机科学 2024-05-30 Jakub Kowalski , Elliot Doe , Mark H. M. Winands , Daniel Górski , Dennis J. N. J. Soemers

We propose an efficient Context-Aware clustering of Bandits (CAB) algorithm, which can capture collaborative effects. CAB can be easily deployed in a real-world recommendation system, where multi-armed bandits have been shown to perform…

机器学习 · 计算机科学 2017-02-28 Shuai Li , Purushottam Kar

Online planning is crucial for high performance in many complex sequential decision-making tasks. Monte Carlo Tree Search (MCTS) employs a principled mechanism for trading off exploration for exploitation for efficient online planning, and…

人工智能 · 计算机科学 2024-02-08 Kalle Kujanpää , Amin Babadi , Yi Zhao , Juho Kannala , Alexander Ilin , Joni Pajarinen

We consider a multi-armed bandit problem where the decision maker can explore and exploit different arms at every round. The exploited arm adds to the decision maker's cumulative reward (without necessarily observing the reward) while the…

机器学习 · 计算机科学 2012-07-03 Orly Avner , Shie Mannor , Ohad Shamir

We propose an algorithm for computing approximate Nash equilibria of partially observable games using Monte-Carlo tree search based on recent bandit methods. We obtain experimental results for the game of phantom tic-tac-toe, showing that…

计算机科学与博弈论 · 计算机科学 2011-02-09 David Auger