English
Related papers

Related papers: Adapting Improved Upper Confidence Bounds for Mont…

200 papers

We obtain the upper bound of the loss function for a strategy in the multi-armed bandit problem with Gaussian distributions of incomes. Considered strategy is an asymptotic generalization of the strategy proposed by J. Bather for the…

Statistics Theory · Mathematics 2019-02-04 Alexander Kolnogorov , Sergey Garbar

Nowadays, the field of Artificial Intelligence in Computer Games (AI in Games) is going to be more alluring since computer games challenge many aspects of AI with a wide range of problems, particularly general problems. One of these kinds…

Upper Confidence Bound (UCB) algorithms are a widely-used class of sequential algorithms for the $K$-armed bandit problem. Despite extensive research over the past decades aimed at understanding their asymptotic and (near) minimax…

Statistics Theory · Mathematics 2024-12-10 Qiyang Han , Koulik Khamaru , Cun-Hui Zhang

In this paper, we consider the online computation of a strategy that aims at optimizing the expected average reward in a Markov decision process. The strategy is computed with a receding horizon and using Monte Carlo tree search (MCTS). We…

Computer Science and Game Theory · Computer Science 2020-07-17 Damien Busatto-Gaston , Debraj Chakraborty , Jean-Francois Raskin

The article presents research on the use of Monte-Carlo Tree Search (MCTS) methods to create an artificial player for the popular card game "The Lord of the Rings". The game is characterized by complicated rules, multi-stage round…

Machine Learning · Computer Science 2021-09-27 Konrad Godlewski , Bartosz Sawicki

In many problem settings, most notably in game playing, an agent receives a possibly delayed reward for its actions. Often, those rewards are handcrafted and not naturally given. Even simple terminal-only rewards, like winning equals one…

Artificial Intelligence · Computer Science 2021-01-27 Tobias Joppen , Johannes Fürnkranz

We study an original problem of pure exploration in a strategic bandit model motivated by Monte Carlo Tree Search. It consists in identifying the best action in a game, when the player may sample random outcomes of sequentially chosen pairs…

Statistics Theory · Mathematics 2016-02-16 Aurélien Garivier , Emilie Kaufmann , Wouter Koolen

This paper introduces a novel backup strategy for Monte-Carlo Tree Search (MCTS) designed for highly stochastic and partially observable Markov decision processes. We adopt a probabilistic approach, modeling both value and action-value…

Artificial Intelligence · Computer Science 2023-09-20 Tuan Dam , Pascal Stenger , Lukas Schneider , Joni Pajarinen , Carlo D'Eramo , Odalric-Ambrym Maillard

Monte Carlo tree search (MCTS) is extremely popular in computer Go which determines each action by enormous simulations in a broad and deep search tree. However, human experts select most actions by pattern analysis and careful evaluation…

Artificial Intelligence · Computer Science 2017-06-14 Jinzhuo Wang , Wenmin Wang , Ronggang Wang , Wen Gao

We explore how a general AI algorithm can be used for 3D scene understanding to reduce the need for training data. More exactly, we propose a modification of the Monte Carlo Tree Search (MCTS) algorithm to retrieve objects and room layouts…

Computer Vision and Pattern Recognition · Computer Science 2021-05-06 Shreyas Hampali , Sinisa Stekovic , Sayan Deb Sarkar , Chetan Srinivasa Kumar , Friedrich Fraundorfer , Vincent Lepetit

In this research, we investigate the possibility of applying a search strategy to genetic algorithms to explore the entire genetic tree structure. Several methods aid in performing tree searches; however, simpler algorithms such as…

Neural and Evolutionary Computing · Computer Science 2023-08-10 Akshay Hebbar

To solve the problem of lateral and logitudinal joint decision-making of multi-vehicle cooperative driving for connected and automated vehicles (CAVs), this paper proposes a Monte Carlo tree search (MCTS) method with parallel update for…

Multiagent Systems · Computer Science 2025-08-07 Ye Han , Lijun Zhang , Dejian Meng , Zhuang Zhang , Xingyu Hu , Songyu Weng

The article presents the use of Monte Carlo Tree Search algorithms for the card game Lord of the Rings. The main challenge was the complexity of the game mechanics, in which each round consists of 5 decision stages and 2 random stages. To…

Artificial Intelligence · Computer Science 2021-09-28 Konrad Godlewski , Bartosz Sawicki

We propose a novel variant of the UCB algorithm (referred to as Efficient-UCB-Variance (EUCBV)) for minimizing cumulative regret in the stochastic multi-armed bandit (MAB) setting. EUCBV incorporates the arm elimination strategy proposed in…

Machine Learning · Computer Science 2018-07-12 Subhojyoti Mukherjee , K. P. Naveen , Nandan Sudarsanam , Balaraman Ravindran

Autonomous mobile robots enable increased flexibility of manufacturing systems. The design and operating strategy of such a fleet of robots requires careful consideration of both fixed and operational costs. In this paper, a Monte-Carlo…

Systems and Control · Electrical Eng. & Systems 2024-03-05 T. M. J. T. Baltussen , M. Goutham , M. Menon , S. G. Garrow , M. Santillo , S. Stockar

Recent works on neural contextual bandits have achieved compelling performances due to their ability to leverage the strong representation power of neural networks (NNs) for reward prediction. Many applications of contextual bandits involve…

Machine Learning · Computer Science 2023-03-02 Zhongxiang Dai , Yao Shu , Arun Verma , Flint Xiaofeng Fan , Bryan Kian Hsiang Low , Patrick Jaillet

Many enhancements to Monte-Carlo Tree Search (MCTS) have been proposed over almost two decades of general game playing and other artificial intelligence research. However, our ability to characterise and understand which variants work well…

Motivated by wireless networks where interference or channel state estimates provide partial insight into throughput, we study a variant of the classical stochastic multi-armed bandit problem in which the learner has limited access to…

Machine Learning · Computer Science 2026-03-03 Arun Verma , Manjesh Kumar Hanawal , Arun Rajkumar

This paper proposes a novel reinforcement learning (RL) algorithm using improved Monte Carlo tree search (IMCTS) formulation for discrete optimum design of truss structures. IMCTS with multiple root nodes includes update process, the best…

Artificial Intelligence · Computer Science 2024-08-08 Fu-Yao Ko , Katsuyuki Suzuki , Kazuo Yonekura

The upper confidence bound (UCB) policy is recognized as an order-optimal solution for the classical total-reward bandit problem. While similar UCB-based approaches have been applied to the max bandit problem, which aims to maximize the…

Machine Learning · Statistics 2024-11-04 Nobuaki Kikkawa , Hiroshi Ohno