English
Related papers

Related papers: Multiple Tree for Partially Observable Monte-Carlo…

200 papers

In this article we propose a heuristic algorithm to explore search space trees associated with instances of combinatorial optimization problems. The algorithm is based on Monte Carlo tree search, a popular algorithm in game playing that is…

Artificial Intelligence · Computer Science 2022-11-17 Jorik Jooken , Pieter Leyman , Tony Wauters , Patrick De Causmaecker

Much current research in AI and games is being devoted to Monte Carlo search (MCS) algorithms. While the quest for a single unified MCS algorithm that would perform well on all problems is of major interest for AI, practitioners often know…

Artificial Intelligence · Computer Science 2015-03-20 Francis Maes , David Lupien St-Pierre , Damien Ernst

Monte Carlo Tree Search (MCTS) is a relatively new sampling method with multiple variants in the literature. They can be applied to a wide variety of challenging domains including board games, video games, and energy-based problems to…

Artificial Intelligence · Computer Science 2020-10-06 Fred Valdez Ameneyro , Edgar Galvan , Anger Fernando Kuri Morales

We present a polynomial-time algorithm that always finds an (approximate) Nash equilibrium for repeated two-player stochastic games. The algorithm exploits the folk theorem to derive a strategy profile that forms an equilibrium by…

Computer Science and Game Theory · Computer Science 2012-06-18 Enrique Munoz de Cote , Michael L. Littman

We introduce the Thresholding Monte Carlo Tree Search problem, in which, given a tree $\mathcal{T}$ and a threshold $\theta$, a player must answer whether the root node value of $\mathcal{T}$ is at least $\theta$ or not. In the given tree,…

Machine Learning · Statistics 2026-02-02 Shoma Nameki , Atsuyoshi Nakamura , Junpei Komiyama , Koji Tabata

Games with large branching factors pose a significant challenge for game tree search algorithms. In this paper, we address this problem with a sampling strategy for Monte Carlo Tree Search (MCTS) algorithms called {\em na\"{i}ve sampling},…

Artificial Intelligence · Computer Science 2017-10-16 Santiago Ontañón

Neural network supported tree-search has shown strong results in a variety of perfect information multi-agent tasks. However, the performance of these methods on partial information games has generally been below competing approaches. Here…

Multiagent Systems · Computer Science 2024-06-18 Ryan Yu , Alex Olshevsky , Peter Chin

In this paper, we consider the problem of finding a Nash equilibrium in a multi-player game over generally connected networks. This model differs from a conventional setting in that players have partial information on the actions of their…

Optimization and Control · Mathematics 2019-12-10 Farzad Salehisadaghiani , Wei Shi , Lacra Pavel

In this paper, we aim to design a distributed approximate algorithm for seeking Nash equilibria of an aggregative game. Due to the local set constraints of each player, projectionbased algorithms have been widely employed for solving such…

Optimization and Control · Mathematics 2021-08-30 Gehui Xu , Guanpu Chen , Hongsheng Qi , Yiguang Hong

This paper presents Generalized Proof-Number Monte-Carlo Tree Search: a generalization of recently proposed combinations of Proof-Number Search (PNS) with Monte-Carlo Tree Search (MCTS), which use (dis)proof numbers to bias UCB1-based…

Artificial Intelligence · Computer Science 2025-06-17 Jakub Kowalski , Dennis J. N. J. Soemers , Szymon Kosakowski , Mark H. M. Winands

Many enhancements to Monte-Carlo Tree Search (MCTS) have been proposed over almost two decades of general game playing and other artificial intelligence research. However, our ability to characterise and understand which variants work well…

We present an extension of Monte Carlo Tree Search (MCTS) that strongly increases its efficiency for trees with asymmetry and/or loops. Asymmetric termination of search trees introduces a type of uncertainty for which the standard upper…

Machine Learning · Statistics 2018-05-24 Thomas M. Moerland , Joost Broekens , Aske Plaat , Catholijn M. Jonker

In this paper, the problem of finding a Nash equilibrium of a multi-player game is considered. The players are only aware of their own cost functions as well as the action space of all players. We develop a relatively fast algorithm within…

Systems and Control · Computer Science 2017-05-09 Farzad Salehisadaghiani , Lacra Pavel

We provide the first fully polynomial time approximation scheme (FPTAS) for computing an approximate mixed-strategy Nash equilibrium in tree-structured graphical multi-hypermatrix games (GMhGs). GMhGs are generalizations of normal-form…

Computer Science and Game Theory · Computer Science 2017-02-07 Luis E. Ortiz , Mohammad T. Irfan

Exciting contemporary machine learning problems have recently been phrased in the classic formalism of tree search -- most famously, the game of Go. Interestingly, the state-space underlying these sequential decision-making problems often…

Machine Learning · Computer Science 2021-06-17 Julia Grosse , Cheng Zhang , Philipp Hennig

In this study, we explore the efficiency of the Monte Carlo Tree Search (MCTS), a prominent decision-making algorithm renowned for its effectiveness in complex decision environments, contingent upon the volume of simulations conducted.…

Artificial Intelligence · Computer Science 2024-03-19 Ye Zhang , Mengran Zhu , Kailin Gui , Jiayue Yu , Yong Hao , Haozhan Sun

In this paper, we consider the online computation of a strategy that aims at optimizing the expected average reward in a Markov decision process. The strategy is computed with a receding horizon and using Monte Carlo tree search (MCTS). We…

Computer Science and Game Theory · Computer Science 2020-07-17 Damien Busatto-Gaston , Debraj Chakraborty , Jean-Francois Raskin

Proof-Number Search (PNS) and Monte-Carlo Tree Search (MCTS) have been successfully applied for decision making in a range of games. This paper proposes a new approach called PN-MCTS that combines these two tree-search methods by…

Artificial Intelligence · Computer Science 2022-06-09 Elliot Doe , Mark H. M. Winands , Dennis J. N. J. Soemers , Cameron Browne

This work proposes a novel distributed approach for computing a Nash equilibrium in convex games with restricted strongly monotone pseudo-gradients. By leveraging the idea of the centralized operator extrapolation method presented in [4] to…

Optimization and Control · Mathematics 2023-10-25 Tatiana Tatarenko , Angelia Nedich

Monte Carlo Tree Search (MCTS), most famously used in game-play artificial intelligence (e.g., the game of Go), is a well-known strategy for constructing approximate solutions to sequential decision problems. Its primary innovation is the…

Optimization and Control · Mathematics 2017-04-21 Daniel R. Jiang , Lina Al-Kanj , Warren B. Powell