English
Related papers

Related papers: Enhancing the Monte Carlo Tree Search Algorithm fo…

200 papers

Monte Carlo Tree Search (MCTS) methods have achieved great success in many Artificial Intelligence (AI) benchmarks. The in-tree operations become a critical performance bottleneck in realizing parallel MCTS on CPUs. In this work, we develop…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-08-25 Yuan Meng , Rajgopal Kannan , Viktor Prasanna

Monte Carlo Tree Search (MCTS) is a powerful algorithm for solving complex decision-making problems. This paper presents an optimized MCTS implementation applied to the FrozenLake environment, a classic reinforcement learning task…

Artificial Intelligence · Computer Science 2024-09-26 Esteban Aldana Guerra

Traditional search algorithms have issues when applied to games of imperfect information where the number of possible underlying states and trajectories are very large. This challenge is particularly evident in trick-taking card games.…

Artificial Intelligence · Computer Science 2024-04-23 Douglas Rebstock , Christopher Solinas , Nathan R. Sturtevant , Michael Buro

Software engineers operating in complex and dynamic environments must continuously adapt to evolving requirements, learn iteratively from experience, and reconsider their approaches based on new insights. However, current large language…

Artificial Intelligence · Computer Science 2025-04-03 Antonis Antoniades , Albert Örwall , Kexun Zhang , Yuxi Xie , Anirudh Goyal , William Wang

Monte Carlo Tree Search (MCTS) is a best-first sampling method employed in the search for optimal decisions. The effectiveness of MCTS relies on the construction of its statistical tree, with the selection policy playing a crucial role. A…

Neural and Evolutionary Computing · Computer Science 2023-11-27 Edgar Galvan , Fred Valdez Ameneyro

Much current research in AI and games is being devoted to Monte Carlo search (MCS) algorithms. While the quest for a single unified MCS algorithm that would perform well on all problems is of major interest for AI, practitioners often know…

Artificial Intelligence · Computer Science 2015-03-20 Francis Maes , David Lupien St-Pierre , Damien Ernst

Monte Carlo Tree Search (MCTS) is a sampling best-first method to search for optimal decisions. The MCTS's popularity is based on its extraordinary results in the challenging two-player based game Go, a game considered much harder than…

Neural and Evolutionary Computing · Computer Science 2021-12-21 Edgar Galván , Gavin Simpson

We study Monte Carlo tree search (MCTS) in zero-sum extensive-form games with perfect information and simultaneous moves. We present a general template of MCTS algorithms for these games, which can be instantiated by various selection…

Computer Science and Game Theory · Computer Science 2013-12-16 Viliam Lisý , Vojtěch Kovařík , Marc Lanctot , Branislav Bošanský

UCT, a state-of-the art algorithm for Monte Carlo tree search (MCTS) in games and Markov decision processes, is based on UCB1, a sampling policy for the Multi-armed Bandit problem (MAB) that minimizes the cumulative regret. However, search…

Artificial Intelligence · Computer Science 2012-07-25 David Tolpin , Solomon Eyal Shimony

Matching tile games are an extremely popular game genre. Arguably the most popular iteration, Match-3 games, are simple to understand puzzle games, making them great benchmarks for research. In this paper, we propose developing different…

Artificial Intelligence · Computer Science 2019-07-16 Luvneesh Mugrai , Fernando de Mesentier Silva , Christoffer Holmgård , Julian Togelius

Competitive program generation aims to automatically produce correct and efficient solutions for programming-contest problems under strict time and memory constraints. Existing LLM-based approaches often fail to perform explicit algorithmic…

Software Engineering · Computer Science 2026-05-05 Minnan Wei , Xiang Chen , Xiaoshuai Niu , Siyu Chen

The General Video Game AI competitions have been the testing ground for several techniques for game playing, such as evolutionary computation techniques, tree search algorithms, hyper heuristic based or knowledge based algorithms. So far…

Artificial Intelligence · Computer Science 2018-06-05 Ivan Bravi , Jialin Liu , Diego Perez-Liebana , Simon Lucas

Large Language Models (LLM) are increasingly being explored for problem-solving tasks. However, their strategic planning capability is often viewed with skepticism. Recent studies have incorporated the Monte Carlo Tree Search (MCTS)…

Artificial Intelligence · Computer Science 2025-02-05 Bingzheng Gan , Yufan Zhao , Tianyi Zhang , Jing Huang , Yusu Li , Shu Xian Teo , Changwang Zhang , Wei Shi

In this paper we explore the application of simultaneous move Monte Carlo Tree Search (MCTS) based online framework for tactical maneuvering between two unmanned aircrafts. Compared to other techniques, MCTS enables efficient search over…

Artificial Intelligence · Computer Science 2020-09-21 Kunal Srivastava , Amit Surana

Online planning is crucial for high performance in many complex sequential decision-making tasks. Monte Carlo Tree Search (MCTS) employs a principled mechanism for trading off exploration for exploitation for efficient online planning, and…

Artificial Intelligence · Computer Science 2024-02-08 Kalle Kujanpää , Amin Babadi , Yi Zhao , Juho Kannala , Alexander Ilin , Joni Pajarinen

We present an extension of Monte Carlo Tree Search (MCTS) that strongly increases its efficiency for trees with asymmetry and/or loops. Asymmetric termination of search trees introduces a type of uncertainty for which the standard upper…

Machine Learning · Statistics 2018-05-24 Thomas M. Moerland , Joost Broekens , Aske Plaat , Catholijn M. Jonker

Monte Carlo tree search (MCTS) is extremely popular in computer Go which determines each action by enormous simulations in a broad and deep search tree. However, human experts select most actions by pattern analysis and careful evaluation…

Artificial Intelligence · Computer Science 2017-06-14 Jinzhuo Wang , Wenmin Wang , Ronggang Wang , Wen Gao

This paper presents a novel approach to automated playtesting for the prediction of human player behavior and experience. It has previously been demonstrated that Deep Reinforcement Learning (DRL) game-playing agents can predict both game…

Artificial Intelligence · Computer Science 2021-07-27 Shaghayegh Roohi , Christian Guckelsberger , Asko Relas , Henri Heiskanen , Jari Takatalo , Perttu Hämäläinen

Planning problems are among the most important and well-studied problems in artificial intelligence. They are most typically solved by tree search algorithms that simulate ahead into the future, evaluate future states, and back-up those…

Artificial Intelligence · Computer Science 2018-07-18 Arthur Guez , Théophane Weber , Ioannis Antonoglou , Karen Simonyan , Oriol Vinyals , Daan Wierstra , Rémi Munos , David Silver

This paper proposes using a linear function approximator, rather than a deep neural network (DNN), to bias a Monte Carlo tree search (MCTS) player for general games. This is unlikely to match the potential raw playing strength of DNNs, but…

Artificial Intelligence · Computer Science 2019-03-22 Dennis J. N. J. Soemers , Éric Piette , Cameron Browne