English
Related papers

Related papers: Injecting Combinatorial Optimization into MCTS: Ap…

200 papers

We consider the popular tree-based search strategy within the framework of reinforcement learning, the Monte Carlo Tree Search (MCTS), in the context of finite-horizon Markov decision process. We propose a dynamic sampling tree policy that…

Artificial Intelligence · Computer Science 2023-05-09 Gongbo Zhang , Yijie Peng , Yilong Xu

Monte Carlo Tree Search (MCTS) is a powerful algorithm for solving complex decision-making problems. This paper presents an optimized MCTS implementation applied to the FrozenLake environment, a classic reinforcement learning task…

Artificial Intelligence · Computer Science 2024-09-26 Esteban Aldana Guerra

Making changes to a program to optimize its performance is an unscalable task that relies entirely upon human intuition and experience. In addition, companies operating at large scale are at a stage where no single individual understands…

Machine Learning · Computer Science 2020-05-08 Don M. Dini

Monte Carlo Tree Search (MCTS) has improved the performance of game engines in domains such as Go, Hex, and general game playing. MCTS has been shown to outperform classic alpha-beta search in games where good heuristic evaluations are…

Artificial Intelligence · Computer Science 2014-06-23 Marc Lanctot , Mark H. M. Winands , Tom Pepels , Nathan R. Sturtevant

Reinforcement learning has achieved remarkable success in perfect information games such as Go and Atari, enabling agents to compete at the highest levels against human players. However, research in reinforcement learning for imperfect…

Machine Learning · Computer Science 2024-10-24 Jiamian Li

In many problem settings, most notably in game playing, an agent receives a possibly delayed reward for its actions. Often, those rewards are handcrafted and not naturally given. Even simple terminal-only rewards, like winning equals 1 and…

Artificial Intelligence · Computer Science 2020-12-09 Tobias Joppen , Johannes Fürnkranz

Monte Carlo Tree Search can be used for automated theorem proving. Holophrasm is a neural theorem prover using MCTS combined with neural networks for the policy and the evaluation. In this paper we propose to improve the performance of the…

Artificial Intelligence · Computer Science 2023-09-25 Marc Pierre , Quentin Cohen-Solal , Tristan Cazenave

The construction of approximate replication strategies for pricing and hedging of derivative contracts in incomplete markets is a key problem of financial engineering. Recently Reinforcement Learning algorithms for hedging under realistic…

Artificial Intelligence · Computer Science 2023-11-02 Oleg Szehr

Monte Carlo Tree Search is a popular method for solving decision making problems. Faster implementations allow for more simulations within the same wall clock time, directly improving search performance. To this end, we present an…

Artificial Intelligence · Computer Science 2025-08-29 James Ragan , Fred Y. Hadaegh , Soon-Jo Chung

Proof-Number Search (PNS) and Monte-Carlo Tree Search (MCTS) have been successfully applied for decision making in a range of games. This paper proposes a new approach called PN-MCTS that combines these two tree-search methods by…

Artificial Intelligence · Computer Science 2022-06-09 Elliot Doe , Mark H. M. Winands , Dennis J. N. J. Soemers , Cameron Browne

We consider a deterministic game with alternate moves and complete information, of which the issue is always the victory of one of the two opponents. We assume that this game is the realization of a random model enjoying some independence…

Probability · Mathematics 2018-01-25 Sylvain Delattre , Nicolas Fournier

We present an extension of Monte Carlo Tree Search (MCTS) that strongly increases its efficiency for trees with asymmetry and/or loops. Asymmetric termination of search trees introduces a type of uncertainty for which the standard upper…

Machine Learning · Statistics 2018-05-24 Thomas M. Moerland , Joost Broekens , Aske Plaat , Catholijn M. Jonker

Recent advances in bandit tools and techniques for sequential learning are steadily enabling new applications and are promising the resolution of a range of challenging related problems. We study the game tree search problem, where the goal…

Machine Learning · Statistics 2017-11-07 Emilie Kaufmann , Wouter Koolen

Making inferences with a deep neural network on a batch of states is much faster with a GPU than making inferences on one state after another. We build on this property to propose Monte Carlo Tree Search algorithms using batched inferences.…

Artificial Intelligence · Computer Science 2021-04-12 Tristan Cazenave

Monte Carlo Tree Search (MCTS) is a sampling best-first method to search for optimal decisions. The MCTS's popularity is based on its extraordinary results in the challenging two-player based game Go, a game considered much harder than…

Neural and Evolutionary Computing · Computer Science 2021-12-21 Edgar Galván , Gavin Simpson

In this research, we investigate the possibility of applying a search strategy to genetic algorithms to explore the entire genetic tree structure. Several methods aid in performing tree searches; however, simpler algorithms such as…

Neural and Evolutionary Computing · Computer Science 2023-08-10 Akshay Hebbar

Monte Carlo Tree Search (MCTS) is a relatively new sampling method with multiple variants in the literature. They can be applied to a wide variety of challenging domains including board games, video games, and energy-based problems to…

Artificial Intelligence · Computer Science 2020-10-06 Fred Valdez Ameneyro , Edgar Galvan , Anger Fernando Kuri Morales

We introduce an approach aimed at enhancing the reasoning capabilities of Large Language Models (LLMs) through an iterative preference learning process inspired by the successful strategy employed by AlphaZero. Our work leverages Monte…

Artificial Intelligence · Computer Science 2024-06-19 Yuxi Xie , Anirudh Goyal , Wenyue Zheng , Min-Yen Kan , Timothy P. Lillicrap , Kenji Kawaguchi , Michael Shieh

Monte Carlo Tree Search (MCTS) is particularly adapted to domains where the potential actions can be represented as a tree of sequential decisions. For an effective action selection, MCTS performs many simulations to build a reliable tree…

Artificial Intelligence · Computer Science 2018-09-10 Seydou Ba , Takuya Hiraoka , Takashi Onishi , Toru Nakata , Yoshimasa Tsuruoka

Search-based procedural content generation uses stochastic global optimization algorithms to search for game content. However, standard tree search algorithms can be competitive with evolution on some optimization problems. We investigate…

Artificial Intelligence · Computer Science 2020-08-14 Debosmita Bhaumik , Ahmed Khalifa , Michael Cerny Green , Julian Togelius