English
Related papers

Related papers: Monte Carlo *-Minimax Search

200 papers

The combination of Monte-Carlo tree search (MCTS) with deep reinforcement learning has led to significant advances in artificial intelligence. However, AlphaZero, the current state-of-the-art MCTS algorithm, still relies on handcrafted…

Machine Learning · Computer Science 2020-07-27 Jean-Bastien Grill , Florent Altché , Yunhao Tang , Thomas Hubert , Michal Valko , Ioannis Antonoglou , Rémi Munos

In this paper, we extend the Descent framework, which enables learning and planning in the context of two-player games with perfect information, to the framework of stochastic games. We propose two ways of doing this, the first way…

Artificial Intelligence · Computer Science 2023-02-10 Quentin Cohen-Solal , Tristan Cazenave

Monte Carlo Tree Search (MCTS) is an immensely popular search-based framework used for decision making. It is traditionally applied to domains where a perfect simulation model of the environment is available. We study and improve MCTS in…

Artificial Intelligence · Computer Science 2024-05-24 Farnaz Kohankhaki , Kiarash Aghakasiri , Hongming Zhang , Ting-Han Wei , Chao Gao , Martin Müller

This paper makes two proposals for Monte Carlo Softmax Search, which is a recently proposed method that is classified as a selective search like the Monte Carlo Tree Search. The first proposal separately defines the node-selection and…

Artificial Intelligence · Computer Science 2020-09-09 Harukazu Igarashi , Yuichi Morioka , Kazumasa Yamamoto

In this article, we focus on search algorithms for two-player perfect information games, whose objective is to determine the best possible strategy, and ideally a winning strategy. Unfortunately, some search algorithms for games in the…

Artificial Intelligence · Computer Science 2026-03-26 Quentin Cohen-Solal

An interesting iterative procedure is proposed to solve a two-player zero-sum Markov games. Under suitable assumption, the boundedness of the proposed iterates is obtained theoretically. Using results from stochastic approximation, the…

Machine Learning · Computer Science 2025-09-23 Shreyas S R , Antony Vijesh

Decision-making under uncertainty (DMU) is present in many important problems. An open challenge is DMU in non-stationary environments, where the dynamics of the environment can change over time. Reinforcement Learning (RL), a popular…

Artificial Intelligence · Computer Science 2022-03-01 Geoffrey Pettet , Ayan Mukhopadhyay , Abhishek Dubey

In games like chess, strategy evolves dramatically across distinct phases - the opening, middlegame, and endgame each demand different forms of reasoning and decision-making. Yet, many modern chess engines rely on a single neural network to…

Machine Learning · Computer Science 2025-06-18 Felix Helfenstein , Johannes Czech , Jannis Blüml , Max Eisel , Kristian Kersting

In many games, moves consist of several decisions made by the player. These decisions can be viewed as separate moves, which is already a common practice in multi-action games for efficiency reasons. Such division of a player move into a…

Artificial Intelligence · Computer Science 2021-12-16 Jakub Kowalski , Maksymilian Mika , Wojciech Pawlik , Jakub Sutowicz , Marek Szykuła , Mark H. M. Winands

In this work we study a well-known and challenging problem of Multi-agent Pathfinding, when a set of agents is confined to a graph, each agent is assigned a unique start and goal vertices and the task is to find a set of collision-free…

Artificial Intelligence · Computer Science 2023-07-26 Yelisey Pitanov , Alexey Skrynnik , Anton Andreychuk , Konstantin Yakovlev , Aleksandr Panov

In the era of vast digital information, the sheer volume and heterogeneity of available information present significant challenges for intricate information seeking. Users frequently face multistep web search tasks that involve navigating…

Information Retrieval · Computer Science 2025-02-10 Ruiyang Ren , Yuhao Wang , Junyi Li , Jinhao Jiang , Wayne Xin Zhao , Wenjie Wang , Tat-Seng Chua

There exists a broad class of sequencing problems, for example, in proteins and polymers that can be formulated as a heuristic search algorithm that involve decision making akin to a computer game. AI gaming algorithms such as Monte Carlo…

Soft Condensed Matter · Physics 2020-06-08 Tarak K Patra , Troy D. Loeffler , Subramanian K R S Sankaranarayanan

In this article we propose a heuristic algorithm to explore search space trees associated with instances of combinatorial optimization problems. The algorithm is based on Monte Carlo tree search, a popular algorithm in game playing that is…

Artificial Intelligence · Computer Science 2022-11-17 Jorik Jooken , Pieter Leyman , Tony Wauters , Patrick De Causmaecker

We demonstrate how Monte Carlo Search (MCS) algorithms, namely Nested Monte Carlo Search (NMCS) and Nested Rollout Policy Adaptation (NRPA), can be used to build graphs and find counter-examples to spectral graph theory conjectures in…

Artificial Intelligence · Computer Science 2022-08-04 Milo Roucairol , Tristan Cazenave

We present a Monte-Carlo simulation algorithm for real-time policy improvement of an adaptive controller. In the Monte-Carlo simulation, the long-term expected reward of each possible action is statistically measured, using the initial…

Machine Learning · Computer Science 2025-04-07 Gerald Tesauro , Gregory R. Galperin

We propose a novel method applicable in many scene understanding problems that adapts the Monte Carlo Tree Search (MCTS) algorithm, originally designed to learn to play games of high-state complexity. From a generated pool of proposals, our…

Computer Vision and Pattern Recognition · Computer Science 2022-07-08 Sinisa Stekovic , Mahdi Rad , Alireza Moradi , Friedrich Fraundorfer , Vincent Lepetit

In this research, we investigate the possibility of applying a search strategy to genetic algorithms to explore the entire genetic tree structure. Several methods aid in performing tree searches; however, simpler algorithms such as…

Neural and Evolutionary Computing · Computer Science 2023-08-10 Akshay Hebbar

Path planning is a crucial algorithmic approach for designing robot behaviors. Sampling-based approaches, like rapidly exploring random trees (RRTs) or probabilistic roadmaps, are prominent algorithmic solutions for path planning problems.…

Robotics · Computer Science 2022-08-05 T. Dam , G. Chalvatzaki , J. Peters , J. Pajarinen

We introduce an approach aimed at enhancing the reasoning capabilities of Large Language Models (LLMs) through an iterative preference learning process inspired by the successful strategy employed by AlphaZero. Our work leverages Monte…

Artificial Intelligence · Computer Science 2024-06-19 Yuxi Xie , Anirudh Goyal , Wenyue Zheng , Min-Yen Kan , Timothy P. Lillicrap , Kenji Kawaguchi , Michael Shieh

Polly is the LLVM project's polyhedral loop nest optimizer. Recently, user-directed loop transformation pragmas were proposed based on LLVM/Clang and Polly. The search space exposed by the transformation pragmas is a tree, wherein each node…

Programming Languages · Computer Science 2021-05-12 Jaehoon Koo , Prasanna Balaprakash , Michael Kruse , Xingfu Wu , Paul Hovland , Mary Hall