English
Related papers

Related papers: Learning Self-Game-Play Agents for Combinatorial O…

200 papers

This paper proposes a new game-search algorithm, PN-MCTS, which combines Monte-Carlo Tree Search (MCTS) and Proof-Number Search (PNS). These two algorithms have been successfully applied for decision making in a range of domains. We define…

Artificial Intelligence · Computer Science 2024-05-30 Jakub Kowalski , Elliot Doe , Mark H. M. Winands , Daniel Górski , Dennis J. N. J. Soemers

The combination of Monte-Carlo tree search (MCTS) with deep reinforcement learning has led to significant advances in artificial intelligence. However, AlphaZero, the current state-of-the-art MCTS algorithm, still relies on handcrafted…

Machine Learning · Computer Science 2020-07-27 Jean-Bastien Grill , Florent Altché , Yunhao Tang , Thomas Hubert , Michal Valko , Ioannis Antonoglou , Rémi Munos

This paper proposes using a linear function approximator, rather than a deep neural network (DNN), to bias a Monte Carlo tree search (MCTS) player for general games. This is unlikely to match the potential raw playing strength of DNNs, but…

Artificial Intelligence · Computer Science 2019-03-22 Dennis J. N. J. Soemers , Éric Piette , Cameron Browne

Reinforcement learning has recently been used to approach well-known NP-hard combinatorial problems in graph theory. Among these problems, Hamiltonian cycle problems are exceptionally difficult to analyze, even when restricted to individual…

Artificial Intelligence · Computer Science 2022-11-18 Kevin Du , Ian Gemp , Yi Wu , Yingying Wu

Recently, Gumbel AlphaZero~(GAZ) was proposed to solve classic combinatorial optimization problems such as TSP and JSSP by creating a carefully designed competition model~(consisting of a learning player and a competitor player), which…

Systems and Control · Electrical Eng. & Systems 2025-02-25 Hui Wang , Xufeng Zhang , Xiaoyu Zhang , Zhenhuan Ding , Chaoxu Mu

Game-theoretic resource allocation on graphs (GRAG) involves two players competing over multiple steps to control nodes of interest on a graph, a problem modeled as a multi-step Colonel Blotto Game (MCBG). Finding optimal strategies is…

Machine Learning · Computer Science 2025-05-13 Zijian An , Lifeng Zhou

Traditional search algorithms have issues when applied to games of imperfect information where the number of possible underlying states and trajectories are very large. This challenge is particularly evident in trick-taking card games.…

Artificial Intelligence · Computer Science 2024-04-23 Douglas Rebstock , Christopher Solinas , Nathan R. Sturtevant , Michael Buro

Efficient allocation is important in nature and human society, where individuals frequently compete for limited resources. The Minority Game (MG) is perhaps the simplest toy model to address this issue. However, most previous solutions…

Physics and Society · Physics 2026-02-04 Guozhong Zheng , Weiran Cai , Guanxiao Qi , Jiqiang Zhang , Li Chen

Decision-making under uncertainty (DMU) is present in many important problems. An open challenge is DMU in non-stationary environments, where the dynamics of the environment can change over time. Reinforcement Learning (RL), a popular…

Artificial Intelligence · Computer Science 2022-03-01 Geoffrey Pettet , Ayan Mukhopadhyay , Abhishek Dubey

Researchers have demonstrated that neural networks are vulnerable to adversarial examples and subtle environment changes, both of which one can view as a form of distribution shift. To humans, the resulting errors can look like blunders,…

Solving jigsaw puzzles requires to grasp the visual features of a sequence of patches and to explore efficiently a solution space that grows exponentially with the sequence length. Therefore, visual deep reinforcement learning (DRL) should…

Computer Vision and Pattern Recognition · Computer Science 2023-02-02 Marie-Morgane Paumard , Hedi Tabia , David Picard

We introduce an approach aimed at enhancing the reasoning capabilities of Large Language Models (LLMs) through an iterative preference learning process inspired by the successful strategy employed by AlphaZero. Our work leverages Monte…

Artificial Intelligence · Computer Science 2024-06-19 Yuxi Xie , Anirudh Goyal , Wenyue Zheng , Min-Yen Kan , Timothy P. Lillicrap , Kenji Kawaguchi , Michael Shieh

The real-time strategy game of StarCraft II has been posed as a challenge for reinforcement learning by Google's DeepMind. This study examines the use of an agent based on the Monte-Carlo Tree Search algorithm for optimizing the build order…

Machine Learning · Computer Science 2020-06-19 Islam Elnabarawy , Kristijana Arroyo , Donald C. Wunsch

In this work we study a well-known and challenging problem of Multi-agent Pathfinding, when a set of agents is confined to a graph, each agent is assigned a unique start and goal vertices and the task is to find a set of collision-free…

Artificial Intelligence · Computer Science 2023-07-26 Yelisey Pitanov , Alexey Skrynnik , Anton Andreychuk , Konstantin Yakovlev , Aleksandr Panov

We propose Monte Carlo Permutation Search (MCPS), a general-purpose Monte Carlo Tree Search (MCTS) algorithm that improves upon the GRAVE algorithm. MCPS is relevant when deep reinforcement learning is not an option or when the computing…

Machine Learning · Computer Science 2026-05-27 Tristan Cazenave

Mean Field Games (MFGs) have been introduced to efficiently approximate games with very large populations of strategic agents. Recently, the question of learning equilibria in MFGs has gained momentum, particularly using model-free…

In reinforcement learning (RL), the term self-play describes a kind of multi-agent learning (MAL) that deploys an algorithm against copies of itself to test compatibility in various stochastic environments. As is typical in MAL, the…

Computer Science and Game Theory · Computer Science 2021-07-08 Anthony DiGiovanni , Ethan C. Zell

We present a generative optimization approach for learning game-playing agents, where policies are represented as Python programs and refined using large language models (LLMs). Our method treats decision-making policies as self-evolving…

Machine Learning · Computer Science 2025-08-28 Zhiyi Kuang , Ryan Rong , YuCheng Yuan , Allen Nie

Monte Carlo Tree Search (MCTS) is a powerful algorithm for solving complex decision-making problems. This paper presents an optimized MCTS implementation applied to the FrozenLake environment, a classic reinforcement learning task…

Artificial Intelligence · Computer Science 2024-09-26 Esteban Aldana Guerra

Gradient-based methods are often used for policy optimization in deep reinforcement learning, despite being vulnerable to local optima and saddle points. Although gradient-free methods (e.g., genetic algorithms or evolution strategies) help…

Machine Learning · Computer Science 2019-12-24 Xiaobai Ma , Katherine Driggs-Campbell , Zongzhang Zhang , Mykel J. Kochenderfer