English
Related papers

Related papers: An AlphaZero-Inspired Approach to Solving Search P…

200 papers

Since AlphaGo and AlphaGo Zero have achieved breakground successes in the game of Go, the programs have been generalized to solve other tasks. Subsequently, AlphaZero was developed to play Go, Chess and Shogi. In the literature, the…

Machine Learning · Computer Science 2019-03-20 Hui Wang , Michael Emmerich , Mike Preuss , Aske Plaat

In 2019, Google DeepMind released MuZero, a model-based reinforcement learning method that achieves strong results in perfect-information games by combining learned dynamics models with Monte Carlo Tree Search (MCTS). However, comparatively…

Artificial Intelligence · Computer Science 2026-03-31 Adam Haile

Much current research in AI and games is being devoted to Monte Carlo search (MCS) algorithms. While the quest for a single unified MCS algorithm that would perform well on all problems is of major interest for AI, practitioners often know…

Artificial Intelligence · Computer Science 2015-03-20 Francis Maes , David Lupien St-Pierre , Damien Ernst

Learning predictive world models is crucial for enhancing the planning capabilities of reinforcement learning (RL) agents. Recently, MuZero-style algorithms, leveraging the value equivalence principle and Monte Carlo Tree Search (MCTS),…

Machine Learning · Computer Science 2025-01-06 Yuan Pu , Yazhe Niu , Zhenjie Yang , Jiyuan Ren , Hongsheng Li , Yu Liu

Self-play has enabled large language models to autonomously improve through self-generated challenges. However, existing self-play methods for vision-language models rely on passive interaction with static image collections, resulting in…

Computer Vision and Pattern Recognition · Computer Science 2026-02-13 Jinghan He , Junfeng Fang , Feng Xiong , Zijun Yao , Fei Shen , Haiyun Guo , Jinqiao Wang , Tat-Seng Chua

Reinforcement learning has recently been used to approach well-known NP-hard combinatorial problems in graph theory. Among these problems, Hamiltonian cycle problems are exceptionally difficult to analyze, even when restricted to individual…

Artificial Intelligence · Computer Science 2022-11-18 Kevin Du , Ian Gemp , Yi Wu , Yingying Wu

Monte Carlo Tree Search (MCTS) algorithms such as AlphaGo and MuZero have achieved superhuman performance in many challenging tasks. However, the computational complexity of MCTS-based algorithms is influenced by the size of the search…

Artificial Intelligence · Computer Science 2023-10-11 Yangqing Fu , Ming Sun , Buqing Nie , Yue Gao

The recently released AlphaZero algorithm achieves superhuman performance in the games of chess, shogi and Go, which raises two open questions. Firstly, as there is a finite number of possibilities in the game, is there a quantifiable…

Artificial Intelligence · Computer Science 2018-12-18 Bo Zhang , Bin Chen , Jin-lin Peng

Improving the decision-making capabilities of agents is a key challenge on the road to artificial intelligence. To improve the planning skills needed to make good decisions, MuZero's agent combines prediction by a network model and planning…

Artificial Intelligence · Computer Science 2023-06-07 Matthias Unverzagt

Test-time reasoning significantly enhances pre-trained AI agents' performance. However, it requires an explicit environment model, often unavailable or overly complex in real-world scenarios. While MuZero enables effective model learning…

Artificial Intelligence · Computer Science 2025-10-07 Ondřej Kubíček , Viliam Lisý

Large-scale AI systems that combine search and learning have reached super-human levels of performance in game-playing, but have also been shown to fail in surprising ways. The brittleness of such models limits their efficacy and…

Artificial Intelligence · Computer Science 2023-02-07 Niko A. Grupen , Michael Hanlon , Alexis Hao , Daniel D. Lee , Bart Selman

To this day, a variety of approaches for providing local interpretability of black-box machine learning models have been introduced. Unfortunately, all of these methods suffer from one or more of the following deficiencies: They are either…

Machine Learning · Computer Science 2022-03-08 Yiran Huang , Nicole Schaal , Michael Hefenbrock , Yexu Zhou , Till Riedel , Likun Fang , Michael Beigl

With large chess-playing neural network models like AlphaZero contesting the state of the art within the world of computerised chess, two challenges present themselves: The question of how to explain the domain knowledge internalised by…

Machine Learning · Computer Science 2023-09-19 Patrik Hammersborg , Inga Strümke

Monte Carlo Tree Search (MCTS) scales poorly in cooperative multi-agent domains because expansion must consider an exponentially large set of joint actions, severely limiting exploration under realistic search budgets. We propose NonZero,…

Machine Learning · Computer Science 2026-05-04 Sizhe Tang , Zuyuan Zhang , Mahdi Imani , Tian Lan

Card game AI has always been a hot topic in the research of artificial intelligence. In recent years, complex card games such as Mahjong, DouDizhu and Texas Hold'em have been solved and the corresponding AI programs have reached the level…

Artificial Intelligence · Computer Science 2022-11-01 Yudong Lu , Jian Zhao , Youpeng Zhao , Wengang Zhou , Houqiang Li

The AlphaGo, AlphaGo Zero, and AlphaZero series of algorithms are remarkable demonstrations of deep reinforcement learning's capabilities, achieving superhuman performance in the complex game of Go with progressively increasing autonomy.…

Artificial Intelligence · Computer Science 2022-06-06 Yuandong Tian , Jerry Ma , Qucheng Gong , Shubho Sengupta , Zhuoyuan Chen , James Pinkerton , C. Lawrence Zitnick

We present TransZero, a model-based reinforcement learning algorithm that removes the sequential bottleneck in Monte Carlo Tree Search (MCTS). Unlike MuZero, which constructs its search tree step by step using a recurrent dynamics model,…

Machine Learning · Computer Science 2025-09-16 Emil Malmsten , Wendelin Böhmer

As artificial intelligence becomes increasingly intelligent---in some cases, achieving superhuman performance---there is growing potential for humans to learn from and collaborate with algorithms. However, the ways in which AI systems…

Artificial Intelligence · Computer Science 2020-07-15 Reid McIlroy-Young , Siddhartha Sen , Jon Kleinberg , Ashton Anderson

Recent progress in reinforcement learning (RL) using self-game-play has shown remarkable performance on several board games (e.g., Chess and Go) as well as video games (e.g., Atari games and Dota2). It is plausible to consider that RL,…

Artificial Intelligence · Computer Science 2019-05-10 Ruiyang Xu , Karl Lieberherr

The construction of approximate replication strategies for pricing and hedging of derivative contracts in incomplete markets is a key problem of financial engineering. Recently Reinforcement Learning algorithms for hedging under realistic…

Artificial Intelligence · Computer Science 2023-11-02 Oleg Szehr