English
Related papers

Related papers: Enhancing the Monte Carlo Tree Search Algorithm fo…

200 papers

This work investigates Monte-Carlo planning for agents in stochastic environments, with multiple objectives. We propose the Convex Hull Monte-Carlo Tree-Search (CHMCTS) framework, which builds upon Trial Based Heuristic Tree Search and…

Artificial Intelligence · Computer Science 2020-03-24 Michael Painter , Bruno Lacerda , Nick Hawes

We study how to efficiently combine formal methods, Monte Carlo Tree Search (MCTS), and deep learning in order to produce high-quality receding horizon policies in large Markov Decision processes (MDPs). In particular, we use model-checking…

Artificial Intelligence · Computer Science 2023-08-16 Debraj Chakraborty , Damien Busatto-Gaston , Jean-François Raskin , Guillermo A. Pérez

Models of intrinsic motivation present an important means to produce sensible behaviour in the absence of extrinsic rewards. Applications in video games are varied, and range from intrinsically motivated general game-playing agents to…

Artificial Intelligence · Computer Science 2018-03-28 Christoph Salge , Christian Guckelsberger , Rodrigo Canaan , Tobias Mahlmann

In the era of vast digital information, the sheer volume and heterogeneity of available information present significant challenges for intricate information seeking. Users frequently face multistep web search tasks that involve navigating…

Information Retrieval · Computer Science 2025-02-10 Ruiyang Ren , Yuhao Wang , Junyi Li , Jinhao Jiang , Wayne Xin Zhao , Wenjie Wang , Tat-Seng Chua

Decision-making under uncertainty (DMU) is present in many important problems. An open challenge is DMU in non-stationary environments, where the dynamics of the environment can change over time. Reinforcement Learning (RL), a popular…

Artificial Intelligence · Computer Science 2022-03-01 Geoffrey Pettet , Ayan Mukhopadhyay , Abhishek Dubey

Decentralized Monte Carlo Tree Search (Dec-MCTS) is widely used for cooperative multi-agent planning but struggles in sparse or skewed reward environments. We introduce Coordinated Boltzmann MCTS (CB-MCTS), which replaces deterministic UCT…

Multiagent Systems · Computer Science 2026-03-11 Nhat D. A. Nguyen , Duong D. Nguyen , Gianluca Rizzo , Hung X. Nguyen

A recent theoretical analysis of a Monte-Carlo tree search (MCTS) method properly modified from the ``upper confidence bound applied to trees" (UCT) algorithm established a surprising result, due to a great deal of empirical successes…

Optimization and Control · Mathematics 2025-02-04 Hyeong Soo Chang

We propose a provably correct Monte Carlo tree search (MCTS) algorithm for solving risk-aware Markov decision processes (MDPs) with entropic risk measure (ERM) objectives. We provide a non-asymptotic analysis of our proposed algorithm,…

Machine Learning · Computer Science 2026-02-06 Pedro P. Santos , Jacopo Silvestrin , Alberto Sardinha , Francisco S. Melo

The discovery of patterns that accurately discriminate one class label from another remains a challenging data mining task. Subgroup discovery (SD) is one of the frameworks that enables to elicit such interesting hypotheses from labeled…

Data Structures and Algorithms · Computer Science 2017-12-07 Guillaume Bosc , Jean-François Boulicaut , Chedy Raïssi , Mehdi Kaytoue

Handcrafting heuristics for solving complex optimization tasks (e.g., route planning and task allocation) is a common practice but requires extensive domain knowledge. Recently, Large Language Model (LLM)-based automatic heuristic design…

Artificial Intelligence · Computer Science 2025-02-03 Zhi Zheng , Zhuoliang Xie , Zhenkun Wang , Bryan Hooi

The diversity of agent behaviors is an important topic for the quality of video games and virtual environments in general. Offering the most compelling experience for users with different skills is a difficult task, and usually needs…

Artificial Intelligence · Computer Science 2019-09-11 Ciprian Paduraru , Miruna Paduraru

Monte Carlo Tree Search (MCTS) has profoundly influenced reinforcement learning (RL) by integrating planning and learning in tasks requiring long-horizon reasoning, exemplified by the AlphaZero family of algorithms. Central to MCTS is the…

Machine Learning · Computer Science 2026-04-28 Maximilian Weichart

This technical report documents the winner of the Computational Intelligence in Games(CIG) 2018 Hanabi competition. We introduce Re-determinizing IS-MCTS, a novel extension of Information Set Monte Carlo Tree Search (IS-MCTS) that prevents…

Artificial Intelligence · Computer Science 2019-05-16 James Goodman

Monte-Carlo tree search (MCTS) has driven many recent breakthroughs in deep reinforcement learning (RL). However, scaling MCTS to parallel compute has proven challenging in practice which has motivated alternative planners like sequential…

Machine Learning · Computer Science 2025-07-09 Joery A. de Vries , Jinke He , Yaniv Oren , Matthijs T. J. Spaan

The article presents research on the use of Monte-Carlo Tree Search (MCTS) methods to create an artificial player for the popular card game "The Lord of the Rings". The game is characterized by complicated rules, multi-stage round…

Machine Learning · Computer Science 2021-09-27 Konrad Godlewski , Bartosz Sawicki

Designing agents that are able to achieve different play-styles while maintaining a competitive level of play is a difficult task, especially for games for which the research community has not found super-human performance yet, like…

Artificial Intelligence · Computer Science 2021-06-29 Diego Perez-Liebana , Cristina Guerrero-Romero , Alexander Dockhorn , Linjie Xu , Jorge Hurtado , Dominik Jeurissen

Automated program repair with large language models remains challenging at the repository level due to long-horizon reasoning requirements and the limitations of autoregressive decoding. We present CodePilot, a hybrid framework that…

Machine Learning · Computer Science 2026-02-03 Yixuan Liang

Monte Carlo Tree Search (MCTS) has emerged as a powerful tool for decision-making in robotics, enabling efficient exploration of large search spaces. However, traditional MCTS methods struggle in environments characterized by high…

Robotics · Computer Science 2025-03-10 Xibai Wang

This paper introduces Monte Carlo *-Minimax Search (MCMS), a Monte Carlo search algorithm for turned-based, stochastic, two-player, zero-sum games of perfect information. The algorithm is designed for the class of of densely stochastic…

Computer Science and Game Theory · Computer Science 2013-04-23 Marc Lanctot , Abdallah Saffidine , Joel Veness , Christopher Archibald , Mark H. M. Winands

In many problem settings, most notably in game playing, an agent receives a possibly delayed reward for its actions. Often, those rewards are handcrafted and not naturally given. Even simple terminal-only rewards, like winning equals one…

Artificial Intelligence · Computer Science 2021-01-27 Tobias Joppen , Johannes Fürnkranz