English
Related papers

Related papers: Bootstrapping Monte Carlo Tree Search with an Impe…

200 papers

Suppose a target is hidden in one of the vertices of an edge-weighted graph according to a known probability distribution. The expanding search problem asks for a search sequence of the vertices so as to minimize the expected time for…

Discrete Mathematics · Computer Science 2019-11-21 Ben Hermans , Roel Leus , Jannik Matuschke

Reinforcement learning has achieved remarkable success in perfect information games such as Go and Atari, enabling agents to compete at the highest levels against human players. However, research in reinforcement learning for imperfect…

Machine Learning · Computer Science 2024-10-24 Jiamian Li

In manufacturing, the production is often done on out-of-the-shelf manufacturing lines, whose underlying scheduling heuristics are not known due to the intellectual property. We consider such a setting with a black-box job-shop system and…

Artificial Intelligence · Computer Science 2022-12-16 Florian Wimmenauer , Matúš Mihalák , Mark H. M. Winands

There has been a lot of recent work on Bayesian methods for reinforcement learning exhibiting near-optimal online performance. The main obstacle facing such methods is that in most problems of interest, the optimal solution involves…

Machine Learning · Computer Science 2009-12-31 Christos Dimitrakakis

Decision-making under uncertainty (DMU) is present in many important problems. An open challenge is DMU in non-stationary environments, where the dynamics of the environment can change over time. Reinforcement Learning (RL), a popular…

Artificial Intelligence · Computer Science 2022-03-01 Geoffrey Pettet , Ayan Mukhopadhyay , Abhishek Dubey

The problem of {\em efficiently} finding the best match for a query in a given set with respect to the Euclidean distance or the cosine similarity has been extensively studied in literature. However, a closely related problem of efficiently…

Computational Geometry · Computer Science 2021-06-24 Parikshit Ram , Alexander G. Gray

Legged robots are able to navigate complex terrains by continuously interacting with the environment through careful selection of contact sequences and timings. However, the combinatorial nature behind contact planning hinders the…

Much current research in AI and games is being devoted to Monte Carlo search (MCS) algorithms. While the quest for a single unified MCS algorithm that would perform well on all problems is of major interest for AI, practitioners often know…

Artificial Intelligence · Computer Science 2015-03-20 Francis Maes , David Lupien St-Pierre , Damien Ernst

Inference-time scaling strategies, particularly Monte Carlo Tree Search (MCTS), have significantly enhanced the reasoning capabilities of Large Language Models (LLMs). However, current approaches remain predominantly stateless, discarding…

Artificial Intelligence · Computer Science 2026-02-05 Hao Lu , Haoyuan Huang , Yulin Zhou , Chen Li , Ningxin Zhu

This paper investigates the optimal signal detection problem with a particular interest in large-scale multiple-input multiple-output (MIMO) systems. The problem is NP-hard and can be solved optimally by searching the shortest path on the…

Machine Learning · Computer Science 2022-03-22 Le He , Ke He , Lisheng Fan , Xianfu Lei , Arumugam Nallanathan , George K. Karagiannidis

Monte Carlo Tree Search (MCTS) is a widely used approach for policy improvement through search with increasing popularity for real world applications. Due to the sequential and deterministic nature of its search, runtime-scaling of MCTS…

Machine Learning · Computer Science 2026-05-22 Yaniv Oren , Viliam Vadocz , Joery A. de Vries , Wendelin Böhmer , Matthijs T. J. Spaan , Hendrik Baier

Automated vehicles require the ability to cooperate with humans for smooth integration into today's traffic. While the concept of cooperation is well known, developing a robust and efficient cooperative trajectory planning method is still a…

Multiagent Systems · Computer Science 2022-11-15 Philipp Stegmaier , Karl Kurzer , J. Marius Zöllner

The Upper Confidence Bounds For Trees (UCT) algorithm is not agnostic to the reward scale of the game it is applied to. For zero-sum games with the sparse rewards of $\{-1,0,1\}$ at the end of the game, this is not a problem, but many games…

Artificial Intelligence · Computer Science 2025-10-27 Robin Schmöcker , Christoph Schnell , Alexander Dockhorn

This work presents a fully integrated tree-based combined exploration-planning algorithm: Exploration-RRT (ERRT). The algorithm is focused on providing real-time solutions for local exploration in a fully unknown and unstructured…

Robotics · Computer Science 2024-07-08 Björn Lindqvist , Akash Patel , Kalle Löfgren , George Nikolakopoulos

Monte-Carlo Tree Search (MCTS) is one of the most-widely used methods for planning, and has powered many recent advances in artificial intelligence. In MCTS, one typically performs computations (i.e., simulations) to collect statistics…

Artificial Intelligence · Computer Science 2020-11-20 Eren Sezener , Peter Dayan

In this work we study a well-known and challenging problem of Multi-agent Pathfinding, when a set of agents is confined to a graph, each agent is assigned a unique start and goal vertices and the task is to find a set of collision-free…

Artificial Intelligence · Computer Science 2023-07-26 Yelisey Pitanov , Alexey Skrynnik , Anton Andreychuk , Konstantin Yakovlev , Aleksandr Panov

Adaptively Informed Trees (AIT*) is an algorithm that uses the problem-specific heuristic to avoid unnecessary searches, which significantly improves its performance, especially when collision checking is expensive. However, the heuristic…

Robotics · Computer Science 2023-05-26 Chenming Li , Han Ma , Peng Xu , Jiankun Wang , Max Q. -H. Meng

In many risk-aware and multi-objective reinforcement learning settings, the utility of the user is derived from a single execution of a policy. In these settings, making decisions based on the average future returns is not suitable. For…

Artificial Intelligence · Computer Science 2022-12-07 Conor F. Hayes , Mathieu Reymond , Diederik M. Roijers , Enda Howley , Patrick Mannion

Monte-Carlo tree search (MCTS) has driven many recent breakthroughs in deep reinforcement learning (RL). However, scaling MCTS to parallel compute has proven challenging in practice which has motivated alternative planners like sequential…

Machine Learning · Computer Science 2025-07-09 Joery A. de Vries , Jinke He , Yaniv Oren , Matthijs T. J. Spaan

We consider the problem of constructing an an optimal-weight tree from the 3*(n choose 4) weighted quartet topologies on n objects, where optimality means that the summed weight of the embedded quartet topologiesis optimal (so it can be the…

Data Structures and Algorithms · Computer Science 2011-11-09 Rudi Cilibrasi , Paul M. B. Vitanyi