English
Related papers

Related papers: Accelerating Monte-Carlo Tree Search with Optimize…

200 papers

A simple and natural algorithm for reinforcement learning (RL) is Monte Carlo Exploring Starts (MCES), where the Q-function is estimated by averaging the Monte Carlo returns, and the policy is improved by choosing actions that maximize the…

Machine Learning · Computer Science 2022-08-08 Che Wang , Shuhan Yuan , Kai Shao , Keith Ross

Monte Carlo Tree Search (MCTS), which leverages Upper Confidence Bound for Trees (UCTs) to balance exploration and exploitation through randomized sampling, is instrumental to solving complex planning problems. However, for multi-agent…

Artificial Intelligence · Computer Science 2025-11-11 Sizhe Tang , Jiayu Chen , Tian Lan

In the world of embedded systems, optimizing actions with the uncertain costs of multiple resources is a complex challenge. Existing methods include plan building based on Monte Carlo Tree Search (MCTS), an approach that thrives in multiple…

Systems and Control · Electrical Eng. & Systems 2024-07-18 Franco Cordeiro , Samuel Tardieu , Laurent Pautet

Recent advances in reasoning with large language models (LLMs) have shown the effectiveness of Monte Carlo Tree Search (MCTS) for generating high quality intermediate trajectories, particularly in math and symbolic domains. Inspired by…

Artificial Intelligence · Computer Science 2025-12-23 Bingning Huang , Tu Nguyen , Matthieu Zimmer

This study investigates the combined use of generative grammar rules and Monte Carlo Tree Search (MCTS) for optimizing truss structures. Our approach accommodates intermediate construction stages characteristic of progressive construction…

Computational Engineering, Finance, and Science · Computer Science 2025-04-03 Gabriel Garayalde , Luca Rosafalco , Matteo Torzoni , Alberto Corigliano

Sequential decision-making under uncertainty is present in many important problems. Two popular approaches for tackling such problems are reinforcement learning and online search (e.g., Monte Carlo tree search). While the former learns a…

Artificial Intelligence · Computer Science 2024-01-23 Ava Pettet , Yunuo Zhang , Baiting Luo , Kyle Wray , Hendrik Baier , Aron Laszka , Abhishek Dubey , Ayan Mukhopadhyay

Bandit based methods for tree search have recently gained popularity when applied to huge trees, e.g. in the game of go (Gelly et al., 2006). The UCT algorithm (Kocsis and Szepesvari, 2006), a tree search method based on Upper Confidence…

Machine Learning · Computer Science 2016-08-14 Pierre-Arnaud Coquelin , Rémi Munos

This work investigates Monte-Carlo planning for agents in stochastic environments, with multiple objectives. We propose the Convex Hull Monte-Carlo Tree-Search (CHMCTS) framework, which builds upon Trial Based Heuristic Tree Search and…

Artificial Intelligence · Computer Science 2020-03-24 Michael Painter , Bruno Lacerda , Nick Hawes

In this paper we propose a novel reinforcement learning based model for sequence tagging, referred to as MM-Tag. Inspired by the success and methodology of the AlphaGo Zero, MM-Tag formalizes the problem of sequence tagging with a Monte…

Computation and Language · Computer Science 2018-05-21 Yadi Lao , Jun Xu , Yanyan Lan , Jiafeng Guo , Sheng Gao , Xueqi Cheng

Bayes-optimal behavior, while well-defined, is often difficult to achieve. Recent advances in the use of Monte-Carlo tree search (MCTS) have shown that it is possible to act near-optimally in Markov Decision Processes (MDPs) with very large…

Artificial Intelligence · Computer Science 2012-02-20 John Asmuth , Michael L. Littman

In this paper we explore the application of simultaneous move Monte Carlo Tree Search (MCTS) based online framework for tactical maneuvering between two unmanned aircrafts. Compared to other techniques, MCTS enables efficient search over…

Artificial Intelligence · Computer Science 2020-09-21 Kunal Srivastava , Amit Surana

Dynamic job shop scheduling, a fundamental combinatorial optimisation problem in various industrial sectors, poses substantial challenges for effective scheduling due to frequent disruptions caused by the arrival of new jobs.…

Artificial Intelligence · Computer Science 2025-09-29 Ruiqi Chen , Yi Mei , Fangfang Zhang , Mengjie Zhang

We present a new Monte Carlo Tree Search (MCTS) algorithm to solve the stochastic orienteering problem with chance constraints, i.e., a version of the problem where travel costs are random, and one is assigned a bound on the tolerable…

Robotics · Computer Science 2024-09-06 Stefano Carpin

In many problem settings, most notably in game playing, an agent receives a possibly delayed reward for its actions. Often, those rewards are handcrafted and not naturally given. Even simple terminal-only rewards, like winning equals one…

Artificial Intelligence · Computer Science 2021-01-27 Tobias Joppen , Johannes Fürnkranz

Large Language Models (LLMs) harness extensive data from the Internet, storing a broad spectrum of prior knowledge. While LLMs have proven beneficial as decision-making aids, their reliability is hampered by limitations in reasoning,…

Artificial Intelligence · Computer Science 2024-03-12 Hongyi Guo , Zhihan Liu , Yufeng Zhang , Zhaoran Wang

Autonomous mobile robots enable increased flexibility of manufacturing systems. The design and operating strategy of such a fleet of robots requires careful consideration of both fixed and operational costs. In this paper, a Monte-Carlo…

Systems and Control · Electrical Eng. & Systems 2024-03-05 T. M. J. T. Baltussen , M. Goutham , M. Menon , S. G. Garrow , M. Santillo , S. Stockar

Recently, the seminal algorithms AlphaGo and AlphaZero have started a new era in game learning and deep reinforcement learning. While the achievements of AlphaGo and AlphaZero - playing Go and other complex games at super human level - are…

Machine Learning · Computer Science 2022-09-27 Johannes Scheiermann , Wolfgang Konen

To reduce global carbon emissions and limit climate change, controlling energy consumption in buildings is an important piece of the puzzle. Here, we specifically focus on using a demand response (DR) algorithm to limit the energy…

Systems and Control · Electrical Eng. & Systems 2024-05-22 Fabio Pavirani , Gargya Gokhale , Bert Claessens , Chris Develder

The uncertainty of distributed renewable energy brings significant challenges to economic operation of microgrids. Conventional online optimization approaches require a forecast model. However, accurately forecasting the renewable power…

Systems and Control · Electrical Eng. & Systems 2021-05-31 Hang Shuai , Haibo He

Monte Carlo Tree Search (MCTS) has proven to be capable of solving challenging tasks in domains such as Go, chess and Atari. Previous research has developed parallel versions of MCTS, exploiting today's multiprocessing architectures. These…

Machine Learning · Computer Science 2020-04-01 Karl Kurzer , Christoph Hörtnagl , J. Marius Zöllner