English
Related papers

Related papers: MALinZero: Efficient Low-Dimensional Search for Ma…

200 papers

Monte Carlo Tree Search (MCTS) methods have achieved great success in many Artificial Intelligence (AI) benchmarks. The in-tree operations become a critical performance bottleneck in realizing parallel MCTS on CPUs. In this work, we develop…

Distributed, Parallel, and Cluster Computing · Computer Science 2022-08-25 Yuan Meng , Rajgopal Kannan , Viktor Prasanna

We propose a provably correct Monte Carlo tree search (MCTS) algorithm for solving risk-aware Markov decision processes (MDPs) with entropic risk measure (ERM) objectives. We provide a non-asymptotic analysis of our proposed algorithm,…

Machine Learning · Computer Science 2026-02-06 Pedro P. Santos , Jacopo Silvestrin , Alberto Sardinha , Francisco S. Melo

Monte-Carlo tree search (MCTS) has driven many recent breakthroughs in deep reinforcement learning (RL). However, scaling MCTS to parallel compute has proven challenging in practice which has motivated alternative planners like sequential…

Machine Learning · Computer Science 2025-07-09 Joery A. de Vries , Jinke He , Yaniv Oren , Matthijs T. J. Spaan

Monte Carlo Tree Search is a popular method for solving decision making problems. Faster implementations allow for more simulations within the same wall clock time, directly improving search performance. To this end, we present an…

Artificial Intelligence · Computer Science 2025-08-29 James Ragan , Fred Y. Hadaegh , Soon-Jo Chung

The uncertainty of distributed renewable energy brings significant challenges to economic operation of microgrids. Conventional online optimization approaches require a forecast model. However, accurately forecasting the renewable power…

Systems and Control · Electrical Eng. & Systems 2021-05-31 Hang Shuai , Haibo He

The UCT algorithm, which combines the UCB algorithm and Monte-Carlo Tree Search (MCTS), is currently the most widely used variant of MCTS. Recently, a number of investigations into applying other bandit algorithms to MCTS have produced…

Artificial Intelligence · Computer Science 2015-05-13 Yun-Ching Liu , Yoshimasa Tsuruoka

Learning and planning with latent space dynamics has been shown to be useful for sample efficiency in model-based reinforcement learning (MBRL) for discrete and continuous control tasks. In particular, recent work, for discrete action…

Machine Learning · Computer Science 2020-10-21 Anurag Koul , Varun V. Kumar , Alan Fern , Somdeb Majumdar

Industries frequently adjust their facilities network by opening new branches in promising areas and closing branches in areas where they expect low profits. In this paper, we examine a particular class of facility location problems. Our…

Artificial Intelligence · Computer Science 2024-03-18 Saeid Amiri , Parisa Zehtabi , Danial Dervovic , Michael Cashmore

This paper presents the Constrained Multi-Task Representation Learning (CMTRL) framework for linear bandits. We consider T linear bandit tasks in a d dimensional space, which share a common low-dimensional representation of dimension r,…

Machine Learning · Computer Science 2026-05-13 Jiabin Lin , Shana Moothedath

Bayesian optimization (BO) is a popular method for computationally expensive black-box optimization. However, traditional BO methods need to solve new problems from scratch, leading to slow convergence. Recent studies try to extend BO to a…

Machine Learning · Computer Science 2024-12-11 Shukuan Wang , Ke Xue , Lei Song , Xiaobin Huang , Chao Qian

We propose a novel method applicable in many scene understanding problems that adapts the Monte Carlo Tree Search (MCTS) algorithm, originally designed to learn to play games of high-state complexity. From a generated pool of proposals, our…

Computer Vision and Pattern Recognition · Computer Science 2022-07-08 Sinisa Stekovic , Mahdi Rad , Alireza Moradi , Friedrich Fraundorfer , Vincent Lepetit

Planning problems are among the most important and well-studied problems in artificial intelligence. They are most typically solved by tree search algorithms that simulate ahead into the future, evaluate future states, and back-up those…

Artificial Intelligence · Computer Science 2018-07-18 Arthur Guez , Théophane Weber , Ioannis Antonoglou , Karen Simonyan , Oriol Vinyals , Daan Wierstra , Rémi Munos , David Silver

In this paper, we introduce ObjectZero, a novel reinforcement learning (RL) algorithm that leverages the power of object-level representations to model dynamic environments more effectively. Unlike traditional approaches that process the…

Artificial Intelligence · Computer Science 2026-01-13 Rodion Vakhitov , Leonid Ugadiarov , Aleksandr Panov

Model-based reinforcement learning (RL) methods that leverage search are responsible for many milestone breakthroughs in RL. Sequential Monte Carlo (SMC) recently emerged as an alternative to the Monte Carlo Tree Search (MCTS) algorithm…

Machine Learning · Computer Science 2026-05-22 Yaniv Oren , Joery A. de Vries , Pascal R. van der Vaart , Matthijs T. J. Spaan , Wendelin Böhmer

We examine a type of modified Monte Carlo Tree Search (MCTS) for strategising in combinatorial games. The modifications are derived by analysing simplified strategies and simplified versions of the underlying game and then using the results…

Computer Science and Game Theory · Computer Science 2025-01-14 Michael Haythorpe , Alex Newcombe , Damian O'Dea

To lower the expertise barrier in machine learning, the AutoML community has focused on the CASH problem, which jointly automates algorithm selection and hyperparameter tuning. While traditional methods like Bayesian Optimization (BO)…

Machine Learning · Computer Science 2026-05-08 Beicheng Xu , Weitong Qian , Lingching Tung , Yupeng Lu , Bin Cui

Recently, the seminal algorithms AlphaGo and AlphaZero have started a new era in game learning and deep reinforcement learning. While the achievements of AlphaGo and AlphaZero - playing Go and other complex games at super human level - are…

Machine Learning · Computer Science 2022-09-27 Johannes Scheiermann , Wolfgang Konen

One of the most important AI research questions is to trade off computation versus performance since ``perfect rationality" exists in theory but is impossible to achieve in practice. Recently, Monte-Carlo tree search (MCTS) has attracted…

Artificial Intelligence · Computer Science 2022-10-25 Weirui Ye , Pieter Abbeel , Yang Gao

We present a self-improving, Neural Tree Expansion (NTE) method for multi-robot online planning in non-cooperative environments, where each robot attempts to maximize its cumulative reward while interacting with other self-interested…

Robotics · Computer Science 2021-07-12 Benjamin Riviere , Wolfgang Hoenig , Matthew Anderson , Soon-Jo Chung

Monte Carlo tree search (MCTS) is a popular choice for solving sequential anytime problems. However, it depends on a numeric feedback signal, which can be difficult to define. Real-time MCTS is a variant which may only rarely encounter…

Artificial Intelligence · Computer Science 2018-09-20 Tobias Joppen , Christian Wirth , Johannes Fürnkranz