English
Related papers

Related papers: Towards High Efficient Long-horizon Planning with …

200 papers

Monte Carlo Tree Search (MCTS) is a powerful approach to designing game-playing bots or solving sequential decision problems. The method relies on intelligent tree search that balances exploration and exploitation. MCTS performs random…

Artificial Intelligence · Computer Science 2023-04-04 Maciej Świechowski , Konrad Godlewski , Bartosz Sawicki , Jacek Mańdziuk

In this paper we propose a novel reinforcement learning based model for sequence tagging, referred to as MM-Tag. Inspired by the success and methodology of the AlphaGo Zero, MM-Tag formalizes the problem of sequence tagging with a Monte…

Computation and Language · Computer Science 2018-05-21 Yadi Lao , Jun Xu , Yanyan Lan , Jiafeng Guo , Sheng Gao , Xueqi Cheng

Probabilistic search algorithms, such as Monte Carlo Tree Search (MCTS), have proven very effective in solving sequential decision-making tasks under uncertainty. However, interpreting asymmetric search trees that incorporate bandit-based…

Human-Computer Interaction · Computer Science 2026-05-21 Siqi Lu , Mirsaleh Bahavarnia , Hiba Baroud , Yixuan Zhang , Hemant Purohit , Ayan Mukhopadhyay

Motion Planning is necessary for robots to complete different tasks. Rapidly-exploring Random Tree (RRT) and its variants have been widely used in robot motion planning due to their fast search in state space. However, they perform not well…

Robotics · Computer Science 2022-05-19 Zhirui Sun , Jiankun Wang , Max Q. -H. Meng

While modern biotechnologies allow synthesizing new proteins and function measurements at scale, efficiently exploring a protein sequence space and engineering it remains a daunting task due to the vast sequence space of any given protein.…

Biomolecules · Quantitative Biology 2024-01-15 Jiahao Qiu , Hui Yuan , Jinghong Zhang , Wentao Chen , Huazheng Wang , Mengdi Wang

We study how to efficiently combine formal methods, Monte Carlo Tree Search (MCTS), and deep learning in order to produce high-quality receding horizon policies in large Markov Decision processes (MDPs). In particular, we use model-checking…

Artificial Intelligence · Computer Science 2023-08-16 Debraj Chakraborty , Damien Busatto-Gaston , Jean-François Raskin , Guillermo A. Pérez

Levin Tree Search (LTS) (Orseau et al., 2018) is a search algorithm for deterministic environments that uses a user-specified policy to guide the search. It comes with a formal guarantee on the number of search steps (node visits) for…

Artificial Intelligence · Computer Science 2025-03-12 Laurent Orseau , Marcus Hutter , Levi H. S. Lelis

With the aim of improving performance in Markov Decision Problem in an Off-Policy setting, we suggest taking inspiration from what is done in Offline Reinforcement Learning (RL). In Offline RL, it is a common practice during policy learning…

Artificial Intelligence · Computer Science 2024-10-29 Jérôme Arjonilla , Abdallah Saffidine , Tristan Cazenave

Robots have become increasingly prevalent in dynamic and crowded environments such as airports and shopping malls. In these scenarios, the critical challenges for robot navigation are reliability and timely arrival at predetermined…

Robotics · Computer Science 2023-09-21 Zhirui Sun , Boshu Lei , Peijia Xie , Fugang Liu , Junjie Gao , Ying Zhang , Jiankun Wang

Testing and evaluation is an important step before the large-scale application of the autonomous driving systems (ADSs). Based on the three level of scenario abstraction theory, a testing can be performed within a logical scenario, followed…

Artificial Intelligence · Computer Science 2025-10-24 Xinzheng Wu , Junyi Chen , Jianfeng Wu , Longgao Zhang , Tian Xia , Yong Shen

Monte Carlo Tree Search (MCTS), most famously used in game-play artificial intelligence (e.g., the game of Go), is a well-known strategy for constructing approximate solutions to sequential decision problems. Its primary innovation is the…

Optimization and Control · Mathematics 2017-04-21 Daniel R. Jiang , Lina Al-Kanj , Warren B. Powell

Planning under resource constraints is central to real-world decision making, yet most large language model (LLM) planners assume uniform action costs. We systematically analyze whether tree-search LLM planners are cost-aware and whether…

Artificial Intelligence · Computer Science 2026-01-13 Zihao Zhang , Hui Wei , Kenan Jiang , Shijia Pan , Shu Kai , Fei Liu

Autonomous agents powered by language models (LMs) have demonstrated promise in their ability to perform decision-making tasks such as web automation. However, a key limitation remains: LMs, primarily optimized for natural language…

Artificial Intelligence · Computer Science 2026-02-10 Jing Yu Koh , Stephen McAleer , Daniel Fried , Ruslan Salakhutdinov

Recent research works establish deep neural networks as high performing tools for radar target detection, especially on challenging environments (presence of clutter or interferences, multi-target scenarii...). However, the usually large…

Signal Processing · Electrical Eng. & Systems 2025-06-30 Noé Lallouet , Tristan Cazenave , Cyrille Enderli , Stéphanie Gourdin

We present an extension of Monte Carlo Tree Search (MCTS) that strongly increases its efficiency for trees with asymmetry and/or loops. Asymmetric termination of search trees introduces a type of uncertainty for which the standard upper…

Machine Learning · Statistics 2018-05-24 Thomas M. Moerland , Joost Broekens , Aske Plaat , Catholijn M. Jonker

For UAV-aided wireless systems, online path planning attracts much attention recently. To better adapt to the real-time dynamic environment, we, for the first time, propose a Monte Carlo Tree Search (MCTS)-based path planning scheme. In…

Networking and Internet Architecture · Computer Science 2022-02-08 Yuwen Qian , Kexin Sheng , Chuan Ma , Jun Li , Ming Ding , Mahbub Hassan

Sequential decision-making under uncertainty is present in many important problems. Two popular approaches for tackling such problems are reinforcement learning and online search (e.g., Monte Carlo tree search). While the former learns a…

Artificial Intelligence · Computer Science 2024-01-23 Ava Pettet , Yunuo Zhang , Baiting Luo , Kyle Wray , Hendrik Baier , Aron Laszka , Abhishek Dubey , Ayan Mukhopadhyay

Evolutionary multi-task optimization (EMTO) is an advanced optimization paradigm that improves search efficiency by enabling knowledge transfer across multiple tasks solved in parallel. Accordingly, a broad range of knowledge transfer…

Neural and Evolutionary Computing · Computer Science 2026-04-01 Xuebin Lyu , Yuxiao Huang , XueFeng Chen , Jing Tang , Liang Feng , Kay Chen Tan

Monte Carlo Tree Search (MCTS) has emerged as a powerful tool for decision-making in robotics, enabling efficient exploration of large search spaces. However, traditional MCTS methods struggle in environments characterized by high…

Robotics · Computer Science 2025-03-10 Xibai Wang

Monte Carlo Tree Search (MCTS) has profoundly influenced reinforcement learning (RL) by integrating planning and learning in tasks requiring long-horizon reasoning, exemplified by the AlphaZero family of algorithms. Central to MCTS is the…

Machine Learning · Computer Science 2026-04-28 Maximilian Weichart