English
Related papers

Related papers: Provably Efficient Long-Horizon Exploration in Mon…

200 papers

In this study, working with the task of object retrieval in clutter, we have developed a robot learning framework in which Monte Carlo Tree Search (MCTS) is first applied to enable a Deep Neural Network (DNN) to learn the intricate…

Robotics · Computer Science 2022-03-25 Baichuan Huang , Teng Guo , Abdeslam Boularias , Jingjin Yu

Despite its groundbreaking success in Go and computer games, Monte Carlo Tree Search (MCTS) is computationally expensive as it requires a substantial number of rollouts to construct the search tree, which calls for effective…

Machine Learning · Computer Science 2020-10-06 Anji Liu , Yitao Liang , Ji Liu , Guy Van den Broeck , Jianshu Chen

Monte Carlo Tree Search (MCTS) has improved the performance of game engines in domains such as Go, Hex, and general game playing. MCTS has been shown to outperform classic alpha-beta search in games where good heuristic evaluations are…

Artificial Intelligence · Computer Science 2014-06-23 Marc Lanctot , Mark H. M. Winands , Tom Pepels , Nathan R. Sturtevant

To reduce global carbon emissions and limit climate change, controlling energy consumption in buildings is an important piece of the puzzle. Here, we specifically focus on using a demand response (DR) algorithm to limit the energy…

Systems and Control · Electrical Eng. & Systems 2024-05-22 Fabio Pavirani , Gargya Gokhale , Bert Claessens , Chris Develder

Complex sequential decision-making planning problems, covering infinite states' space have been shown to be solvable by AlphaZero type of algorithms. Such an approach that trains a neural model while simulating projection of futures with a…

Artificial Intelligence · Computer Science 2024-08-13 Ronit Bustin , Claudia V. Goldman

In many applications of computer algebra large expressions must be simplified to make repeated numerical evaluations tractable. Previous works presented heuristically guided improvements, e.g., for Horner schemes. The remaining expression…

Artificial Intelligence · Computer Science 2013-12-04 Ben Ruijl , Jos Vermaseren , Aske Plaat , Jaap van den Herik

Monte Carlo tree search (MCTS) is a popular choice for solving sequential anytime problems. However, it depends on a numeric feedback signal, which can be difficult to define. Real-time MCTS is a variant which may only rarely encounter…

Artificial Intelligence · Computer Science 2018-09-20 Tobias Joppen , Christian Wirth , Johannes Fürnkranz

Monte Carlo Tree Search and Monte Carlo Search have good results for many combinatorial problems. In this paper we propose to use Monte Carlo Search to design mathematical expressions that are used as exploration terms for Monte Carlo Tree…

Artificial Intelligence · Computer Science 2024-04-16 Tristan Cazenave

This work presents the first study of using the popular Monte Carlo Tree Search (MCTS) method combined with dedicated heuristics for solving the Weighted Vertex Coloring Problem. Starting with the basic MCTS algorithm, we gradually…

Machine Learning · Computer Science 2022-04-08 Cyril Grelier , Olivier Goudet , Jin-Kao Hao

With the aim of improving performance in Markov Decision Problem in an Off-Policy setting, we suggest taking inspiration from what is done in Offline Reinforcement Learning (RL). In Offline RL, it is a common practice during policy learning…

Artificial Intelligence · Computer Science 2024-10-29 Jérôme Arjonilla , Abdallah Saffidine , Tristan Cazenave

Integrated task and motion planning (TAMP) is desirable for generalized autonomy robots but it is challenging at the same time. TAMP requires the planner to not only search in both the large symbolic task space and the high-dimension motion…

Robotics · Computer Science 2021-10-18 Tianyu Ren , Georgia Chalvatzaki , Jan Peters

In this work, we are dedicated to multi-target active object tracking (AOT), where there are multiple targets as well as multiple cameras in the environment. The goal is maximize the overall target coverage of all cameras. Previous work…

Computer Vision and Pattern Recognition · Computer Science 2022-05-10 Zheng Chen , Jian Zhao , Mingyu Yang , Wengang Zhou , Houqiang Li

The ability of a robot to plan complex behaviors with real-time computation, rather than adhering to predesigned or offline-learned routines, alleviates the need for specialized algorithms or training for each problem instance. Monte Carlo…

Robotics · Computer Science 2024-12-17 Benjamin Riviere , John Lathrop , Soon-Jo Chung

Much current research in AI and games is being devoted to Monte Carlo search (MCS) algorithms. While the quest for a single unified MCS algorithm that would perform well on all problems is of major interest for AI, practitioners often know…

Artificial Intelligence · Computer Science 2015-03-20 Francis Maes , David Lupien St-Pierre , Damien Ernst

Monte-Carlo planning, as exemplified by Monte-Carlo Tree Search (MCTS), has demonstrated remarkable performance in applications with finite spaces. In this paper, we consider Monte-Carlo planning in an environment with continuous…

Artificial Intelligence · Computer Science 2021-01-01 Weichao Mao , Kaiqing Zhang , Qiaomin Xie , Tamer Başar

In this study, we explore the efficiency of the Monte Carlo Tree Search (MCTS), a prominent decision-making algorithm renowned for its effectiveness in complex decision environments, contingent upon the volume of simulations conducted.…

Artificial Intelligence · Computer Science 2024-03-19 Ye Zhang , Mengran Zhu , Kailin Gui , Jiayue Yu , Yong Hao , Haozhan Sun

Large Language Models (LLMs) have empowered autonomous agents to handle complex web navigation tasks. While recent studies integrate tree search to enhance long-horizon reasoning, applying these algorithms in web navigation faces two…

Artificial Intelligence · Computer Science 2026-02-17 Weiming Zhang , Jihong Wang , Jiamu Zhou , Qingyao Li , Xinbei Ma , Congmin Zheng , Xingyu Lou , Weiwen Liu , Zhuosheng Zhang , Jun Wang , Yong Yu , Weinan Zhang

Automatic Heuristic Design (AHD) is an effective framework for solving complex optimization problems. The development of large language models (LLMs) enables the automated generation of heuristics. Existing LLM-based evolutionary methods…

Artificial Intelligence · Computer Science 2025-12-12 Hui Wang , Yang Liu , Xiaoyu Zhang , Chaoxu Mu

The maximum reachability probabilities in a Markov decision process can be computed using value iteration (VI). Recently, simulation-based heuristic extensions of VI have been introduced, such as bounded real-time dynamic programming…

Logic in Computer Science · Computer Science 2018-09-11 Pranav Ashok , Tomáš Brázdil , Jan Křetínský , Ondřej Slámečka

Performing object retrieval in real-world workspaces must tackle challenges including \emph{uncertainty} and \emph{clutter}. One option is to apply prehensile operations, which can be time consuming in highly-cluttered scenarios. On the…

Robotics · Computer Science 2024-02-07 Ewerton R. Vieira , Kai Gao , Daniel Nakhimovich , Kostas E. Bekris , Jingjin Yu