中文
相关论文

相关论文: Monte Carlo Tree Search for Verifying Reachability…

200 篇论文

Bayesian optimization (BO) is a class of popular methods for expensive black-box optimization, and has been widely applied to many scenarios. However, BO suffers from the curse of dimensionality, and scaling it to high-dimensional problems…

机器学习 · 计算机科学 2022-11-17 Lei Song , Ke Xue , Xiaobin Huang , Chao Qian

In this paper, we consider the online computation of a strategy that aims at optimizing the expected average reward in a Markov decision process. The strategy is computed with a receding horizon and using Monte Carlo tree search (MCTS). We…

计算机科学与博弈论 · 计算机科学 2020-07-17 Damien Busatto-Gaston , Debraj Chakraborty , Jean-Francois Raskin

Monte Carlo Tree Search (MCTS) is a branch of stochastic modeling that utilizes decision trees for optimization, mostly applied to artificial intelligence (AI) game players. This project imagines a game in which an AI player searches for a…

机器学习 · 计算机科学 2020-12-01 Elana Kozak , Scott Hottovy

The Job Shop Scheduling Problem (JSSP) is a well-known optimization problem in manufacturing, where the goal is to determine the optimal sequence of jobs across different machines to minimize a given objective. In this work, we focus on…

人工智能 · 计算机科学 2025-01-31 Laurie Boveroux , Damien Ernst , Quentin Louveaux

Monte Carlo Tree Search (MCTS) has been proposed as a transformative approach to join-order optimization in database query processing, with recent frameworks such as AlphaJoin and HyperQO claiming to outperform traditional methods. However,…

This paper introduces COR-MCTS (Conservation of Resources - Monte Carlo Tree Search), a novel tactical decision-making approach for automated driving focusing on maneuver planning over extended horizons. Traditional decision-making…

机器人学 · 计算机科学 2025-04-23 Karim Essalmi , Fernando Garrido , Fawzi Nashashibi

Computing optimal conditional reachability probabilities in Markov decision processes (MDPs) is tractable by a reduction to reachability probabilities. Yet, this reduction yields cyclic, challenging MDPs that are often notoriously hard to…

计算机科学中的逻辑 · 计算机科学 2026-05-14 Milan Češka , Sebastian Junges , Luko van der Maas , Filip Macák , Tim Quatmann

We present a general framework for applying learning algorithms and heuristical guidance to the verification of Markov decision processes (MDPs). The primary goal of our techniques is to improve performance by avoiding an exhaustive…

Path planning is a crucial algorithmic approach for designing robot behaviors. Sampling-based approaches, like rapidly exploring random trees (RRTs) or probabilistic roadmaps, are prominent algorithmic solutions for path planning problems.…

机器人学 · 计算机科学 2022-08-05 T. Dam , G. Chalvatzaki , J. Peters , J. Pajarinen

This paper presents a novel algorithm for robot task and motion planning (TAMP) problems by utilizing a reachability tree. While tree-based algorithms are known for their speed and simplicity in motion planning (MP), they are not…

机器人学 · 计算机科学 2024-01-15 Kanghyun Kim , Daehyung Park , Min Jun Kim

This work investigates the Monte Carlo Tree Search (MCTS) method combined with dedicated heuristics for solving the Weighted Vertex Coloring Problem. In addition to the basic MCTS algorithm, we study several MCTS variants where the…

人工智能 · 计算机科学 2025-03-05 Cyril Grelier , Olivier Goudet , Jin-Kao Hao

Online motion planning is a challenging problem for intelligent robots moving in dense environments with dynamic obstacles, e.g., crowds. In this work, we propose a novel approach for optimal and safe online motion planning with minimal…

人工智能 · 计算机科学 2025-01-17 Lorenzo Bonanni , Daniele Meli , Alberto Castellini , Alessandro Farinelli

This paper introduces a novel backup strategy for Monte-Carlo Tree Search (MCTS) designed for highly stochastic and partially observable Markov decision processes. We adopt a probabilistic approach, modeling both value and action-value…

人工智能 · 计算机科学 2023-09-20 Tuan Dam , Pascal Stenger , Lukas Schneider , Joni Pajarinen , Carlo D'Eramo , Odalric-Ambrym Maillard

Bayes-optimal behavior, while well-defined, is often difficult to achieve. Recent advances in the use of Monte-Carlo tree search (MCTS) have shown that it is possible to act near-optimally in Markov Decision Processes (MDPs) with very large…

人工智能 · 计算机科学 2012-02-20 John Asmuth , Michael L. Littman

We introduce an approach aimed at enhancing the reasoning capabilities of Large Language Models (LLMs) through an iterative preference learning process inspired by the successful strategy employed by AlphaZero. Our work leverages Monte…

人工智能 · 计算机科学 2024-06-19 Yuxi Xie , Anirudh Goyal , Wenyue Zheng , Min-Yen Kan , Timothy P. Lillicrap , Kenji Kawaguchi , Michael Shieh

Real-world problems often require reasoning about hybrid beliefs, over both discrete and continuous random variables. Yet, such a setting has hardly been investigated in the context of planning. Moreover, existing online Partially…

人工智能 · 计算机科学 2023-05-04 Moran Barenboim , Moshe Shienman , Vadim Indelman

Monte-Carlo tree search (MCTS) is an effective anytime algorithm with a vast amount of applications. It strategically allocates computational resources to focus on promising segments of the search tree, making it a very attractive search…

人工智能 · 计算机科学 2024-02-14 Cedric Derstroff , Jannis Brugger , Jannis Blüml , Mira Mezini , Stefan Kramer , Kristian Kersting

This paper presents an efficient approach to object manipulation planning using Monte Carlo Tree Search (MCTS) to find contact sequences and an efficient ADMM-based trajectory optimization algorithm to evaluate the dynamic feasibility of…

机器人学 · 计算机科学 2023-03-21 Huaijiang Zhu , Avadesh Meduri , Ludovic Righetti

High-dimensional design spaces underpin a wide range of physics-based modeling and computational design tasks in science and engineering. These problems are commonly formulated as constrained black-box searches over rugged objective…

Partially Observable Markov Decision Processes (POMDPs) are powerful models for sequential decision making under transition and observation uncertainties. This paper studies the challenging yet important problem in POMDPs known as the…

人工智能 · 计算机科学 2024-06-06 Qi Heng Ho , Martin S. Feather , Federico Rossi , Zachary N. Sunberg , Morteza Lahijanian