中文
相关论文

相关论文: Monte Carlo Tree Search for Verifying Reachability…

200 篇论文

In many risk-aware and multi-objective reinforcement learning settings, the utility of the user is derived from a single execution of a policy. In these settings, making decisions based on the average future returns is not suitable. For…

人工智能 · 计算机科学 2022-12-07 Conor F. Hayes , Mathieu Reymond , Diederik M. Roijers , Enda Howley , Patrick Mannion

Computing reachability probabilities is at the heart of probabilistic model checking. All model checkers compute these probabilities in an iterative fashion using value iteration. This technique approximates a fixed point from below by…

计算机科学中的逻辑 · 计算机科学 2018-04-16 Tim Quatmann , Joost-Pieter Katoen

General Video Game Playing (GVGP) is a field of Artificial Intelligence where agents play a variety of real-time video games that are unknown in advance. This limits the use of domain-specific heuristics. Monte-Carlo Tree Search (MCTS) is a…

人工智能 · 计算机科学 2024-07-04 Dennis J. N. J. Soemers , Chiara F. Sironi , Torsten Schuster , Mark H. M. Winands

Tree search-based methods have made significant progress in enhancing the code generation capabilities of large language models. However, due to the difficulty in effectively evaluating intermediate algorithmic steps and the inability to…

人工智能 · 计算机科学 2025-12-18 Yuanyuan Lin , Xiangyu Ouyang , Teng Zhang , Kaixin Sui

Two standard models for probabilistic systems are Markov chains (MCs) and Markov decision processes (MDPs). Classic objectives for such probabilistic models for control and planning problems are reachability and stochastic shortest path.…

人工智能 · 计算机科学 2025-05-13 Krishnendu Chatterjee , Mahdi JafariRaviz , Raimundo Saona , Jakub Svoboda

Monte-Carlo Tree Search (MCTS) is a family of sampling-based search algorithms widely used for online planning in sequential decision-making domains and at the heart of many recent advances in artificial intelligence. Understanding the…

人工智能 · 计算机科学 2025-09-25 Yiyu Qian , Tim Miller , Zheng Qian , Liyuan Zhao

The integration of autonomous vehicles into urban and highway environments necessitates the development of robust and adaptable behavior planning systems. This study presents an innovative approach to address this challenge by utilizing a…

机器人学 · 计算机科学 2023-10-19 Qianfeng Wen , Zhongyi Gong , Lifeng Zhou , Zhongshun Zhang

Monte Carlo tree search (MCTS) has received considerable interest due to its spectacular success in the difficult problem of computer Go and also proved beneficial in a range of other domains. A major issue that has received little…

机器学习 · 计算机科学 2019-05-10 Aurelien Pelissier , Atsuyoshi Nakamura , Koji Tabata

This study investigates the combined use of generative grammar rules and Monte Carlo Tree Search (MCTS) for optimizing truss structures. Our approach accommodates intermediate construction stages characteristic of progressive construction…

计算工程、金融与科学 · 计算机科学 2025-04-03 Gabriel Garayalde , Luca Rosafalco , Matteo Torzoni , Alberto Corigliano

This paper introduces the MCTS algorithm to the financial world and focuses on solving significant multi-period financial planning models by combining a Monte Carlo Tree Search algorithm with a deep neural network. The MCTS provides an…

计算金融 · 定量金融 2022-05-19 Afşar Onat Aydınhan , Xiaoyue Li , John M. Mulvey

Recent advancements in large language models (LLMs) have shown remarkable potential in automating machine learning tasks. However, existing LLM-based agents often struggle with low-diversity and suboptimal code generation. While recent work…

计算与语言 · 计算机科学 2026-01-26 Zujie Liang , Feng Wei , Wujiang Xu , Lin Chen , Yuxi Qian , Xinhui Wu

To plan safely in uncertain environments, agents must balance utility with safety constraints. Safe planning problems can be modeled as a chance-constrained partially observable Markov decision process (CC-POMDP) and solutions often use…

人工智能 · 计算机科学 2024-05-02 Robert J. Moss , Arec Jamgochian , Johannes Fischer , Anthony Corso , Mykel J. Kochenderfer

We study how to efficiently combine formal methods, Monte Carlo Tree Search (MCTS), and deep learning in order to produce high-quality receding horizon policies in large Markov Decision processes (MDPs). In particular, we use model-checking…

人工智能 · 计算机科学 2023-08-16 Debraj Chakraborty , Damien Busatto-Gaston , Jean-François Raskin , Guillermo A. Pérez

This paper studies parametric Markov decision processes (pMDPs), an extension to Markov decision processes (MDPs) where transitions probabilities are described by polynomials over a finite set of parameters. Fixing values for all parameters…

计算机科学中的逻辑 · 计算机科学 2019-04-03 Tobias Winkler , Sebastian Junges , Guillermo A. Pérez , Joost-Pieter Katoen

Monte-Carlo Tree Search (MCTS) methods are drawing great interest after yielding breakthrough results in computer Go. This paper proposes a Bayesian approach to MCTS that is inspired by distributionfree approaches such as UCT [13], yet…

机器学习 · 计算机科学 2012-03-19 Gerald Tesauro , V T Rajan , Richard Segal

In this research, we investigate the possibility of applying a search strategy to genetic algorithms to explore the entire genetic tree structure. Several methods aid in performing tree searches; however, simpler algorithms such as…

神经与进化计算 · 计算机科学 2023-08-10 Akshay Hebbar

This paper presents a finite-time analysis for Monte Carlo Tree Search (MCTS) in Partially Observable Markov Decision Processes (POMDPs), with probabilistic concentration bounds in both discrete and continuous observation spaces. While…

人工智能 · 计算机科学 2026-05-11 Da Kong , Vadim Indelman

The solution convergence of Markov Decision Processes (MDPs) can be accelerated by prioritized sweeping of states ranked by their potential impacts to other states. In this paper, we present new heuristics to speed up the solution…

人工智能 · 计算机科学 2019-01-07 Shoubhik Debnath , Lantao Liu , Gaurav Sukhatme

We consider Monte-Carlo Tree Search (MCTS) applied to Markov Decision Processes (MDPs) and Partially Observable MDPs (POMDPs), and the well-known Upper Confidence bound for Trees (UCT) algorithm. In UCT, a tree with nodes (states) and edges…

人工智能 · 计算机科学 2020-07-14 Tuan Dam , Pascal Klink , Carlo D'Eramo , Jan Peters , Joni Pajarinen

Autonomous mobile robots enable increased flexibility of manufacturing systems. The design and operating strategy of such a fleet of robots requires careful consideration of both fixed and operational costs. In this paper, a Monte-Carlo…

系统与控制 · 电气工程与系统科学 2024-03-05 T. M. J. T. Baltussen , M. Goutham , M. Menon , S. G. Garrow , M. Santillo , S. Stockar