English
Related papers

Related papers: Scalable Anytime Planning for Multi-Agent MDPs

200 papers

In the world of embedded systems, optimizing actions with the uncertain costs of multiple resources is a complex challenge. Existing methods include plan building based on Monte Carlo Tree Search (MCTS), an approach that thrives in multiple…

Systems and Control · Electrical Eng. & Systems 2024-07-18 Franco Cordeiro , Samuel Tardieu , Laurent Pautet

Constrained Markov decision processes (CMDPs), in which the agent optimizes expected payoffs while keeping the expected cost below a given threshold, are the leading framework for safe sequential decision making under stochastic…

Artificial Intelligence · Computer Science 2024-12-19 Martin Kurečka , Václav Nevyhoštěný , Petr Novotný , Vít Unčovský

The maximum reachability probabilities in a Markov decision process can be computed using value iteration (VI). Recently, simulation-based heuristic extensions of VI have been introduced, such as bounded real-time dynamic programming…

Logic in Computer Science · Computer Science 2018-09-11 Pranav Ashok , Tomáš Brázdil , Jan Křetínský , Ondřej Slámečka

Efficient motion planning for high-dimensional robotic systems, such as manipulators and mobile manipulators, is critical for real-time operation and reliable deployment. Although advances in planning algorithms have enhanced scalability to…

Robotics · Computer Science 2026-02-13 Itamar Mishani , Maxim Likhachev

A novel method called mixed variable system Monte Carlo tree search (MVSMCTS) formulation is presented for optimization problems considering various types of variables with single and mixed continuous-discrete system. This method utilizes a…

Optimization and Control · Mathematics 2024-10-31 Fu-Yao Ko , Katsuyuki Suzuki , Kazuo Yonekura

We tackle the challenging problem of multi-agent cooperative motion planning for complex tasks described using signal temporal logic (STL), where robots can have nonlinear and nonholonomic dynamics. Existing methods in multi-agent motion…

Robotics · Computer Science 2022-01-17 Dawei Sun , Jingkai Chen , Sayan Mitra , Chuchu Fan

We present a self-improving, Neural Tree Expansion (NTE) method for multi-robot online planning in non-cooperative environments, where each robot attempts to maximize its cumulative reward while interacting with other self-interested…

Robotics · Computer Science 2021-07-12 Benjamin Riviere , Wolfgang Hoenig , Matthew Anderson , Soon-Jo Chung

Lane-free traffic environments allow vehicles to better harness the lateral capacity of the road without being restricted to lane-keeping, thereby increasing the traffic flow rates. As such, we have a distinct and more challenging setting…

The discovery of patterns that accurately discriminate one class label from another remains a challenging data mining task. Subgroup discovery (SD) is one of the frameworks that enables to elicit such interesting hypotheses from labeled…

Data Structures and Algorithms · Computer Science 2017-12-07 Guillaume Bosc , Jean-François Boulicaut , Chedy Raïssi , Mehdi Kaytoue

The most widely used methods for toolpath planning in fused deposition 3D printing slice the input model into successive 2D layers in order to construct the toolpath. Unfortunately slicing-based methods can incur a substantial amount of…

Robotics · Computer Science 2020-02-06 Chanyeol Yoo , Samuel Lensgraf , Robert Fitch , Lee M. Clemon , Ramgopal Mettu

This paper proposes a cooperative environmental learning algorithm working in a fully distributed manner. A multi-robot system is more effective for exploration tasks than a single robot, but it involves the following challenges: 1) online…

Robotics · Computer Science 2021-12-30 Dohyun Jang , Jaehyun Yoo , Clark Youngdong Son , H. Jin Kim

Generating safety-critical scenarios is essential for validating the robustness of autonomous driving systems, yet existing methods often struggle to produce collisions that are both realistic and diverse while ensuring explicit interaction…

Robotics · Computer Science 2026-03-05 Wenyun Li , Zejian Deng , Chen Sun

Large language models (LLMs) have demonstrated remarkable capabilities in code generation and structured reasoning; however, their performance often degrades on complex tasks that require consistent multi-step planning. Recent work has…

Machine Learning · Computer Science 2025-08-11 Fei Xu Yu , Gina Adam , Nathaniel D. Bastian , Tian Lan

Missions for autonomous systems often require agents to visit multiple targets in complex operating conditions. This work considers the problem of visiting a set of targets in minimum time by a team of non-communicating agents in a Markov…

Optimization and Control · Mathematics 2023-06-21 Farhad Nawaz , Melkior Ornik

Temporal planning is an extension of classical planning involving concurrent execution of actions and alignment with temporal constraints. Durative actions along with invariants allow for modeling domains in which multiple agents operate in…

Artificial Intelligence · Computer Science 2023-07-25 Marco De Bortoli , Lukáš Chrpa , Martin Gebser , Gerald Steinbauer-Wagner

This paper introduces a new negotiating agent model for automated negotiation. We focus on applications without time pressure with multidi-mensional negotiation on both continuous and discrete domains. The agent bidding strategy relies on…

Multiagent Systems · Computer Science 2019-09-23 Cédric Buron , Zahia Guessoum , Sylvain Ductor

We study how to efficiently combine formal methods, Monte Carlo Tree Search (MCTS), and deep learning in order to produce high-quality receding horizon policies in large Markov Decision processes (MDPs). In particular, we use model-checking…

Artificial Intelligence · Computer Science 2023-08-16 Debraj Chakraborty , Damien Busatto-Gaston , Jean-François Raskin , Guillermo A. Pérez

In decentralized stochastic control, standard approaches for sequential decision-making, e.g. dynamic programming, quickly become intractable due to the need to maintain a complex information state. Computational challenges are further…

Machine Learning · Computer Science 2019-08-08 Kaiqing Zhang , Erik Miehling , Tamer Başar

Planning under resource constraints is central to real-world decision making, yet most large language model (LLM) planners assume uniform action costs. We systematically analyze whether tree-search LLM planners are cost-aware and whether…

Artificial Intelligence · Computer Science 2026-01-13 Zihao Zhang , Hui Wei , Kenan Jiang , Shijia Pan , Shu Kai , Fei Liu

We propose a provably correct Monte Carlo tree search (MCTS) algorithm for solving risk-aware Markov decision processes (MDPs) with entropic risk measure (ERM) objectives. We provide a non-asymptotic analysis of our proposed algorithm,…

Machine Learning · Computer Science 2026-02-06 Pedro P. Santos , Jacopo Silvestrin , Alberto Sardinha , Francisco S. Melo