English
Related papers

Related papers: Time-critical and confidence-based abstraction dro…

200 papers

Gradient-based methods are often used for policy optimization in deep reinforcement learning, despite being vulnerable to local optima and saddle points. Although gradient-free methods (e.g., genetic algorithms or evolution strategies) help…

Machine Learning · Computer Science 2019-12-24 Xiaobai Ma , Katherine Driggs-Campbell , Zongzhang Zhang , Mykel J. Kochenderfer

The increasing use of autonomous robot systems in hazardous environments underscores the need for efficient search and rescue operations. Despite significant advancements, existing literature on object search often falls short in overcoming…

Robotics · Computer Science 2024-04-08 Matthew Collins , Jared J. Beard , Nicholas Ohi , Yu Gu

We present abstraction-refinement algorithms for model checking safety properties of timed automata. The abstraction domain we consider abstracts away zones by restricting the set of clock constraints that can be used to define them, while…

Formal Languages and Automata Theory · Computer Science 2019-05-27 Victor Roussanaly , Ocan Sankur , Nicolas Markey

The search for quantum algorithms to tackle classical combinatorial optimization problems has long been one of the most attractive yet challenging research topics in quantum computing. In this context, variational quantum algorithms (VQA)…

Quantum Physics · Physics 2025-04-15 Andoni Agirre , Evert Van Nieuwenburg , Matteo M. Wauters

We tackle the problem of goal-directed graph construction: given a starting graph, a budget of modifications, and a global objective function, the aim is to find a set of edges whose addition to the graph achieves the maximum improvement in…

Artificial Intelligence · Computer Science 2022-02-17 Victor-Alexandru Darvariu , Stephen Hailes , Mirco Musolesi

This article presents MCTS-BN, an adaptation of the Monte Carlo Tree Search (MCTS) algorithm for the structural learning of Bayesian Networks (BNs). Initially designed for game tree exploration, MCTS has been repurposed to address the…

Machine Learning · Computer Science 2025-02-04 Jorge D. Laborda , Pablo Torrijos , José M. Puerta , José A. Gámez

For UAV-aided wireless systems, online path planning attracts much attention recently. To better adapt to the real-time dynamic environment, we, for the first time, propose a Monte Carlo Tree Search (MCTS)-based path planning scheme. In…

Networking and Internet Architecture · Computer Science 2022-02-08 Yuwen Qian , Kexin Sheng , Chuan Ma , Jun Li , Ming Ding , Mahbub Hassan

The maximum reachability probabilities in a Markov decision process can be computed using value iteration (VI). Recently, simulation-based heuristic extensions of VI have been introduced, such as bounded real-time dynamic programming…

Logic in Computer Science · Computer Science 2018-09-11 Pranav Ashok , Tomáš Brázdil , Jan Křetínský , Ondřej Slámečka

The most widely used methods for toolpath planning in fused deposition 3D printing slice the input model into successive 2D layers in order to construct the toolpath. Unfortunately slicing-based methods can incur a substantial amount of…

Robotics · Computer Science 2020-02-06 Chanyeol Yoo , Samuel Lensgraf , Robert Fitch , Lee M. Clemon , Ramgopal Mettu

Bandit based methods for tree search have recently gained popularity when applied to huge trees, e.g. in the game of go [6]. Their efficient exploration of the tree enables to re- turn rapidly a good value, and improve preci- sion if more…

Artificial Intelligence · Computer Science 2014-08-12 Pierre-Arnuad Coquelin , Remi Munos

Demand for high-performance, robust, and safe autonomous systems has grown substantially in recent years. These objectives motivate the desire for efficient safety-theoretic reasoning that can be embedded in core decision-making tasks such…

Robotics · Computer Science 2022-12-27 Kristoffer M. Frey , Ted J. Steiner , Jonathan P. How

Effective decision-making and problem-solving in conversational systems require the ability to identify and acquire missing information through targeted questioning. A key challenge lies in efficiently narrowing down a large space of…

Artificial Intelligence · Computer Science 2025-06-03 Harshita Chopra , Chirag Shah

Online test-time adaptation (OTTA) of vision-language models (VLMs) has recently garnered increased attention to take advantage of data observed along a stream to improve future predictions. Unfortunately, existing methods rely on…

Computer Vision and Pattern Recognition · Computer Science 2025-01-09 Clément Fuchs , Maxime Zanella , Christophe De Vleeschouwer

Monte Carlo tree search (MCTS) has achieved state-of-the-art results in many domains such as Go and Atari games when combining with deep neural networks (DNNs). When more simulations are executed, MCTS can achieve higher performance but…

Artificial Intelligence · Computer Science 2020-12-16 Li-Cheng Lan , Meng-Yu Tsai , Ti-Rong Wu , I-Chen Wu , Cho-Jui Hsieh

The Monte Carlo simulation (MCS) is a statistical methodology used in a large number of applications. It uses repeated random sampling to solve problems with a probability interpretation to obtain high-quality numerical results. The MCS is…

Discrete Mathematics · Computer Science 2022-01-19 Wei-Chang Yeh

The majority of existing Linear Temporal Logic (LTL) planning methods rely on the construction of a discrete product automaton, that combines a discrete abstraction of robot mobility and a B$\ddot{\text{u}}$chi automaton that captures the…

Robotics · Computer Science 2021-03-24 Xusheng Luo , Yiannis Kantaros , Michael M. Zavlanos

This paper introduces the MCTS algorithm to the financial world and focuses on solving significant multi-period financial planning models by combining a Monte Carlo Tree Search algorithm with a deep neural network. The MCTS provides an…

Computational Finance · Quantitative Finance 2022-05-19 Afşar Onat Aydınhan , Xiaoyue Li , John M. Mulvey

Differentiable architecture search (DARTS) has been a popular one-shot paradigm for NAS due to its high efficiency. It introduces trainable architecture parameters to represent the importance of candidate operations and proposes…

Computer Vision and Pattern Recognition · Computer Science 2022-02-01 Xiaoxing Wang , Wenxuan Guo , Junchi Yan , Jianlin Su , Xiaokang Yang

This paper proposes a novel reinforcement learning (RL) algorithm using improved Monte Carlo tree search (IMCTS) formulation for discrete optimum design of truss structures. IMCTS with multiple root nodes includes update process, the best…

Artificial Intelligence · Computer Science 2024-08-08 Fu-Yao Ko , Katsuyuki Suzuki , Kazuo Yonekura

Physics-based simulations and learning-based models are vital for complex robotics tasks like deformable object manipulation and liquid handling. However, these models often struggle with accuracy due to epistemic uncertainty or the…

Robotics · Computer Science 2025-07-29 Marco Faroni , Carlo Odesco , Andrea Zanchettin , Paolo Rocco