English
Related papers

Related papers: How to Combine Tree-Search Methods in Reinforcemen…

200 papers

We propose a reinforcement-learning algorithm to tackle the challenge of reconstructing phylogenetic trees. The search for the tree that best describes the data is algorithmically challenging, thus all current algorithms for phylogeny…

Populations and Evolution · Quantitative Biology 2023-03-14 Dana Azouri , Oz Granit , Michael Alburquerque , Yishay Mansour , Tal Pupko , Itay Mayrose

AlphaZero-like Monte Carlo Tree Search systems, originally introduced for two-player games, dynamically balance exploration and exploitation using neural network guidance. This combination makes them also suitable for classical search…

Machine Learning · Computer Science 2025-11-06 Alexandros Vazaios , Jannis Brugger , Cedric Derstroff , Kristian Kersting , Mira Mezini

In this paper, we propose to combine imitation and reinforcement learning via the idea of reward shaping using an oracle. We study the effectiveness of the near-optimal cost-to-go oracle on the planning horizon and demonstrate that the…

Machine Learning · Computer Science 2018-05-30 Wen Sun , J. Andrew Bagnell , Byron Boots

This paper addresses the problem of optimal control using search trees. We start by considering multi-armed bandit problems with continuous action spaces and propose LD-HOO, a limited depth variant of the hierarchical optimistic…

Optimization and Control · Mathematics 2021-06-30 Ricardo Quinteiro , Francisco S. Melo , Pedro A. Santos

Calibrating agent-based models (ABMs) in economics and finance typically involves a derivative-free search in a very large parameter space. In this work, we benchmark a number of search methods in the calibration of a well-known…

Machine Learning · Computer Science 2023-12-08 Aldo Glielmo , Marco Favorito , Debmallya Chanda , Domenico Delli Gatti

Wheel loaders in mines and construction sites repeatedly load soil from a pile to load receivers. Automating this task presents a challenging planning problem since each loading's performance depends on the pile state, which depends on…

Computational Engineering, Finance, and Science · Computer Science 2025-07-14 Koji Aoshima , Eddie Wadbro , Martin Servin

Tree search has recently emerged as a powerful framework for aligning generative models with task-specific rewards at test time. Applying tree search to Masked Diffusion Language Models, however, introduces two key challenges: (i) parallel…

Computation and Language · Computer Science 2025-09-30 Zichao Yu , Ming Li , Wenyi Zhang , Weiguo Gao

The combination of Monte-Carlo Tree Search (MCTS) and deep reinforcement learning is state-of-the-art in two-player perfect-information games. In this paper, we describe a search algorithm that uses a variant of MCTS which we enhanced by 1)…

Machine Learning · Computer Science 2020-05-26 Arta Seify , Michael Buro

We introduce and study the problem of planning a trajectory for an agent to carry out a scouting mission while avoiding being detected by an adversarial guard. This introduces an adversarial version of classical visibility-based planning…

Robotics · Computer Science 2019-02-26 Zhongshun Zhang , Yoonchang Sung , Lifeng Zhou , Jonathon M. Smereka , Joseph Lee , Pratap Tokekar

Optimal motion planning involves obstacles avoidance where path planning is the key to success in optimal motion planning. Due to the computational demands, most of the path planning algorithms can not be employed for real-time based…

Robotics · Computer Science 2022-02-15 Geesara Kulathunga

Based on the existing pivot rules, the simplex method for linear programming is not polynomial in the worst case. Therefore the optimal pivot of the simplex method is crucial. This study proposes the optimal rule to find all shortest pivot…

Optimization and Control · Mathematics 2024-02-27 Anqi Li , Tiande Guo , Congying Han , Bonan Li , Haoran Li

Adaptive sampling and planning in robotic environmental monitoring are challenging when the target environmental process varies over space and time. The underlying environmental dynamics require the planning module to integrate future…

Robotics · Computer Science 2023-06-19 Weizhe Chen , Lantao Liu

Particle physics experiments often require the reconstruction of decay patterns through a hierarchical clustering of the observed final-state particles. We show that this task can be phrased as a Markov Decision Process and adapt…

Artificial Intelligence · Computer Science 2020-12-21 Johann Brehmer , Sebastian Macaluso , Duccio Pappadopulo , Kyle Cranmer

We study tabular reinforcement learning problems with multiple steps of lookahead information. Before acting, the learner observes $\ell$ steps of future transition and reward realizations: the exact state the agent would reach and the…

Machine Learning · Computer Science 2026-01-16 Nadav Merlis

This paper proposes a new algorithm for learning accurate tree-based models while ensuring the existence of recourse actions. Algorithmic Recourse (AR) aims to provide a recourse action for altering the undesired prediction result given by…

Machine Learning · Computer Science 2024-06-04 Kentaro Kanamori , Takuya Takagi , Ken Kobayashi , Yuichi Ike

Monte Carlo Tree Search (MCTS) has been proposed as a transformative approach to join-order optimization in database query processing, with recent frameworks such as AlphaJoin and HyperQO claiming to outperform traditional methods. However,…

In many risk-aware and multi-objective reinforcement learning settings, the utility of the user is derived from a single execution of a policy. In these settings, making decisions based on the average future returns is not suitable. For…

Artificial Intelligence · Computer Science 2022-12-07 Conor F. Hayes , Mathieu Reymond , Diederik M. Roijers , Enda Howley , Patrick Mannion

This paper proposes a novel reinforcement learning (RL) algorithm using improved Monte Carlo tree search (IMCTS) formulation for discrete optimum design of truss structures. IMCTS with multiple root nodes includes update process, the best…

Artificial Intelligence · Computer Science 2024-08-08 Fu-Yao Ko , Katsuyuki Suzuki , Kazuo Yonekura

Popular Monte-Carlo tree search (MCTS) algorithms for online planning, such as epsilon-greedy tree search and UCT, aim at rapidly identifying a reasonably good action, but provide rather poor worst-case guarantees on performance improvement…

Artificial Intelligence · Computer Science 2013-09-27 Zohar Feldman , Carmel Domshlak

Research in reinforcement learning has produced algorithms for optimal decision making under uncertainty that fall within two main types. The first employs a Bayesian framework, where optimality improves with increased computational time.…

Machine Learning · Statistics 2011-09-22 Christos Dimitrakakis