English
Related papers

Related papers: Enhancing Reinforcement Learning Through Guided Se…

200 papers

We propose Monte Carlo Permutation Search (MCPS), a general-purpose Monte Carlo Tree Search (MCTS) algorithm that improves upon the GRAVE algorithm. MCPS is relevant when deep reinforcement learning is not an option or when the computing…

Machine Learning · Computer Science 2026-05-27 Tristan Cazenave

Classical policy gradient (PG) methods in reinforcement learning frequently converge to suboptimal local optima, a challenge exacerbated in large or complex environments. This work investigates Policy Gradient with Tree Search (PGTS), an…

Machine Learning · Computer Science 2025-06-10 Uri Koren , Navdeep Kumar , Uri Gadot , Giorgia Ramponi , Kfir Yehuda Levy , Shie Mannor

Sample efficiency and exploration remain major challenges in online reinforcement learning (RL). A powerful approach that can be applied to address these issues is the inclusion of offline data, such as prior trajectories from a human…

Machine Learning · Computer Science 2023-06-01 Philip J. Ball , Laura Smith , Ilya Kostrikov , Sergey Levine

The recent success of supervised learning methods on ever larger offline datasets has spurred interest in the reinforcement learning (RL) field to investigate whether the same paradigms can be translated to RL algorithms. This research…

Machine Learning · Computer Science 2021-02-12 Mengjiao Yang , Ofir Nachum

We examine a type of modified Monte Carlo Tree Search (MCTS) for strategising in combinatorial games. The modifications are derived by analysing simplified strategies and simplified versions of the underlying game and then using the results…

Computer Science and Game Theory · Computer Science 2025-01-14 Michael Haythorpe , Alex Newcombe , Damian O'Dea

Reinforcement Learning (RL) enhances LLM reasoning, yet a paradox emerges as models scale: strong base models saturate standard benchmarks (e.g., MATH), yielding correct but homogeneous solutions. In such environments, the lack of failure…

Machine Learning · Computer Science 2026-04-21 Zhenwen Liang , Yujun Zhou , Sidi Lu , Xiangliang Zhang , Haitao Mi , Dong Yu

Many robotic tasks, such as inverse kinematics, motion planning, and optimal control, can be formulated as optimization problems. Solving these problems involves addressing nonlinear kinematics, complex contact dynamics, long-horizon…

Robotics · Computer Science 2025-09-10 Teng Xue , Yan Zhang , Amirreza Razmjoo , Sylvain Calinon

To overcome the curses of dimensionality and modeling of Dynamic Programming (DP) methods to solve Markov Decision Process (MDP) problems, Reinforcement Learning (RL) methods are adopted in practice. Contrary to traditional RL algorithms…

Machine Learning · Computer Science 2021-08-24 Arghyadip Roy , Vivek Borkar , Abhay Karandikar , Prasanna Chaporkar

This paper addresses the problem of learning optimal control policies for systems with uncertain dynamics and high-level control objectives specified as Linear Temporal Logic (LTL) formulas. Uncertainty is considered in the workspace…

Robotics · Computer Science 2024-10-17 Yiannis Kantaros , Jun Wang

Recommender systems (RecSys) have become critical tools for enhancing user engagement by delivering personalized content across diverse digital platforms. Recent advancements in large language models (LLMs) demonstrate significant potential…

Information Retrieval · Computer Science 2025-10-16 Yi Zhang , Lili Xie , Ruihong Qiu , Jiajun Liu , Sen Wang

In sequential decision-making problems, Return-Conditioned Supervised Learning (RCSL) has gained increasing recognition for its simplicity and stability in modern decision-making tasks. Unlike traditional offline reinforcement learning (RL)…

Machine Learning · Computer Science 2025-06-11 Zhishuai Liu , Yu Yang , Ruhan Wang , Pan Xu , Dongruo Zhou

Leveraging the power of a graph neural network (GNN) with message passing, we present a Monte Carlo Tree Search (MCTS) method to solve stochastic orienteering problems with chance constraints. While adhering to an assigned travel budget the…

Robotics · Computer Science 2025-08-19 Marcos Abel Zuzuárregui , Stefano Carpin

In this paper we explore the application of simultaneous move Monte Carlo Tree Search (MCTS) based online framework for tactical maneuvering between two unmanned aircrafts. Compared to other techniques, MCTS enables efficient search over…

Artificial Intelligence · Computer Science 2020-09-21 Kunal Srivastava , Amit Surana

Evolution Strategy (ES) is a powerful black-box optimization technique based on the idea of natural evolution. In each of its iterations, a key step entails ranking candidate solutions based on some fitness score. For an ES method in…

Machine Learning · Computer Science 2023-02-22 Eshwar S R , Shishir Kolathaya , Gugan Thoppe

Recent research in vision-language models (VLMs) has centered around the possibility of equipping them with implicit long-form chain-of-thought reasoning -- akin to the success observed in language models -- via distillation and…

Computer Vision and Pattern Recognition · Computer Science 2025-06-11 David Acuna , Ximing Lu , Jaehun Jung , Hyunwoo Kim , Amlan Kar , Sanja Fidler , Yejin Choi

Dynamic job shop scheduling, a fundamental combinatorial optimisation problem in various industrial sectors, poses substantial challenges for effective scheduling due to frequent disruptions caused by the arrival of new jobs.…

Artificial Intelligence · Computer Science 2025-09-29 Ruiqi Chen , Yi Mei , Fangfang Zhang , Mengjie Zhang

We propose a provably correct Monte Carlo tree search (MCTS) algorithm for solving risk-aware Markov decision processes (MDPs) with entropic risk measure (ERM) objectives. We provide a non-asymptotic analysis of our proposed algorithm,…

Machine Learning · Computer Science 2026-02-06 Pedro P. Santos , Jacopo Silvestrin , Alberto Sardinha , Francisco S. Melo

Reinforcement learning (RL) is a goal-oriented learning solution that has proven to be successful for Neural Architecture Search (NAS) on the CIFAR and ImageNet datasets. However, a limitation of this approach is its high computational…

Neural and Evolutionary Computing · Computer Science 2019-12-04 J. Gomez Robles , J. Vanschoren

Proof-Number Search (PNS) and Monte-Carlo Tree Search (MCTS) have been successfully applied for decision making in a range of games. This paper proposes a new approach called PN-MCTS that combines these two tree-search methods by…

Artificial Intelligence · Computer Science 2022-06-09 Elliot Doe , Mark H. M. Winands , Dennis J. N. J. Soemers , Cameron Browne

This paper introduces COR-MCTS (Conservation of Resources - Monte Carlo Tree Search), a novel tactical decision-making approach for automated driving focusing on maneuver planning over extended horizons. Traditional decision-making…

Robotics · Computer Science 2025-04-23 Karim Essalmi , Fernando Garrido , Fawzi Nashashibi