English
Related papers

Related papers: Monte Carlo Tree Diffusion for System 2 Planning

200 papers

Diffusion models have recently emerged as a powerful approach for trajectory planning. However, their inherently non-sequential nature limits their effectiveness in long-horizon reasoning tasks at test time. The recently proposed Monte…

Artificial Intelligence · Computer Science 2025-10-27 Jaesik Yoon , Hyeonseo Cho , Yoshua Bengio , Sungjin Ahn

Monte Carlo Tree Diffusion (MCTD) integrates diffusion models with structured tree search to enable effective trajectory exploration through stepwise reasoning. However, MCTD remains fundamentally limited by training trajectory lengths.…

Machine Learning · Computer Science 2026-01-07 Jaesik Yoon , Hyeonseo Cho , Sungjin Ahn

The goal of protein design is to generate amino acid sequences that fold into functional structures with desired properties. Prior methods combining autoregressive language models with Monte Carlo Tree Search (MCTS) struggle with long-range…

Machine Learning · Computer Science 2026-02-25 Xuefeng Liu , Mingxuan Cao , Songhao Jiang , Xiao Luo , Xiaotian Duan , Mengdi Wang , Tobin R. Sosnick , Jinbo Xu , Rick Stevens

Adapting a pretrained diffusion model to new objectives at inference time remains an open problem in generative modeling. Existing steering methods suffer from inaccurate value estimation, especially at high noise levels, which biases…

Machine Learning · Computer Science 2025-06-27 Vineet Jain , Kusha Sareen , Mohammad Pedramfar , Siamak Ravanbakhsh

While plan-and-infill decoding in Masked Diffusion Models (MDMs) shows promise for mathematical and code reasoning, performance remains highly sensitive to slot infilling order, often yielding substantial output variance. We introduce…

Artificial Intelligence · Computer Science 2026-05-28 Joshua Ong Jun Leang , Yu Zhao , Mihaela Cătălina Stoian , Wenda Li , Shay B. Cohen , Eleonora Giunchiglia

This paper introduces the MCTS algorithm to the financial world and focuses on solving significant multi-period financial planning models by combining a Monte Carlo Tree Search algorithm with a deep neural network. The MCTS provides an…

Computational Finance · Quantitative Finance 2022-05-19 Afşar Onat Aydınhan , Xiaoyue Li , John M. Mulvey

Making changes to a program to optimize its performance is an unscalable task that relies entirely upon human intuition and experience. In addition, companies operating at large scale are at a stage where no single individual understands…

Machine Learning · Computer Science 2020-05-08 Don M. Dini

Standard planners for sequential decision making (including Monte Carlo planning, tree search, dynamic programming, etc.) are constrained by an implicit sequential planning assumption: The order in which a plan is constructed is the same in…

Monte Carlo Tree Search (MCTS) is an immensely popular search-based framework used for decision making. It is traditionally applied to domains where a perfect simulation model of the environment is available. We study and improve MCTS in…

Artificial Intelligence · Computer Science 2024-05-24 Farnaz Kohankhaki , Kiarash Aghakasiri , Hongming Zhang , Ting-Han Wei , Chao Gao , Martin Müller

Diffusion language models (DLMs) have recently emerged as a compelling alternative to autoregressive generation, offering parallel generation and improved global coherence. During inference, DLMs generate text by iteratively denoising…

Monte-Carlo tree search (MCTS) is an effective anytime algorithm with a vast amount of applications. It strategically allocates computational resources to focus on promising segments of the search tree, making it a very attractive search…

Artificial Intelligence · Computer Science 2024-02-14 Cedric Derstroff , Jannis Brugger , Jannis Blüml , Mira Mezini , Stefan Kramer , Kristian Kersting

The most widely used methods for toolpath planning in fused deposition 3D printing slice the input model into successive 2D layers in order to construct the toolpath. Unfortunately slicing-based methods can incur a substantial amount of…

Robotics · Computer Science 2020-02-06 Chanyeol Yoo , Samuel Lensgraf , Robert Fitch , Lee M. Clemon , Ramgopal Mettu

Online planning is crucial for high performance in many complex sequential decision-making tasks. Monte Carlo Tree Search (MCTS) employs a principled mechanism for trading off exploration for exploitation for efficient online planning, and…

Artificial Intelligence · Computer Science 2024-02-08 Kalle Kujanpää , Amin Babadi , Yi Zhao , Juho Kannala , Alexander Ilin , Joni Pajarinen

Monte Carlo Tree Search (MCTS) is an effective test-time compute scaling (TTCS) method for improving the reasoning performance of large language models, but its highly variable execution time leads to severe long-tail latency in practice.…

Artificial Intelligence · Computer Science 2026-04-02 Hongbeen Kim , Juhyun Lee , Sanghyeon Lee , Kwanghoon Choi , Jaehyuk Huh

Deep Neural Network guided Monte-Carlo Tree Search (DNN-MCTS) is a powerful class of AI algorithms. In DNN-MCTS, a Deep Neural Network model is trained collaboratively with a dynamic Monte-Carlo search tree to guide the agent towards…

Performance · Computer Science 2023-10-10 Yuan Meng , Qian Wang , Tianxin Zu , Viktor Prasanna

In many risk-aware and multi-objective reinforcement learning settings, the utility of the user is derived from a single execution of a policy. In these settings, making decisions based on the average future returns is not suitable. For…

Artificial Intelligence · Computer Science 2022-12-07 Conor F. Hayes , Mathieu Reymond , Diederik M. Roijers , Enda Howley , Patrick Mannion

Monte Carlo Tree Search (MCTS) efficiently balances exploration and exploitation in tree search based on count-derived uncertainty. However, these local visit counts ignore a second type of uncertainty induced by the size of the subtree…

Artificial Intelligence · Computer Science 2020-05-21 Thomas M Moerland , Joost Broekens , Aske Plaat , Catholijn M Jonker

The discovery of patterns that accurately discriminate one class label from another remains a challenging data mining task. Subgroup discovery (SD) is one of the frameworks that enables to elicit such interesting hypotheses from labeled…

Data Structures and Algorithms · Computer Science 2017-12-07 Guillaume Bosc , Jean-François Boulicaut , Chedy Raïssi , Mehdi Kaytoue

Monte Carlo Tree Search (MCTS) is a powerful approach to designing game-playing bots or solving sequential decision problems. The method relies on intelligent tree search that balances exploration and exploitation. MCTS performs random…

Artificial Intelligence · Computer Science 2023-04-04 Maciej Świechowski , Konrad Godlewski , Bartosz Sawicki , Jacek Mańdziuk

Global climate challenge is demanding urgent actions for decarbonization, while electric power systems take the major roles in clean energy transition. Due to the existence of spatially and temporally dispersed renewable energy resources…

Systems and Control · Electrical Eng. & Systems 2024-08-13 Xuan He , Danny H. K. Tsang , Yize Chen
‹ Prev 1 2 3 10 Next ›