English
Related papers

Related papers: Regular Tree Search for Simulation Optimization

200 papers

Computing an optimal classification tree that provably maximizes training performance within a given size limit, is NP-hard, and in practice, most state-of-the-art methods do not scale beyond computing optimal trees of depth three.…

Machine Learning · Computer Science 2025-01-15 Catalin E. Brita , Jacobus G. M. van der Linden , Emir Demirović

We investigate optimizing quantum tree search algorithms by employing a nested Grover Algorithm. This approach seeks to enhance results compared to previous Grover-based methods by expanding the tree of partial assignments to a specific…

Quantum Physics · Physics 2025-09-10 Andreas Wichert

Decision tree optimization is notoriously difficult from a computational perspective but essential for the field of interpretable machine learning. Despite efforts over the past 40 years, only recently have optimization breakthroughs been…

Machine Learning · Computer Science 2022-11-24 Jimmy Lin , Chudi Zhong , Diane Hu , Cynthia Rudin , Margo Seltzer

Robots have become increasingly prevalent in dynamic and crowded environments such as airports and shopping malls. In these scenarios, the critical challenges for robot navigation are reliability and timely arrival at predetermined…

Robotics · Computer Science 2023-09-21 Zhirui Sun , Boshu Lei , Peijia Xie , Fugang Liu , Junjie Gao , Ying Zhang , Jiankun Wang

In this paper, we propose a stochastic search algorithm for solving general optimization problems with little structure. The algorithm iteratively finds high quality solutions by randomly sampling candidate solutions from a parameterized…

Optimization and Control · Mathematics 2013-01-08 Enlu Zhou , Jiaqiao Hu

Tree search is a fundamental tool for planning, as many sequential decision-making problems can be framed as searching over tree-structured spaces. We propose an uncertainty-guided tree search algorithm for settings where the reward…

Machine Learning · Computer Science 2025-09-05 Julia Grosse , Ruotian Wu , Ahmad Rashid , Cheng Zhang , Philipp Hennig , Pascal Poupart , Agustinus Kristiadi

We consider the problem of using a heuristic policy to improve the value approximation by the Upper Confidence Bound applied in Trees (UCT) algorithm in non-adversarial settings such as planning with large-state space Markov Decision…

Artificial Intelligence · Computer Science 2012-06-27 Truong-Huy Dinh Nguyen , Wee-Sun Lee , Tze-Yun Leong

In recent years, significant progress has been made on algorithms for learning optimal decision trees, primarily in the context of binary features. Extending these methods to continuous features remains substantially more challenging due to…

Machine Learning · Computer Science 2026-01-22 Harold Kiossou , Pierre Schaus , Siegfried Nijssen

Recent advances in bandit tools and techniques for sequential learning are steadily enabling new applications and are promising the resolution of a range of challenging related problems. We study the game tree search problem, where the goal…

Machine Learning · Statistics 2017-11-07 Emilie Kaufmann , Wouter Koolen

Decision tree optimization is fundamental to interpretable machine learning. The most popular approach is to greedily search for the best feature at every decision point, which is fast but provably suboptimal. Recent approaches find the…

Machine Learning · Computer Science 2025-11-19 Varun Babbar , Hayden McTavish , Cynthia Rudin , Margo Seltzer

This paper proposes a new algorithm for learning accurate tree-based models while ensuring the existence of recourse actions. Algorithmic Recourse (AR) aims to provide a recourse action for altering the undesired prediction result given by…

Machine Learning · Computer Science 2024-06-04 Kentaro Kanamori , Takuya Takagi , Ken Kobayashi , Yuichi Ike

We introduce an adaptive tree search algorithm, that can find high-scoring outputs under translation models that make no assumptions about the form or structure of the search objective. This algorithm -- a deterministic variant of Monte…

Computation and Language · Computer Science 2022-02-24 Wang Ling , Wojciech Stokowiec , Domenic Donato , Laurent Sartran , Lei Yu , Austin Matthews , Chris Dyer

Standard planners for sequential decision making (including Monte Carlo planning, tree search, dynamic programming, etc.) are constrained by an implicit sequential planning assumption: The order in which a plan is constructed is the same in…

Policy tree search is a family of tree search algorithms that use a policy to guide the search. These algorithms provide guarantees on the number of expansions required to solve a given problem that are based on the quality of the policy.…

Artificial Intelligence · Computer Science 2025-12-03 Jake Tuero , Michael Buro , Levi H. S. Lelis

Monte-Carlo planning and Reinforcement Learning (RL) are essential to sequential decision making. The recent AlphaGo and AlphaZero algorithms have shown how to successfully combine these two paradigms in order to solve large scale…

Machine Learning · Computer Science 2021-02-17 Tuan Dam , Carlo D'Eramo , Jan Peters , Joni Pajarinen

Parallel surrogate optimization algorithms have proven to be efficient methods for solving expensive noisy optimization problems. In this work we develop a new parallel surrogate optimization algorithm (ProSRS), using a novel tree-based…

Optimization and Control · Mathematics 2019-08-22 Chenchao Shou , Matthew West

While modern biotechnologies allow synthesizing new proteins and function measurements at scale, efficiently exploring a protein sequence space and engineering it remains a daunting task due to the vast sequence space of any given protein.…

Biomolecules · Quantitative Biology 2024-01-15 Jiahao Qiu , Hui Yuan , Jinghong Zhang , Wentao Chen , Huazheng Wang , Mengdi Wang

We consider unconstrained randomized optimization of convex objective functions. We analyze the Random Pursuit algorithm, which iteratively computes an approximate solution to the optimization problem by repeated optimization over a…

Optimization and Control · Mathematics 2012-05-25 Sebastian U. Stich , Christian L. Müller , Bernd Gärtner

We develop a theoretical framework for the analysis of oblique decision trees, where the splits at each decision node occur at linear combinations of the covariates (as opposed to conventional tree constructions that force axis-aligned…

Statistics Theory · Mathematics 2023-09-01 Matias D. Cattaneo , Rajita Chandak , Jason M. Klusowski

Tree search has recently emerged as a powerful framework for aligning generative models with task-specific rewards at test time. Applying tree search to Masked Diffusion Language Models, however, introduces two key challenges: (i) parallel…

Computation and Language · Computer Science 2025-09-30 Zichao Yu , Ming Li , Wenyi Zhang , Weiguo Gao