English
Related papers

Related papers: BFS-Prover: Scalable Best-First Tree Search for LL…

200 papers

The ubiquity and value of tables as semi-structured data across various domains necessitate advanced methods for understanding their complexity and vast amounts of information. Despite the impressive capabilities of large language models…

Computation and Language · Computer Science 2024-11-14 Deyi Ji , Lanyun Zhu , Siqi Gao , Peng Xu , Hongtao Lu , Jieping Ye , Feng Zhao

The creation of Business Process Model and Notation (BPMN) models is a complex and time-consuming task requiring both domain knowledge and proficiency in modeling conventions. Recent advances in large language models (LLMs) have…

Software Engineering · Computer Science 2026-01-30 Chantale Lauer , Peter Pfeiffer , Alexander Rombach , Nijat Mehdiyev

We present an extension of Monte Carlo Tree Search (MCTS) that strongly increases its efficiency for trees with asymmetry and/or loops. Asymmetric termination of search trees introduces a type of uncertainty for which the standard upper…

Machine Learning · Statistics 2018-05-24 Thomas M. Moerland , Joost Broekens , Aske Plaat , Catholijn M. Jonker

With the rapid advancement of test-time compute search strategies to improve the mathematical problem-solving capabilities of large language models (LLMs), the need for building robust verifiers has become increasingly important. However,…

Computation and Language · Computer Science 2025-03-11 Jung Hyun Lee , June Yong Yang , Byeongho Heo , Dongyoon Han , Kyungsu Kim , Eunho Yang , Kang Min Yoo

Levin Tree Search (LTS) is a search algorithm that makes use of a policy (a probability distribution over actions) and comes with a theoretical guarantee on the number of expansions before reaching a goal node, depending on the quality of…

Machine Learning · Computer Science 2024-11-13 Laurent Orseau , Marcus Hutter , Levi H. S. Lelis

While model serving has unlocked unprecedented capabilities, the high cost of serving large-scale models continues to be a significant barrier to widespread accessibility and rapid innovation. Compiler optimizations have long driven…

Machine Learning · Computer Science 2026-02-05 Annabelle Sujun Tang , Christopher Priebe , Rohan Mahapatra , Lianhui Qin , Hadi Esmaeilzadeh

Breadth-first Search (BFS) is one of the most important graph processing subroutines, especially for computing the unweighted distance. Many applications may require running BFS from multiple sources. Sequentially, when running BFS on a…

Data Structures and Algorithms · Computer Science 2024-10-29 Letong Wang , Guy Blelloch , Yan Gu , Yihan Sun

Large language models (LLMs) have shown promise in proving formal theorems using proof assistants such as Lean. However, existing methods are difficult to reproduce or build on, due to private code, data, and large compute requirements.…

Machine Learning · Computer Science 2023-10-30 Kaiyu Yang , Aidan M. Swope , Alex Gu , Rahul Chalamala , Peiyang Song , Shixing Yu , Saad Godil , Ryan Prenger , Anima Anandkumar

Safety-critical infrastructures must operate safely and reliably. Fault tree analysis is a widespread method used to assess risks in these systems: fault trees (FTs) are required - among others - by the Federal Aviation Authority, the…

Software Engineering · Computer Science 2024-06-04 Stefano M. Nicoletti , E. Moritz Hahn , Marielle Stoelinga

This paper presents an advanced mathematical problem-solving framework, LLaMA-Berry, for enhancing the mathematical reasoning ability of Large Language Models (LLMs). The framework combines Monte Carlo Tree Search (MCTS) with iterative…

Artificial Intelligence · Computer Science 2024-11-22 Di Zhang , Jianbo Wu , Jingdi Lei , Tong Che , Jiatong Li , Tong Xie , Xiaoshui Huang , Shufei Zhang , Marco Pavone , Yuqiang Li , Wanli Ouyang , Dongzhan Zhou

Tabular data high-stakes critical decision-making in domains such as finance, healthcare, and scientific discovery. Yet, learning effectively from tabular data in few-shot settings, where labeled examples are scarce, remains a fundamental…

Machine Learning · Computer Science 2026-01-19 Zhihan Yang , Jiaqi Wei , Xiang Zhang , Haoyu Dong , Yiwen Wang , Xiaoke Guo , Pengkun Zhang , Yiwei Xu , Chenyu You

Monte Carlo tree search (MCTS) is one of the most capable online search algorithms for sequential planning tasks, with significant applications in areas such as resource allocation and transit planning. Despite its strong performance in…

Artificial Intelligence · Computer Science 2024-10-31 Ziyan An , Hendrik Baier , Abhishek Dubey , Ayan Mukhopadhyay , Meiyi Ma

Monte Carlo Tree Search (MCTS) has been proposed as a transformative approach to join-order optimization in database query processing, with recent frameworks such as AlphaJoin and HyperQO claiming to outperform traditional methods. However,…

We introduce Kimina-Prover Preview, a large language model that pioneers a novel reasoning-driven exploration paradigm for formal theorem proving, as showcased in this preview release. Trained with a large-scale reinforcement learning…

Knob tuning plays a critical role in improving the performance of permissioned blockchains. However, efficient tuning remains challenging due to the architectural complexity of blockchains and the semantic gap between knob-specific logic…

Databases · Computer Science 2026-05-25 Yaoyi Deng , Chongyang Tao , Mingxuan Li , Xuelian Lin , Han Sun , Mingchao Wan , Shuai Ma

Feature selection (FS) remains essential for building accurate and interpretable detection models, particularly in high-dimensional malware datasets. Conventional FS methods such as Extra Trees, Variance Threshold, Tree-based models,…

Machine Learning · Computer Science 2026-02-11 Naveen Gill , Ajvad Haneef K , Madhu Kumar S D

This paper presents Generalized Proof-Number Monte-Carlo Tree Search: a generalization of recently proposed combinations of Proof-Number Search (PNS) with Monte-Carlo Tree Search (MCTS), which use (dis)proof numbers to bias UCB1-based…

Artificial Intelligence · Computer Science 2025-06-17 Jakub Kowalski , Dennis J. N. J. Soemers , Szymon Kosakowski , Mark H. M. Winands

Large Language Models (LLMs) demonstrate impressive mathematical reasoning abilities, but their solutions frequently contain errors that cannot be automatically checked. Formal theorem proving systems such as Lean 4 offer automated…

Artificial Intelligence · Computer Science 2026-03-18 Sumanth Varambally , Thomas Voice , Yanchao Sun , Zhifeng Chen , Rose Yu , Ke Ye

Levin Tree Search (LTS) (Orseau et al., 2018) is a search algorithm for deterministic environments that uses a user-specified policy to guide the search. It comes with a formal guarantee on the number of search steps (node visits) for…

Artificial Intelligence · Computer Science 2025-03-12 Laurent Orseau , Marcus Hutter , Levi H. S. Lelis

Tree matching techniques have been investigated in many fields, including web data mining and extraction, as a key component to analyze the content of web documents, existing tree matching approaches, like Tree-Edit Distance (TED) or…

Databases · Computer Science 2024-06-28 Sacha Brisset , Romain Rouvoy , Renaud Pawlak , Lionel Seinturier