English
Related papers

Related papers: Solving Formal Math Problems by Decomposition and …

200 papers

A key challenge in automated formal reasoning is the intractable search space, which grows exponentially with the depth of the proof. This branching is caused by the large number of candidate proof tactics which can be applied to a given…

Artificial Intelligence · Computer Science 2025-10-29 Sean Lamont , Christian Walder , Amir Dezfouli , Paul Montague , Michael Norrish

Formal logic enables computers to reason in natural language by representing sentences in symbolic forms and applying rules to derive conclusions. However, in what our study characterizes as "rulebreaker" scenarios, this method can lead to…

Computation and Language · Computer Science 2025-08-18 Jason Chan , Robert Gaizauskas , Zhixue Zhao

Large language models (LLMs) have achieved reasonable quality improvements in machine translation (MT). However, most current research on MT-LLMs still faces significant challenges in maintaining translation consistency and accuracy when…

Computation and Language · Computer Science 2025-03-06 Yutong Wang , Jiali Zeng , Xuebo Liu , Derek F. Wong , Fandong Meng , Jie Zhou , Min Zhang

Deductive verification provides strong correctness guarantees for code by extracting verification conditions (VCs) and writing formal proofs for them. The expertise-intensive task of VC proving is the main bottleneck in this process, and…

Software Engineering · Computer Science 2026-03-24 Huan Zhao , Haoxin Tu , Zhengyao Liu , Martin Rinard , Abhik Roychoudhury

Large language models (LLMs) have recently shown strong progress on scientific reasoning, yet two major bottlenecks remain. First, explicit retrieval fragments reasoning, imposing a hidden "tool tax" of extra tokens and steps. Second,…

We present a novel approach to formalise and solve search-based problems using large language models, which significantly improves upon previous state-of-the-art results. We demonstrate the efficacy of this approach on the logic puzzles…

Artificial Intelligence · Computer Science 2025-02-25 Pascal Kesseli , Peter O'Hearn , Ricardo Silveira Cabral

Mathematical problem-solving is a key field in artificial intelligence (AI) and a critical benchmark for evaluating the capabilities of large language models (LLMs). While extensive research has focused on mathematical problem-solving, most…

Computation and Language · Computer Science 2025-01-03 Ziye Chen , Hao Qi

Conventional mechanical design follows an iterative process in which initial concepts are refined through cycles of expert assessment and resource-intensive Finite Element Method (FEM) analysis to meet performance goals. While machine…

Machine Learning · Computer Science 2025-05-02 Yayati Jadhav , Amir Barati Farimani

Chain-of-Thought (CoT) prompting has become the de facto method to elicit reasoning capabilities from large language models (LLMs). However, to mitigate hallucinations in CoT that are notoriously difficult to detect, current methods such as…

Computation and Language · Computer Science 2025-06-06 Chengwu Liu , Ye Yuan , Yichun Yin , Yan Xu , Xin Xu , Zaoyu Chen , Yasheng Wang , Lifeng Shang , Qun Liu , Ming Zhang

The integration of experimental technologies with large language models (LLMs) is transforming scientific research. It positions AI as a versatile research assistant rather than a mere problem-solving tool. In the field of power systems,…

Computation and Language · Computer Science 2025-05-20 Mengshuo Jia , Zeyu Cui , Gabriela Hug

Simulations, although powerful in accurately replicating real-world systems, often remain inaccessible to non-technical users due to their complexity. Conversely, large language models (LLMs) provide intuitive, language-based interactions…

Computation and Language · Computer Science 2025-05-22 Jacob Kleiman , Kevin Frank , Joseph Voyles , Sindy Campagna

The popularity of Large Language Models (LLMs) have unleashed a new age ofLanguage Agents for solving a diverse range of tasks. While contemporary frontier LLMs are capable enough to power reasonably good Language agents, the closed-API…

Computation and Language · Computer Science 2024-10-11 Priyanshu Gupta , Shashank Kirtania , Ananya Singha , Sumit Gulwani , Arjun Radhakrishna , Sherry Shi , Gustavo Soares

Generative large language models (LLMs) with instruct training such as GPT-4 can follow human-provided instruction prompts and generate human-like responses to these prompts. Apart from natural language responses, they have also been found…

Artificial Intelligence · Computer Science 2023-09-29 Sumit Kumar Jha , Susmit Jha , Patrick Lincoln , Nathaniel D. Bastian , Alvaro Velasquez , Rickard Ewetz , Sandeep Neema

Mathematical reasoning and optimization are fundamental to artificial intelligence and computational problem-solving. Recent advancements in Large Language Models (LLMs) have significantly improved AI-driven mathematical reasoning, theorem…

Artificial Intelligence · Computer Science 2025-03-25 Ali Forootani

Large Language Model (LLM) reasoning for complex tasks inherently involves a trade-off between solution accuracy and computational efficiency. The subsequent step of verification, while intended to improve performance, further complicates…

Artificial Intelligence · Computer Science 2025-05-20 Jianyuan Zhong , Zeju Li , Zhijian Xu , Xiangyu Wen , Kezhi Li , Qiang Xu

Large Language Models (LLMs) have shown remarkable ability in solving complex tasks, making them a promising tool for enhancing tabular learning. However, existing LLM-based methods suffer from high resource requirements, suboptimal…

Machine Learning · Computer Science 2025-05-12 Ruxue Shi , Hengrui Gu , Xu Shen , Xin Wang

We introduce SELF-DISCOVER, a general framework for LLMs to self-discover the task-intrinsic reasoning structures to tackle complex reasoning problems that are challenging for typical prompting methods. Core to the framework is a…

Artificial Intelligence · Computer Science 2024-02-07 Pei Zhou , Jay Pujara , Xiang Ren , Xinyun Chen , Heng-Tze Cheng , Quoc V. Le , Ed H. Chi , Denny Zhou , Swaroop Mishra , Huaixiu Steven Zheng

Large Language Models (LLMs) present an intriguing avenue for exploration in the field of formal theorem proving. Nevertheless, their full potential, particularly concerning the mitigation of hallucinations and refinement through prover…

Computation and Language · Computer Science 2024-08-27 Chuanyang Zheng , Haiming Wang , Enze Xie , Zhengying Liu , Jiankai Sun , Huajian Xin , Jianhao Shen , Zhenguo Li , Yu Li

Logical reasoning is a fundamental aspect of human intelligence and a key component of tasks like problem-solving and decision-making. Recent advancements have enabled Large Language Models (LLMs) to potentially exhibit reasoning…

Computation and Language · Computer Science 2023-11-13 Jiazhan Feng , Ruochen Xu , Junheng Hao , Hiteshi Sharma , Yelong Shen , Dongyan Zhao , Weizhu Chen

Deep research agents increasingly automate complex information-seeking tasks, producing evidence-grounded reports via multi-step reasoning, tool use, and synthesis. Their growing role demands scalable, reliable evaluation, positioning…

Computation and Language · Computer Science 2026-05-20 Leyao Wang , Yanan He , Peng Chen , Asaf Yehudai , Yixin Liu , Rex Ying , Michal Shmueli-Scheuer , Arman Cohan