English
Related papers

Related papers: Draft-and-Prune: Improving the Reliability of Auto…

200 papers

Inductive reasoning is a core problem-solving capacity: humans can identify underlying principles from a few examples, which robustly generalize to novel scenarios. Recent work evaluates large language models (LLMs) on inductive reasoning…

Machine Learning · Computer Science 2024-06-03 Ruocheng Wang , Eric Zelikman , Gabriel Poesia , Yewen Pu , Nick Haber , Noah D. Goodman

Existing informal language-based (e.g., human language) Large Language Models (LLMs) trained with Reinforcement Learning (RL) face a significant challenge: their verification processes, which provide crucial training signals, are neither…

Computation and Language · Computer Science 2025-10-14 Chuanhao Yan , Fengdi Che , Xuhan Huang , Xu Xu , Xin Li , Yizhi Li , Xingwei Qu , Jingzhe Shi , Chenghua Lin , Yaodong Yang , Binhang Yuan , Hang Zhao , Yu Qiao , Bowen Zhou , Jie Fu

Autoformalization is the task of automatically translating mathematical content written in natural language to a formal language expression. The growing language interpretation capabilities of Large Language Models (LLMs), including in…

Computation and Language · Computer Science 2025-06-16 Lan Zhang , Xin Quan , Andre Freitas

Search-optimization problems are plentiful in scientific and engineering domains. Artificial intelligence has long contributed to the development of search algorithms and declarative programming languages geared towards solving and modeling…

Artificial Intelligence · Computer Science 2022-06-17 Yuliya Lierler

Interactive theorem provers (ITPs) require manual formalization, which is labor-intensive and demands expert knowledge. While automated formalization offers a potential solution, it faces two major challenges: model hallucination (e.g.,…

Artificial Intelligence · Computer Science 2026-03-24 Wangyue Lu , Lun Du , Sirui Li , Ke Weng , Haozhe Sun , Hengyu Liu , Minghe Yu , Tiancheng Zhang , Ge Yu

Large Language Models (LLMs) have demonstrated strong capabilities in natural language understanding and reasoning. However, their ability to perform exact, deterministic computation remains unclear. In this work, we systematically evaluate…

Artificial Intelligence · Computer Science 2026-05-08 Hongkun Yu

Large Reasoning Models (LRMs) have demonstrated remarkable capabilities by scaling up the length of Chain-of-Thought (CoT). However, excessively long reasoning traces pose substantial challenges for training cost and inference latency.…

Machine Learning · Computer Science 2026-01-09 Wenhao Zeng , Yaoning Wang , Chao Hu , Yuling Shi , Chengcheng Wan , Hongyu Zhang , Xiaodong Gu

The problem-solving in automated theorem proving (ATP) can be interpreted as a search problem where the prover constructs a proof tree step by step. In this paper, we propose a deep reinforcement learning algorithm for proof search in…

Machine Learning · Computer Science 2018-11-05 Mitsuru Kusumoto , Keisuke Yahata , Masahiro Sakai

There has been considerable divergence of opinion on the reasoning abilities of Large Language Models (LLMs). While the initial optimism that reasoning might emerge automatically with scale has been tempered thanks to a slew of…

Artificial Intelligence · Computer Science 2024-08-06 Kaya Stechly , Karthik Valmeekam , Subbarao Kambhampati

This work explores the application of deep learning, a machine learning technique that uses deep neural networks (DNN) in its core, to an automated theorem proving (ATP) problem. To this end, we construct a statistical model which…

Artificial Intelligence · Computer Science 2018-05-31 Taro Sekiyama , Kohei Suenaga

Automatic evaluation of large language model (LLM) responses requires not only factual correctness but also clarity, particularly in political question-answering. While recent datasets provide human annotations for clarity and evasion, the…

Computation and Language · Computer Science 2026-01-14 Lavanya Prahallad , Sai Utkarsh Choudarypally , Pragna Prahallad , Pranathi Prahallad

Large Language Models (LLMs) have shown strong performance across a wide range of natural language processing tasks; however, their effectiveness is highly dependent on prompt design, structure, and embedded reasoning signals. Conventional…

Machine Learning · Computer Science 2026-04-07 Shiek Ruksana , Sailesh Kiran Kurra , Thipparthi Sanjay Baradwaj

Structured pruning reduces LLM inference cost by removing low-importance architectural components. This can be viewed as learning a multiplicative gate for each component under an l0 sparsity constraint. Due to the discreteness of the l0…

Machine Learning · Computer Science 2026-05-12 Weiyu Huang , Pengle Zhang , Xiaolu Zhang , Jun Zhou , Jun Zhu , Jianfei Chen

Translating natural language into formal language such as First-Order Logic (FOL) is a foundational challenge in NLP with wide-ranging applications in automated reasoning, misinformation tracking, and knowledge validation. In this paper, we…

Computation and Language · Computer Science 2025-03-07 Abhinav Lalwani , Tasha Kim , Lovish Chopra , Christopher Hahn , Zhijing Jin , Mrinmaya Sachan

We present semantic correctness proofs of forward-mode Automatic Differentiation (AD) for languages with sources of partiality such as partial operations, lazy conditionals on real parameters, iteration, and term and type recursion. We…

Programming Languages · Computer Science 2024-05-28 Matthijs Vákár

Large language models (LLMs) are capable of solving a wide range of tasks, yet they have struggled with reasoning. To address this, we propose $\textbf{Additional Logic Training (ALT)}$, which aims to enhance LLMs' reasoning capabilities by…

Machine Learning · Computer Science 2024-12-24 Terufumi Morishita , Gaku Morio , Atsuki Yamaguchi , Yasuhiro Sogawa

Integrating autonomous and adaptive behavior into software-intensive systems presents significant challenges for software development, as uncertainties in the environment or decision-making processes must be explicitly captured. These…

Programming Languages · Computer Science 2025-12-19 Anastasia Mavridou , Marie Farrell , Gricel Vázquez , Tom Pressburger , Timothy E. Wang , Radu Calinescu , Michael Fisher

Logic programs are a powerful approach for solving NP-Hard problems. However, due to their declarative nature, debugging logic programs poses significant challenges. Unlike procedural paradigms, which allow for step-by-step inspection of…

Software Engineering · Computer Science 2024-10-29 Ricardo Brancas , Vasco Manquinho , Ruben Martins

Rationalization empowers deep learning models with self-explaining capabilities through a cooperative game, where a generator selects a semantically consistent subset of the input as a rationale, and a subsequent predictor makes predictions…

Artificial Intelligence · Computer Science 2023-12-18 Wei Liu , Haozhao Wang , Jun Wang , Zhiying Deng , YuanKai Zhang , Cheng Wang , Ruixuan Li

Deep learning drives a new wave in computing systems and triggers the automation of increasingly complex problems. In particular, Large Language Models (LLMs) have significantly advanced cognitive tasks, often matching or even surpassing…