English
Related papers

Related papers: ProofNet++: A Neuro-Symbolic System for Formal Pro…

200 papers

Natural language explanations represent a proxy for evaluating explanation-based and multi-step Natural Language Inference (NLI) models. However, assessing the validity of explanations for NLI is challenging as it typically involves the…

Computation and Language · Computer Science 2024-10-14 Xin Quan , Marco Valentino , Louise A. Dennis , André Freitas

Neural theorem proving has advanced rapidly in the past year, reaching IMO gold-medalist capabilities and producing formal proofs that span thousands of lines. Although such proofs are mechanically verified by formal systems like Lean,…

Machine Learning · Computer Science 2025-10-20 Alex Gu , Bartosz Piotrowski , Fabian Gloeckle , Kaiyu Yang , Aram H. Markosyan

Large Language Models (LLMs) often struggle with complex mathematical reasoning, where prose-based generation leads to unverified and arithmetically unsound solutions. Current prompting strategies like Chain of Thought still operate within…

Computation and Language · Computer Science 2026-01-27 Sina Bagheri Nezhad , Yao Li , Ameeta Agrawal

The combination of verifiable languages and LLMs has significantly influenced both the mathematical and computer science communities because it provides a rigorous foundation for theorem proving. Recent advancements in the field provide…

Artificial Intelligence · Computer Science 2026-01-23 Hanning Zhang , Ruida Wang , Rui Pan , Wenyuan Wang , Bingxu Meng , Tong Zhang

Translating human-written mathematical theorems and proofs from natural language (NL) into formal languages (FLs) like Lean 4 has long been a significant challenge for AI. Most state-of-the-art methods either focus on theorem-only NL-to-FL…

Logic in Computer Science · Computer Science 2026-03-31 Prithwish Jana , Kaan Kale , Ahmet Ege Tanriverdi , Cruise Song , Sriram Vishwanath , Vijay Ganesh

Reasoning is a fundamental substrate for solving novel and complex problems. Deliberate efforts in learning and developing frameworks around System 2 reasoning have made great strides, yet problems of sufficient complexity remain largely…

Computation and Language · Computer Science 2024-10-18 Matthew Ho , Vincent Zhu , Xiaoyin Chen , Moksh Jain , Nikolay Malkin , Edwin Zhang

Language models have become increasingly powerful tools for formal mathematical reasoning. However, most existing approaches rely exclusively on either large general-purpose models or smaller specialized models, each with distinct…

Artificial Intelligence · Computer Science 2025-07-22 Nicolas Wischermann , Claudio Mayrink Verdun , Gabriel Poesia , Francesco Noseda

Automating formal proofs of combinatorial identities is challenging for LLM-based provers, as long-horizon proof planning is required and unconstrained search quickly explodes. Symbolic methods such as the Wilf-Zeilberger (WZ) method can…

Machine Learning · Computer Science 2026-05-07 Beibei Xiong , Hangyu Lv , Junqi Liu , Yisen Wang , Shaoshi Chen , Jianlin Wang , Zhengfeng Yang , Lihong Zhi

Despite their linguistic competence, Large Language Models (LLMs) often struggle to reason reliably and flexibly. To identify these shortcomings, we introduce the Non-Linear Reasoning (NLR) dataset, a collection of 55 unique, hand-designed…

Computation and Language · Computer Science 2025-12-02 Nasim Borazjanizadeh , Steven T. Piantadosi

Formal mathematics libraries are rapidly expanding, creating a growing need to refactor verified proofs for maintainability and to improve training data quality for neural provers. However, scalable proof optimization is hindered by…

Artificial Intelligence · Computer Science 2026-05-25 Riyaz Ahuja , Tate Rowney , Jeremy Avigad , Sean Welleck

LLMs can perform multi-step reasoning through Chain-of-Thought (CoT), but they cannot reliably verify their own logic. Even when they reach correct answers, the underlying reasoning may be flawed, undermining trust in high-stakes scenarios.…

Artificial Intelligence · Computer Science 2025-11-07 Yu Feng , Nathaniel Weir , Kaj Bostrom , Sam Bayless , Darion Cassel , Sapana Chaudhary , Benjamin Kiesl-Reiter , Huzefa Rangwala

There is growing excitement about building software verifiers, synthesizers, and other Automated Reasoning (AR) tools by combining traditional symbolic algorithms and Large Language Models (LLMs). Unfortunately, the current practice for…

Artificial Intelligence · Computer Science 2025-07-09 Aaron Bembenek

We propose a hybrid architecture that integrates decision tree-based symbolic reasoning with the generative capabilities of large language models (LLMs) within a coordinated multi-agent framework. Unlike prior approaches that loosely couple…

Artificial Intelligence · Computer Science 2025-08-08 Andrew Kiruluta

Large language models (LLMs) have demonstrated strong potential in long-horizon decision-making tasks, such as embodied manipulation and web interaction. However, agents frequently struggle with endless trial-and-error loops or deviate from…

Artificial Intelligence · Computer Science 2026-04-06 Bin Wen , Ruoxuan Zhang , Yang Chen , Hongxia Xie , Lan-Zhe Guo

LLMs deployed in high-stakes domains face fundamental reliability challenges: hallucinations, inconsistencies, and privacy vulnerabilities introduce unacceptable risks where errors carry legal, financial, or safety consequences. This paper…

Artificial Intelligence · Computer Science 2026-05-27 Paul Sigloch , Christoph Benzmüller

Neuro-symbolic NLP methods aim to leverage the complementary strengths of large language models and formal logical solvers. However, current approaches are mostly static in nature, i.e., the integration of a target solver is predetermined…

Computation and Language · Computer Science 2025-10-09 Lei Xu , Pierre Beckmann , Marco Valentino , André Freitas

Large Language Models (LLMs) have demonstrated impressive progress in complex reasoning tasks, largely driven by the Chain-of-Thought (CoT) paradigm, which decomposes difficult problems into intermediate steps. However, CoT reasoning…

Symbolic Computation · Computer Science 2026-05-26 Rui Wang , Zeming Wei , Yihao Zhang , Xiaokun Luan

Linear logic and the linear {\lambda}-calculus have a long standing tradition in the study of natural language form and meaning. Among the proof calculi of linear logic, proof nets are of particular interest, offering an attractive…

Computation and Language · Computer Science 2021-01-19 Konstantinos Kogkalidis , Michael Moortgat , Richard Moot

Large Language Models perform well at natural language interpretation and reasoning, but their inherent stochasticity limits their adoption in regulated industries like finance and healthcare that operate under strict policies. To address…

Large language models (LLMs) and theorem provers (TPs) can be effectively combined for verifiable natural language inference (NLI). However, existing approaches rely on a fixed logical formalism, a feature that limits robustness and…

Artificial Intelligence · Computer Science 2026-01-12 Ali Farjami , Luca Redondi , Marco Valentino