English
Related papers

Related papers: Consistent Autoformalization for Constructing Math…

200 papers

Recent advancements in Large Language Models (LLMs) have shown significant progress in understanding complex natural language. One important application of LLM is LLM-based AI Agent, which leverages the ability of LLM as well as external…

Computation and Language · Computer Science 2024-07-19 Zelong Li , Shuyuan Xu , Kai Mei , Wenyue Hua , Balaji Rama , Om Raheja , Hao Wang , He Zhu , Yongfeng Zhang

Autoformalisation, the task of expressing informal mathematical statements in formal language, is often viewed as a direct translation process. This, however, disregards a critical preceding step: conjecturing. Many mathematical problems…

Computation and Language · Computer Science 2025-10-15 Jasivan Alex Sivakumar , Philipp Borchert , Ronald Cardenas , Gerasimos Lampouras

Retrieval-augmented generation (RAG) enhances the question-answering (QA) abilities of large language models (LLMs) by integrating external knowledge. However, adapting general-purpose RAG systems to specialized fields such as science and…

Computation and Language · Computer Science 2025-01-28 Ran Xu , Hui Liu , Sreyashi Nag , Zhenwei Dai , Yaochen Xie , Xianfeng Tang , Chen Luo , Yang Li , Joyce C. Ho , Carl Yang , Qi He

In the rapidly evolving field of Explainable Natural Language Processing (NLP), textual explanations, i.e., human-like rationales, are pivotal for explaining model predictions and enriching datasets with interpretable labels. Traditional…

Computation and Language · Computer Science 2025-11-12 Mahdi Dhaini , Juraj Vladika , Ege Erdogan , Zineb Attaoui , Gjergji Kasneci

Compliance testing in highly regulated domains is crucial but largely manual, requiring domain experts to translate complex regulations into executable test cases. While large language models (LLMs) show promise for automation, their…

Software Engineering · Computer Science 2026-01-16 Zhiyi Xue , Xiaohong Chen , Min Zhang

AutomationML (AML) enables standardized data exchange in engineering, yet existing recommendations for proper AML modeling are typically formulated as informal and textual constraints. These constraints cannot be validated automatically…

Artificial Intelligence · Computer Science 2025-06-13 Tom Westermann , Aljosha Köcher , Felix Gehlhoff

Automating the formalization of mathematical statements for theorem proving remains a major challenge for Large Language Models (LLMs). LLMs struggle to identify and utilize the prerequisite mathematical knowledge and its corresponding…

Artificial Intelligence · Computer Science 2026-04-08 Meiru Zhang , Philipp Borchert , Milan Gritta , Gerasimos Lampouras

Large language models (LLMs) have demonstrated remarkable potential across a broad range of applications. However, producing reliable text that faithfully represents data remains a challenge. While prior work has shown that task-specific…

Human-Computer Interaction · Computer Science 2026-03-16 Amandine M. Caut , Amy Rouillard , Beimnet Zenebe , Matthias Green , Ágúst Pálmason Morthens , David J. T. Sumpter

Large language models (LLMs) have demonstrated impressive capabilities in natural language generation. However, their output quality can be inconsistent, posing challenges for generating natural language from logical forms (LFs). This task…

Computation and Language · Computer Science 2023-09-22 Levon Haroutunian , Zhuang Li , Lucian Galescu , Philip Cohen , Raj Tumuluri , Gholamreza Haffari

The convergence of deep learning and formal mathematics has spurred research in formal verification. Statement autoformalization, a crucial first step in this process, aims to translate informal descriptions into machine-verifiable…

Artificial Intelligence · Computer Science 2026-01-05 Shaoqi Wang , Lu Yu , Siwei Lou , Feng Yan , Chunjie Yang , Qing Cui , Jun Zhou

Autoformalization aims to produce formal statements that compile and faithfully preserve the intended meaning of informal mathematics. Yet standard single-output evaluation protocols collapse a many-to-many problem into a single-output…

Artificial Intelligence · Computer Science 2026-05-29 Haijian Lu , Wei Wang , Jing Liu

Automated testing plays a crucial role in ensuring software security. It heavily relies on formal specifications to validate the correctness of the system behavior. However, the main approach to defining these formal specifications is…

Software Engineering · Computer Science 2025-04-03 Hui Li , Zhen Dong , Siao Wang , Hui Zhang , Liwei Shen , Xin Peng , Dongdong She

This paper introduces a novel framework that leverages large language models (LLMs) for machine translation (MT). We start with one conjecture: an ideal translation should contain complete and accurate information for a strong enough LLM to…

Computation and Language · Computer Science 2024-11-06 Jianqiao Wangni

This paper explores the potential of large language models (LLMs) for task automation in the provision of technical services in the production machinery sector. By focusing on text correction, summarization, and question answering, the…

General Economics · Economics 2025-05-19 Jochen Wulf , Juerg Meierhofer

Table-to-text systems generate natural language statements from structured data like tables. While end-to-end techniques suffer from low factual correctness (fidelity), a previous study reported gains when using manual logical forms (LF)…

Computation and Language · Computer Science 2025-01-07 Iñigo Alonso , Eneko Agirre

When developing text classification models for real world applications, one major challenge is the difficulty to collect sufficient data for all text classes. In this work, we address this challenge by utilizing large language models (LLMs)…

Computation and Language · Computer Science 2025-08-15 Chenhao Xue , Yuanzhe Jin , Adrian Carrasco-Revilla , Joyraj Chakraborty , Min Chen

Graph model generation from natural language description is an important task with many applications in software engineering. With the rise of large language models (LLMs), there is a growing interest in using LLMs for graph model…

Software Engineering · Computer Science 2025-08-04 Boqi Chen , Ou Wei , Bingzhou Zheng , Gunter Mussbacher

This research pioneers the use of fine-tuned Large Language Models (LLMs) to automate Systematic Literature Reviews (SLRs), presenting a significant and novel contribution in integrating AI to enhance academic research methodologies. Our…

Computation and Language · Computer Science 2025-02-21 Teo Susnjak , Peter Hwang , Napoleon H. Reyes , Andre L. C. Barczak , Timothy R. McIntosh , Surangika Ranathunga

Automatic math correction aims to check students' solutions to mathematical problems via artificial intelligence technologies. Most existing studies focus on judging the final answer at the problem level, while they ignore detailed feedback…

Computation and Language · Computer Science 2025-03-25 Junsong Li , Jie Zhou , Yutao Yang , Bihao Zhan , Qianjun Pan , Yuyang Ding , Qin Chen , Jiang Bo , Xin Lin , Liang He

Recent large language models (LLMs) have achieved impressive reasoning milestones but continue to struggle with high computational costs, logical inconsistencies, and sharp performance degradation on high-complexity problems. While…

Artificial Intelligence · Computer Science 2026-05-01 Adam Ishay , Joohyung Lee