English
Related papers

Related papers: Autoformalization in the Wild: Assessing LLMs on R…

200 papers

The meaning of complex phrases in natural language is composed of their individual components. The task of compositional generalization evaluates a model's ability to understand new combinations of components. Previous studies trained…

Computation and Language · Computer Science 2023-12-14 Min Zhang , Jianfeng He , Shuo Lei , Murong Yue , Linhang Wang , Chang-Tien Lu

Large Language Models (LLMs) exhibit strong potential in mathematical reasoning, yet their effectiveness is often limited by a shortage of high-quality queries. This limitation necessitates scaling up computational responses through…

Artificial Intelligence · Computer Science 2025-05-20 Jingyue Gao , Runji Lin , Keming Lu , Bowen Yu , Junyang Lin , Jianyu Chen

Reliable autoformalization remains challenging even in the era of large language models (LLMs). The scarcity of high-quality training data is a major bottleneck. Expert annotation requires substantial time and deep expertise in both…

Artificial Intelligence · Computer Science 2026-03-12 Param Biyani , Shashank Kirtania , Yasharth Bajpai , Sumit Gulwani , Ashish Tiwari

Large language models (LLMs) have demonstrated remarkable performance across a wide array of NLP tasks. However, their efficacy is undermined by undesired and inconsistent behaviors, including hallucination, unfaithful reasoning, and toxic…

Computation and Language · Computer Science 2023-08-31 Liangming Pan , Michael Saxon , Wenda Xu , Deepak Nathani , Xinyi Wang , William Yang Wang

Rule-based reasoning over natural language input arises in domains where decisions must be auditable and justifiable: clinical protocols specify eligibility criteria in prose, evidence rules define admissibility through textual conditions,…

Artificial Intelligence · Computer Science 2026-01-06 Albert Sadowski , Jarosław A. Chudziak

Formalising informal mathematical reasoning into formally verifiable code is a significant challenge for large language models. In scientific fields such as physics, domain-specific machinery (\textit{e.g.} Dirac notation, vector calculus)…

Artificial Intelligence · Computer Science 2026-04-28 Jordan Meadows , Lan Zhang , Andre Freitas

Large language models (LLMs) have demonstrated exceptional performance not only in natural language processing tasks but also in a great variety of non-linguistic domains. In diverse optimization scenarios, there is also a rising trend of…

Neural and Evolutionary Computing · Computer Science 2024-07-09 Beichen Huang , Xingyu Wu , Yu Zhou , Jibin Wu , Liang Feng , Ran Cheng , Kay Chen Tan

Motivated by the progress made by large language models (LLMs), we introduce the framework of verbalized machine learning (VML). In contrast to conventional machine learning (ML) models that are typically optimized over a continuous…

Machine Learning · Computer Science 2025-02-17 Tim Z. Xiao , Robert Bamler , Bernhard Schölkopf , Weiyang Liu

Future wireless networks are expected to incorporate diverse services that often lack general mathematical models. To address such black-box network management tasks, the large language model (LLM) optimizer framework, which leverages…

Information Theory · Computer Science 2025-07-04 Hoon Lee , Wentao Zhou , Merouane Debbah , Inkyu Lee

Mathematical reasoning has long represented one of the most fundamental and challenging frontiers in artificial intelligence research. In recent years, large language models (LLMs) have achieved significant advances in this area. This…

Artificial Intelligence · Computer Science 2025-06-11 Peng-Yuan Wang , Tian-Shuo Liu , Chenyang Wang , Yi-Di Wang , Shu Yan , Cheng-Xing Jia , Xu-Hui Liu , Xin-Wei Chen , Jia-Cheng Xu , Ziniu Li , Yang Yu

Ambiguity in natural language poses significant challenges to Large Language Models (LLMs) used for open-domain question answering. LLMs often struggle with the inherent uncertainties of human communication, leading to misinterpretations,…

Computation and Language · Computer Science 2024-11-20 Aryan Keluskar , Amrita Bhattacharjee , Huan Liu

The use of formal language for deductive logical reasoning aligns well with language models (LMs), where translating natural language (NL) into first-order logic (FOL) and employing an external solver results in a verifiable and therefore…

Computation and Language · Computer Science 2026-01-15 Ramya Keerthy Thatikonda , Jiuzhou Han , Wray Buntine , Ehsan Shareghi

Large Language Models (LLMs) are increasingly being used to automate programming tasks. Yet, LLMs' capabilities in reasoning about program semantics are still inadequately studied, leaving significant potential for further exploration. This…

Programming Languages · Computer Science 2025-05-30 Thanh Le-Cong , Bach Le , Toby Murray

Students benefit from math problems contextualized to their interests. Large language models (LLMs) offer promise for efficient personalization at scale. However, LLM-generated personalized problems may often have problems such as…

Computers and Society · Computer Science 2026-04-08 Fareya Ikram , Nischal Ashok Kumar , Junyang Lu , Hunter McNichols , Candace Walkington , Neil Heffernan , Andrew S. Lan

Large Language Models (LLMs) are becoming vital tools that help us solve and understand complex problems by acting as digital assistants. LLMs can generate convincing explanations, even when only given the inputs and outputs of these…

Computation and Language · Computer Science 2024-10-14 Rohan Ajwani , Shashidhar Reddy Javaji , Frank Rudzicz , Zining Zhu

This paper introduces a novel Large Language Models (LLMs)-assisted agent that automatically converts natural-language descriptions of power system optimization scenarios into compact, solver-ready formulations and generates corresponding…

Artificial Intelligence · Computer Science 2025-08-12 Yunkai Hu , Tianqiao Zhao , Meng Yue

Problem-solving has been a fundamental driver of human progress in numerous domains. With advancements in artificial intelligence, Large Language Models (LLMs) have emerged as powerful tools capable of tackling complex problems across…

Machine Learning · Computer Science 2025-05-07 Da Zheng , Lun Du , Junwei Su , Yuchen Tian , Yuqi Zhu , Jintian Zhang , Lanning Wei , Ningyu Zhang , Huajun Chen

Incorporating natural language rationales in the prompt and In-Context Learning (ICL) have led to a significant improvement of Large Language Models (LLMs) performance. However, generating high-quality rationales require human-annotation or…

Machine Learning · Computer Science 2024-06-18 Milan Bhan , Jean-Noel Vittaut , Nicolas Chesneau , Marie-Jeanne Lesot

Although natural language is the default medium for Large Language Models (LLMs), its limited expressive capacity creates a profound bottleneck for complex problem-solving. While recent advancements in AI have relied heavily on scaling,…

Artificial Intelligence · Computer Science 2026-05-13 Zhiqin Yang , Yuhan Liu , Jingwen Fu , Pei Fu , Bo Han , Masashi Sugiyama , Nanning Zheng

To achieve generalized and robust natural-to-formal language conversion (N2F), large language models (LLMs) need to have strong capabilities of decomposition and composition in N2F when faced with an unfamiliar formal language and be able…

Computation and Language · Computer Science 2025-02-24 Ziyao Xu , Houfeng Wang