English
Related papers

Related papers: Bridging LLM Planning Agents and Formal Methods: A…

200 papers

We present a framework in which a large language model (LLM) acts as an online adaptive controller for SIMP topology optimization, replacing conventional fixed-schedule continuation with real-time, state-conditioned parameter decisions. At…

Computational Engineering, Finance, and Science · Computer Science 2026-05-18 Shaoliang Yang , Jun Wang , Yunsheng Wang

Large Language Models (LLMs) have drawn a lot of attention due to their strong performance on a wide range of natural language tasks, since the release of ChatGPT in November 2022. LLMs' ability of general-purpose language understanding and…

Computation and Language · Computer Science 2025-03-25 Shervin Minaee , Tomas Mikolov , Narjes Nikzad , Meysam Chenaghlu , Richard Socher , Xavier Amatriain , Jianfeng Gao

We develop new conformal inference methods for obtaining validity guarantees on the output of large language models (LLMs). Prior work in conformal language modeling identifies a subset of the text that satisfies a high-probability…

Machine Learning · Statistics 2024-11-01 John J. Cherian , Isaac Gibbs , Emmanuel J. Candès

With recent advancements in natural language processing, Large Language Models (LLMs) have emerged as powerful tools for various real-world applications. Despite their prowess, the intrinsic generative abilities of LLMs may prove…

Artificial Intelligence · Computer Science 2025-12-30 Jingqing Ruan , Yihong Chen , Bin Zhang , Zhiwei Xu , Tianpeng Bao , Guoqing Du , Shiwei Shi , Hangyu Mao , Ziyue Li , Xingyu Zeng , Rui Zhao

Large Language Models (LLMs) demonstrate impressive mathematical reasoning abilities, but their solutions frequently contain errors that cannot be automatically checked. Formal theorem proving systems such as Lean 4 offer automated…

Artificial Intelligence · Computer Science 2026-03-18 Sumanth Varambally , Thomas Voice , Yanchao Sun , Zhifeng Chen , Rose Yu , Ke Ye

In modern industry, dynamic environments and the complexity of modular and reconfigurable resources require automated planning of process sequences. Capability-based planning approaches address this by automatically generating plans from…

Artificial Intelligence · Computer Science 2026-05-28 Luis Miguel Vieira da Silva , Nicolas König , Felix Gehlhoff

Large Language Models (LLMs) such as ChatGPT have shown remarkable abilities in producing human-like text. However, it is unclear how accurately these models internalize concepts that shape human thought and behavior. Here, we developed a…

Machine Learning · Computer Science 2025-07-01 Hiro Taiyo Hamada , Ippei Fujisawa , Genji Kawakita , Yuki Yamada

Pre-trained transformer language models (TLMs) have recently refashioned natural language processing (NLP): Most state-of-the-art NLP models now operate on top of TLMs to benefit from contextualization and knowledge induction. To explain…

Computation and Language · Computer Science 2020-07-09 Karolina Zaczynska , Nils Feldhus , Robert Schwarzenberg , Aleksandra Gabryszak , Sebastian Möller

Intrigued by the claims of emergent reasoning capabilities in LLMs trained on general web corpora, in this paper, we set out to investigate their planning capabilities. We aim to evaluate (1) the effectiveness of LLMs in generating plans…

Artificial Intelligence · Computer Science 2023-11-27 Karthik Valmeekam , Matthew Marquez , Sarath Sreedharan , Subbarao Kambhampati

We present an end-to-end framework for planning supported by verifiers. An orchestrator receives a human specification written in natural language and converts it into a PDDL (Planning Domain Definition Language) model, where the domain and…

Artificial Intelligence · Computer Science 2026-05-11 Emanuele La Malfa , Ping Zhu , Samuele Marro , Sara Bernardini , Michael Wooldridge

Large language models (LLMs) have achieved remarkable success across a wide spectrum of tasks; however, they still face limitations in scenarios that demand long-term planning and spatial reasoning. To facilitate this line of research, in…

Computation and Language · Computer Science 2025-02-25 Mohamed Aghzal , Erion Plaku , Ziyu Yao

Large language models (LLMs) have proven to be highly effective for solving complex reasoning tasks. Surprisingly, their capabilities can often be improved by iterating on previously generated solutions. In this context, a reasoning plan…

Artificial Intelligence · Computer Science 2025-12-05 MohammadHossein Bateni , Vincent Cohen-Addad , Yuzhou Gu , Silvio Lattanzi , Simon Meierhans , Christopher Mohri

Large language models (LLMs) are increasingly used as evaluators for natural language generation, applying human-defined rubrics to assess system outputs. However, human rubrics are often static and misaligned with how models internally…

Computation and Language · Computer Science 2026-02-10 Clemencia Siro , Pourya Aliannejadi , Mohammad Aliannejadi

Converting high-level tasks described by natural language into formal specifications like Linear Temporal Logic (LTL) is a key step towards providing formal safety guarantees over cyber-physical systems (CPS). While the compliance of the…

Logic in Computer Science · Computer Science 2026-04-28 Junle Li , Siqi Chen , Jiakai Li , Meiqi Tian , Bingzhuo Zhong

Planning is a fundamental capability for large language models (LLMs) because such complex tasks require models to coordinate goals, constraints, resources, and long-term consequences into executable and verifiable solutions. Existing…

Artificial Intelligence · Computer Science 2026-05-21 Ziliang Zhao , Zenan Xu , Shuting Wang , Hongjin Qian , Yan Lei , Minda Hu , Zhao Wang , Shihan Dou , Zhicheng Dou , Pluto Zhou

In recent years, Large Language Models (LLMs) have gained immense attention due to their notable emergent capabilities, surpassing those seen in earlier language models. A particularly intriguing application of LLMs is their role as…

Computation and Language · Computer Science 2023-11-02 Xue-Yong Fu , Md Tahmid Rahman Laskar , Cheng Chen , Shashi Bhushan TN

Large Language Models (LLMs) are increasingly being used to automate programming tasks. Yet, LLMs' capabilities in reasoning about program semantics are still inadequately studied, leaving significant potential for further exploration. This…

Programming Languages · Computer Science 2025-05-30 Thanh Le-Cong , Bach Le , Toby Murray

Autoformalization, the task of automatically translating natural language descriptions into a formal language, poses a significant challenge across various domains, especially in mathematics. Recent advancements in large language models…

Computation and Language · Computer Science 2024-12-09 Zenan Li , Yifan Wu , Zhaoyu Li , Xinming Wei , Xian Zhang , Fan Yang , Xiaoxing Ma

Effectively translating between natural language (NL) and formal logics like Linear Temporal Logic (LTL) requires expertise that limits formal verification's reach in safety-critical development. Template-based approaches sacrifice…

Artificial Intelligence · Computer Science 2026-05-25 Paapa Kwesi Quansah , Ernest Bonnah

This research explores the application of Large Language Models (LLMs) for automating the extraction of requirement-related legal content in the food safety domain and checking legal compliance of regulatory artifacts. With Industry 4.0…

Software Engineering · Computer Science 2024-04-29 Shabnam Hassani