English
Related papers

Related papers: FLOW-BENCH: Towards Conversational Generation of E…

200 papers

This literature review studies the field of automated process extraction, i.e., transforming textual descriptions into structured processes using Natural Language Processing (NLP). We found that Machine Learning (ML) / Deep Learning (DL)…

Computation and Language · Computer Science 2024-09-24 William Van Woensel , Soroor Motie

Multi-turn instruction following capability constitutes a core competency of large language models (LLMs) in real-world applications. Existing evaluation benchmarks predominantly focus on fine-grained constraint satisfaction and…

Computation and Language · Computer Science 2025-06-02 Jinnan Li , Jinzhe Li , Yue Wang , Yi Chang , Yuan Wu

This paper introduces a novel approach to integrating large language model (LLM) agents into automated production systems, aimed at enhancing task automation and flexibility. We organize production operations within a hierarchical framework…

Artificial Intelligence · Computer Science 2024-07-12 Yuchen Xia , Jize Zhang , Nasser Jazdi , Michael Weyrich

Classical AI Planning techniques generate sequences of actions for complex tasks. However, they lack the ability to understand planning tasks when provided using natural language. The advent of Large Language Models (LLMs) has introduced…

Task automation has been greatly empowered by the recent advances in Large Language Models (LLMs) via Python code, where the tasks ranging from software engineering development to general-purpose reasoning. While current benchmarks have…

Large language models (LLMs) are beginning to reshape how chemists plan and run reactions in organic synthesis. Trained on millions of reported transformations, these text-based models can propose synthetic routes, forecast reaction…

Artificial Intelligence · Computer Science 2025-08-08 Kartar Kumar Lohana Tharwani , Rajesh Kumar , Sumita , Numan Ahmed , Yong Tang

Large Language Models (LLMs) have emerged as a powerful tool in advancing the Text-to-SQL task, significantly outperforming traditional methods.Nevertheless, as a nascent research field, there is still no consensus on the optimal prompt…

Computation and Language · Computer Science 2026-03-20 Bin Zhang , Yuxiao Ye , Guoqing Du , Xiaoru Hu , Zhishuai Li , Chi Harold Liu , Zhiwei Xu , Guoliang Fan , Rui Zhao , Ziyue Li , Hangyu Mao

A growing number of publications address the best practices to use Large Language Models (LLMs) for software engineering in recent years. However, most of this work focuses on widely-used general purpose programming languages like Python…

Software Engineering · Computer Science 2026-02-27 Salim Fares

We introduce a new benchmark, LLF-Bench (Learning from Language Feedback Benchmark; pronounced as "elf-bench"), to evaluate the ability of AI agents to interactively learn from natural language feedback and instructions. Learning from…

Artificial Intelligence · Computer Science 2023-12-14 Ching-An Cheng , Andrey Kolobov , Dipendra Misra , Allen Nie , Adith Swaminathan

Natural language processing evaluation has made significant progress, largely driven by the proliferation of powerful large language mod-els (LLMs). New evaluation benchmarks are of increasing priority as the reasoning capabilities of LLMs…

Computation and Language · Computer Science 2025-06-19 Joseph J. Peper , Wenzhao Qiu , Ali Payani , Lu Wang

This paper presents an innovative exploration of the application potential of large language models (LLM) in addressing the challenging task of automatically generating behavior trees (BTs) for complex tasks. The conventional manual BT…

Computation and Language · Computer Science 2024-01-17 Fu Li , Xueying Wang , Bin Li , Yunlong Wu , Yanzhen Wang , Xiaodong Yi

We introduce a simple approach that uses a large language model (LLM) to automatically implement a fully interpretable rule-based data-to-text system in pure Python. Experimental evaluation on the WebNLG dataset showed that such a…

Computation and Language · Computer Science 2025-03-03 Jędrzej Warczyński , Mateusz Lango , Ondrej Dusek

Large Language Models (LLMs) are revolutionizing industries by enhancing efficiency, scalability, and innovation. This paper investigates the potential of LLMs in automating Computer-Aided Design (CAD) workflows, by integrating FreeCAD with…

Human-Computer Interaction · Computer Science 2025-08-05 Sumit Kumar , Sarthak Kapoor , Harsh Vardhan , Yao Zhao

In the rapidly evolving field of Explainable Natural Language Processing (NLP), textual explanations, i.e., human-like rationales, are pivotal for explaining model predictions and enriching datasets with interpretable labels. Traditional…

Computation and Language · Computer Science 2025-11-12 Mahdi Dhaini , Juraj Vladika , Ege Erdogan , Zineb Attaoui , Gjergji Kasneci

Modern process simulators enable detailed process design, simulation, and optimization; however, constructing and interpreting simulations is time-consuming and requires expert knowledge. This limits early exploration by inexperienced…

Chemical Physics · Physics 2026-05-22 Jingkang Liang , Niklas Groll , Gürkan Sin

Large language models (LLMs) have revolutionized a large variety of NLP tasks. An active debate is to what extent they can do reasoning and planning. Prior work has assessed the latter in the specific context of PDDL planning, based on…

Artificial Intelligence · Computer Science 2025-05-05 Katharina Stein , Daniel Fišer , Jörg Hoffmann , Alexander Koller

The integration of workflows with large language models (LLMs) enables LLM-based agents to execute predefined procedures, enhancing automation in real-world applications. Traditional rule-based methods tend to limit the inherent flexibility…

Artificial Intelligence · Computer Science 2025-02-21 Yuchen Shi , Siqi Cai , Zihan Xu , Yuei Qin , Gang Li , Hang Shao , Jiawei Chen , Deqing Yang , Ke Li , Xing Sun

Text-to-SQL systems provide a natural language interface that can enable even laymen to access information stored in databases. However, existing Large Language Models (LLM) struggle with SQL generation from natural instructions due to…

Computation and Language · Computer Science 2025-11-07 Fahim Ahmed , Md Mubtasim Ahasan , Jahir Sadik Monon , Muntasir Wahed , M Ashraful Amin , A K M Mahbubur Rahman , Amin Ahsan Ali

Table Question Answering (TQA) aims to answer natural language questions over structured tables. Large Language Models (LLMs) enable promising solutions to this problem, with operator-centric solutions that generate table manipulation…

Databases · Computer Science 2026-04-02 Fengyu Li , Junhao Zhu , Kaishi Song , Lu Chen , Zhongming Yao , Tianyi Li , Christian S. Jensen

Business Process Model and Notation (BPMN) is a widely used standard for modelling business processes. While automated planning has been proposed as a method for simulating and reasoning about BPMN workflows, most implementations remain…

Artificial Intelligence · Computer Science 2025-11-25 Jasper Nie , Christian Muise , Victoria Armstrong