English
Related papers

Related papers: BIS: NL2SQL Service Evaluation Benchmark for Busin…

200 papers

A rigorous formalization of desired system requirements is indispensable when performing any verification task. This often limits the application of verification techniques, as writing formal specifications is an error-prone and…

Logic in Computer Science · Computer Science 2023-03-10 Matthias Cosler , Christopher Hahn , Daniel Mendoza , Frederik Schmitt , Caroline Trippel

NL2VIS - which translates natural language (NL) queries to corresponding visualizations (VIS) - has attracted more and more attention both in commercial visualization vendors and academic researchers. In the last few years, the advanced…

Human-Computer Interaction · Computer Science 2021-12-28 Yuyu Luo , Jiawei Tang , Guoliang Li

The Natural Language to Visualization (NL2Vis) task aims to transform natural-language descriptions into visual representations for a grounded table, enabling users to gain insights from vast amounts of data. Recently, many deep…

Databases · Computer Science 2024-04-29 Yang Wu , Yao Wan , Hongyu Zhang , Yulei Sui , Wucai Wei , Wei Zhao , Guandong Xu , Hai Jin

The task of converting natural language questions (NLQs) into executable SQL queries, known as text-to-SQL, has gained significant interest in recent years, as it enables non-technical users to interact with relational databases. Many…

Software Engineering · Computer Science 2025-11-19 Salmane Chafik , Saad Ezzini , Ismail Berrada

While current tasks of converting natural language to SQL (NL2SQL) using Foundation Models have shown impressive achievements, adapting these approaches for converting natural language to Graph Query Language (NL2GQL) encounters hurdles due…

Computation and Language · Computer Science 2024-07-02 Yuhang Zhou , Yu He , Siyu Tian , Yuchen Ni , Zhangyue Yin , Xiang Liu , Chuanjun Ji , Sen Liu , Xipeng Qiu , Guangnan Ye , Hongfeng Chai

Clinicians exploring oncology trial repositories often need ad-hoc, multi-constraint queries over biomarkers, endpoints, interventions, and time, yet writing SQL requires schema expertise. We demo FD-NL2SQL, a feedback-driven clinical…

Text2SQL, the task of generating SQL queries from natural language text, is a critical challenge in data engineering. Recently, Large Language Models (LLMs) have demonstrated superior performance for this task due to their advanced…

Large language models (LLMs) increasingly rely on external tools and APIs to execute complex tasks specified in natural language. Evaluating such tool calling capabilities in realistic enterprise settings is challenging: APIs are often…

Software Engineering · Computer Science 2026-01-27 Benjamin Elder , Anupama Murthi , Jungkoo Kang , Ankita Rajaram Naik , Kiran Kate , Kinjal Basu , Danish Contractor

Text-to-SQL, which involves translating natural language into Structured Query Language (SQL), is crucial for enabling broad access to structured databases without expert knowledge. However, designing models for such tasks is challenging…

Computation and Language · Computer Science 2024-03-27 Niklas Wretblad , Fredrik Gordh Riseby , Rahul Biswas , Amin Ahmadi , Oskar Holmström

In Natural Language Processing (NLP), one of the most important tasks is text-to-SQL semantic parsing, which focuses on enabling users to interact with the database in a more natural manner. In recent years, text-to-SQL has made significant…

Computation and Language · Computer Science 2024-02-26 Saleh Almohaimeed , Saad Almohaimeed , Mansour Al Ghanim , Liqiang Wang

Despite strong performance on Text-to-SQL benchmarks, it remains unclear whether LLM-generated SQL programs are structurally reliable. In this work, we investigate the structural behavior of LLM-generated SQL queries and introduce…

Computation and Language · Computer Science 2026-04-09 Yixi Zhou , Fan Zhang , Zhiqiao Guo , Yu Chen , Haipeng Zhang , Preslav Nakov , Zhuohan Xie

In modern industry systems like multi-turn chat agents, Text-to-SQL technology bridges natural language (NL) questions and database (DB) querying. The conversion of tabular DB results into NL representations (NLRs) enables the chat-based…

Computation and Language · Computer Science 2025-10-29 Jyotika Singh , Weiyi Sun , Amit Agarwal , Viji Krishnamurthy , Yassine Benajiba , Sujith Ravi , Dan Roth

Text-to-SQL systems translate natural language (NL) questions into SQL queries, enabling non-technical users to interact with structured data. While large language models (LLMs) have shown promising results on the text-to-SQL task, they…

Computation and Language · Computer Science 2025-06-06 Yue Gong , Chuan Lei , Xiao Qin , Kapil Vaidya , Balakrishnan Narayanaswamy , Tim Kraska

Exploring the generalization of a text-to-SQL parser is essential for a system to automatically adapt the real-world databases. Previous works provided investigations focusing on lexical diversity, including the influence of the synonym and…

Artificial Intelligence · Computer Science 2023-01-24 Jieyu Li , Lu Chen , Ruisheng Cao , Su Zhu , Hongshen Xu , Zhi Chen , Hanchong Zhang , Kai Yu

Contemporary database systems, while effective, suffer severe issues related to complexity and usability, especially among individuals who lack technical expertise but are unfamiliar with query languages like Structured Query Language…

Databases · Computer Science 2025-07-25 M. Tedeschi , S. Rizwan , C. Shringi , V. Devram Chandgir , S. Belich

This paper describes DBPal, a new system to translate natural language utterances into SQL statements using a neural machine translation model. While other recent approaches use neural machine translation to implement a Natural Language…

Today's competitive environment drives the enterprises to extend their focus and collaborate with their business partners to carry out the necessities. Tight coordination among business partners assists to share and integrate the service…

Software Engineering · Computer Science 2015-03-13 Thirumaran. M , Dhavachelvan. P , Aranganayagi. G , S. Abarna

Robust workflow composition is critical for effective agent performance, yet progress in Large Language Model (LLM) planning and reasoning is hindered by a scarcity of scalable evaluation data. This work introduces NL2Flow, a fully…

Artificial Intelligence · Computer Science 2025-10-16 Jungkoo Kang

Text-to-SQL prompt strategies based on Large Language Models (LLMs) achieve remarkable performance on well-known benchmarks. However, when applied to real-world databases, their performance is significantly less than for these benchmarks,…

Text-to-SQL systems (also known as NL-to-SQL systems) have become an increasingly popular solution for bridging the gap between user capabilities and SQL-based data access. These systems translate user requests in natural language to valid…

Databases · Computer Science 2024-12-02 Jonathan Fürst , Catherine Kosten , Farhad Nooralahzadeh , Yi Zhang , Kurt Stockinger