English
Related papers

Related papers: SpotIt+: Verification-based Text-to-SQL Evaluation…

200 papers

This paper aims to improve the performance of text-to-SQL parsing by exploring the intrinsic uncertainties in the neural network based approaches (called SUN). From the data uncertainty perspective, it is indisputable that a single SQL can…

Computation and Language · Computer Science 2022-10-31 Bowen Qin , Lihan Wang , Binyuan Hui , Bowen Li , Xiangpeng Wei , Binhua Li , Fei Huang , Luo Si , Min Yang , Yongbin Li

Databases in the past have helped businesses maintain and extract insights from their data. Today, it is common for a business to involve multiple independent, distrustful parties. This trend towards decentralization introduces a new and…

Databases · Computer Science 2020-08-24 Meihui Zhang , Zhongle Xie , Cong Yue , Ziyue Zhong

Text-to-SQL, the task of translating natural language questions into SQL queries, is part of various business processes. Its automation, which is an emerging challenge, will empower software practitioners to seamlessly interact with…

Software Engineering · Computer Science 2024-01-10 Yewei Song , Saad Ezzini , Xunzhu Tang , Cedric Lothritz , Jacques Klein , Tegawendé Bissyandé , Andrey Boytsov , Ulrick Ble , Anne Goujon

Text-to-SQL enables users to interact with databases through natural language, simplifying the retrieval and synthesis of information. Despite the success of large language models (LLMs) in converting natural language questions into SQL…

Machine Learning · Computer Science 2025-04-23 Oleg Somov , Elena Tutubalina

The rise of Large Language Models (LLMs) has significantly advanced Text-to-SQL (NL2SQL) systems, yet evaluating the semantic equivalence of generated SQL remains a challenge, especially given ambiguous user queries and multiple valid SQL…

Computation and Language · Computer Science 2025-06-12 Qingyun Zeng , Simin Ma , Arash Niknafs , Ashish Basran , Carol Szabo

Text-to-SQL generation enables non-experts to interact with databases via natural language. Recent advances rely on large closed-source models like GPT-4 that present challenges in accessibility, privacy, and latency. To address these…

Computation and Language · Computer Science 2025-02-18 Satya Krishna Gorti , Ilan Gofman , Zhaoyan Liu , Jiapeng Wu , Noël Vouitsis , Guangwei Yu , Jesse C. Cresswell , Rasa Hosseinzadeh

The Text-to-SQL task translates natural language questions into SQL queries, enabling intuitive database interaction for non-experts. While recent methods leveraging Large Language Models (LLMs) achieve strong performance, their reliance on…

Computation and Language · Computer Science 2026-01-21 Shengmin Piao , Jieun Lee , Sanghyun Park

NoSQL databases have become increasingly popular due to their outstanding performance in handling large-scale, unstructured, and semi-structured data, highlighting the need for user-friendly interfaces to bridge the gap between…

Databases · Computer Science 2025-02-19 Jinwei Lu , Yuanfeng Song , Zhiqian Qin , Haodi Zhang , Chen Zhang , Raymond Chi-Wing Wong

Despite the significant advancements in Text-to-SQL (Text2SQL) facilitated by large language models (LLMs), the latest state-of-the-art techniques are still trapped in the in-context learning of closed-source LLMs (e.g., GPT-4), which…

Computation and Language · Computer Science 2025-05-27 Yang Qin , Chao Chen , Zhihang Fu , Ze Chen , Dezhong Peng , Peng Hu , Jieping Ye

Addressing the mismatch between natural language descriptions and the corresponding SQL queries is a key challenge for text-to-SQL translation. To bridge this gap, we propose an SQL intermediate representation (IR) called Natural SQL…

Computation and Language · Computer Science 2021-09-14 Yujian Gan , Xinyun Chen , Jinxia Xie , Matthew Purver , John R. Woodward , John Drake , Qiaofu Zhang

This paper introduces text-2-SQL-4-PM, a bilingual (Portuguese-English) benchmark dataset designed for the text-to-SQL task in the process mining domain. Text-to-SQL conversion facilitates natural language querying of databases, increasing…

Information Retrieval · Computer Science 2025-09-15 Bruno Yui Yamate , Thais Rodrigues Neubauer , Marcelo Fantinato , Sarajane Marques Peres

We introduce a framework for generating Chain-of-Thought (CoT) rationales to enhance text-to-SQL model fine-tuning. These rationales consist of intermediate SQL statements and explanations, serving as incremental steps toward constructing…

Computation and Language · Computer Science 2025-03-21 Gaetano Rossiello , Nhan Pham , Michael Glass , Junkyu Lee , Dharmashankar Subramanian

Recent text-to-SQL systems powered by large language models (LLMs) have demonstrated remarkable performance in translating natural language queries into SQL. However, these systems often struggle with complex database structures and…

Computation and Language · Computer Science 2025-05-22 Haoyuan Ma , Yongliang Shen , Hengwei Liu , Wenqi Zhang , Haolei Xu , Qiuying Peng , Jun Wang , Weiming Lu

Large-scale Text-to-SQL benchmarks such as BIRD typically assume complete and accurate database annotations as well as readily available external knowledge, which fails to reflect common industrial settings where annotations are missing,…

Computation and Language · Computer Science 2026-01-15 Jiahui Chen , Lei Fu , Jian Cui , Yu Lei , Zhenning Dong

Translating users' natural language queries (NL) into SQL queries (i.e., Text-to-SQL, a.k.a. NL2SQL) can significantly reduce barriers to accessing relational databases and support various commercial applications. The performance of…

Databases · Computer Science 2025-12-08 Xinyu Liu , Shuyu Shen , Boyan Li , Peixian Ma , Runzhi Jiang , Yuxin Zhang , Ju Fan , Guoliang Li , Nan Tang , Yuyu Luo

We introduce SQLSpace, a human-interpretable, generalizable, compact representation for text-to-SQL examples derived with minimal human intervention. We demonstrate the utility of these representations in evaluation with three use cases:…

Computation and Language · Computer Science 2025-11-03 Neha Srikanth , Victor Bursztyn , Puneet Mathur , Ani Nenkova

A large number of web applications is based on a relational database together with a program, typically a script, that enables the user to interact with the database through embedded SQL queries and commands. In this paper, we introduce a…

Logic in Computer Science · Computer Science 2016-10-10 Shachar Itzhaky , Tomer Kotek , Noam Rinetzky , Mooly Sagiv , Orr Tamir , Helmut Veith , Florian Zuleger

Recently, large language models (LLMs) have significantly improved the performance of text-to-SQL systems. Nevertheless, many state-of-the-art (SOTA) approaches have overlooked the critical aspect of system robustness. Our experiments…

Computation and Language · Computer Science 2024-12-18 Geling Liu , Yunzhi Tan , Ruichao Zhong , Yuanzhen Xie , Lingchen Zhao , Qian Wang , Bo Hu , Zang Li

Recent advancements in large language models (LLMs) have significantly contributed to the progress of the Text-to-SQL task. A common requirement in many of these works is the post-correction of SQL queries. However, the majority of this…

Databases · Computer Science 2025-01-10 Chaofan Li , Yingxia Shao , Yawen Li , Zheng Liu

Because high-quality data is like oxygen for AI systems, effectively eliciting information from crowdsourcing workers has become a first-order problem for developing high-performance machine learning algorithms. Two prevalent paradigms,…

Machine Learning · Computer Science 2024-02-22 Shengwei Xu , Yichi Zhang , Paul Resnick , Grant Schoenebeck