English
Related papers

Related papers: TrustSQL: Benchmarking Text-to-SQL Reliability wit…

200 papers

Text-to-SQL systems translate natural language (NL) questions into SQL queries, enabling non-technical users to interact with structured data. While large language models (LLMs) have shown promising results on the text-to-SQL task, they…

Computation and Language · Computer Science 2025-06-06 Yue Gong , Chuan Lei , Xiao Qin , Kapil Vaidya , Balakrishnan Narayanaswamy , Tim Kraska

Large Language Models (LLMs) have demonstrated impressive capabilities across various domains, prompting a surge in their practical applications. However, concerns have arisen regarding the trustworthiness of LLMs outputs, particularly in…

Computation and Language · Computer Science 2024-05-08 Danna Zheng , Danyang Liu , Mirella Lapata , Jeff Z. Pan

Text-to-SQL translates natural language queries into Structured Query Language (SQL) commands, enabling users to interact with databases using natural language. Essentially, the text-to-SQL task is a text generation task, and its…

Databases · Computer Science 2024-10-10 Xiaohu Zhu , Qian Li , Lizhen Cui , Yongkang Liu

With the development of the Large Language Models (LLMs), a large range of LLM-based Text-to-SQL(Text2SQL) methods have emerged. This survey provides a comprehensive review of LLM-based Text2SQL studies. We first enumerate classic…

Computation and Language · Computer Science 2025-06-04 Liang Shi , Zhengju Tang , Nan Zhang , Xiaotong Zhang , Zhi Yang

Text-to-SQL, which provides zero-code interface for operating relational databases, has gained much attention in financial analysis; because, financial professionals may not well-skilled in SQL programming. However, until now, there is no…

Computation and Language · Computer Science 2024-01-22 Chao Zhang , Yuren Mao , Yijiang Fan , Yu Mi , Yunjun Gao , Lu Chen , Dongfang Lou , Jinshu Lin

Text-to-SQL systems translate natural language questions into SQL queries, providing substantial value for non-expert users. While large language models (LLMs) show promising results for this task, they remain error-prone. Query ambiguity…

Databases · Computer Science 2026-03-24 Zhongjun Ding , Yin Lin , Tianjing Zeng , Rong Zhu , Bolin Ding , Jingren Zhou

NoSQL databases have become increasingly popular due to their outstanding performance in handling large-scale, unstructured, and semi-structured data, highlighting the need for user-friendly interfaces to bridge the gap between…

Databases · Computer Science 2025-02-19 Jinwei Lu , Yuanfeng Song , Zhiqian Qin , Haodi Zhang , Chen Zhang , Raymond Chi-Wing Wong

Community-driven Text-to-SQL evaluation platforms play a pivotal role in tracking the state of the art of Text-to-SQL performance. The reliability of the evaluation process is critical for driving progress in the field. Current evaluation…

Databases · Computer Science 2026-03-05 Rocky Klopfenstein , Yang He , Andrew Tremante , Yuepeng Wang , Nina Narodytska , Haoze Wu

Large language models (LLMs) have demonstrated strong performance in translating natural language questions into SQL queries (Text-to-SQL). In contrast, small language models (SLMs) ranging from 0.5B to 1.5B parameters currently…

Computation and Language · Computer Science 2025-07-31 Lei Sheng , Shuai-Shuai Xu

Large language models (LLMs) have revolutionized Text-to-SQL generation, allowing users to query structured data using natural language with growing ease. Yet, real-world deployment remains challenging, especially in complex or unseen…

Computation and Language · Computer Science 2026-05-01 Smit Jivani , Sarvam Maheshwari , Sunita Sarawagi

Text-to-SQL bridges the gap between natural language and structured database language, thus allowing non-technical users to easily query databases. Traditional approaches model text-to-SQL as a direct translation task, where a given Natural…

Machine Learning · Computer Science 2025-08-12 Anurag Tripathi , Vaibhav Patle , Abhinav Jain , Ayush Pundir , Sairam Menon , Ajeet Kumar Singh , Dorien Herremans

Text-to-SQL systems enable users to interact with structured databases using natural language, eliminating the need for specialized programming knowledge. In this work, we introduce GEMMA-SQL, a lightweight and efficient text-to-SQL model…

Computation and Language · Computer Science 2025-11-10 Hari Mohan Pandey , Anshul Gupta , Subham Sarkar , Minakshi Tomer , Schneider Johannes , Yan Gong

Text-to-SQL generation enables non-experts to interact with databases via natural language. Recent advances rely on large closed-source models like GPT-4 that present challenges in accessibility, privacy, and latency. To address these…

Computation and Language · Computer Science 2025-02-18 Satya Krishna Gorti , Ilan Gofman , Zhaoyan Liu , Jiapeng Wu , Noël Vouitsis , Guangwei Yu , Jesse C. Cresswell , Rasa Hosseinzadeh

Text-to-SQL aims at generating SQL queries for the given natural language questions and thus helping users to query databases. Prompt learning with large language models (LLMs) has emerged as a recent approach, which designs prompts to lead…

Information Retrieval · Computer Science 2023-09-06 Chunxi Guo , Zhiliang Tian , Jintao Tang , Shasha Li , Zhihua Wen , Kaixuan Wang , Ting Wang

The task of Text-to-SQL enables anyone to retrieve information from SQL databases using natural language. While this task has made substantial progress, the two primary evaluation metrics - Execution Accuracy (EXE) and Exact Set Matching…

Computation and Language · Computer Science 2025-06-18 Benjamin G. Ascoli , Yasoda Sai Ram Kandikonda , Jinho D. Choi

To be informative, an evaluation must measure how well systems generalize to realistic unseen data. We identify limitations of and propose improvements to current evaluations of text-to-SQL systems. First, we compare human-generated and…

Computation and Language · Computer Science 2020-06-05 Catherine Finegan-Dollak , Jonathan K. Kummerfeld , Li Zhang , Karthik Ramanathan , Sesh Sadasivam , Rui Zhang , Dragomir Radev

Despite the remarkable performance of large language models (LLMs) in text-to-SQL (SQL generation), correctly producing SQL queries remains challenging during initial generation. The SQL refinement task is subsequently introduced to correct…

Computation and Language · Computer Science 2026-03-05 Zijin Hong , Hao Chen , Zheng Yuan , Qinggang Zhang , Luyao Zhuang , Qing Liao , Feiran Huang , Yangqiu Song , Xiao Huang

Text-to-SQL aims to convert natural language questions into executable SQL queries. While previous approaches, such as skeleton-masked selection, have demonstrated strong performance by retrieving similar training examples to guide large…

Computation and Language · Computer Science 2025-10-01 Jimin Lee , Ingeol Baek , Byeongjeong Kim , Hyunkyung Bae , Hwanhee Lee

Text-to-SQL is a task that converts a natural language question into a structured query language (SQL) to retrieve information from a database. Large language models (LLMs) work well in natural language generation tasks, but they are not…

Computation and Language · Computer Science 2023-09-04 Chunxi Guo , Zhiliang Tian , Jintao Tang , Pancheng Wang , Zhihua Wen , Kang Yang , Ting Wang

Text-to-SQL benchmarks play a crucial role in evaluating the progress made in the field and the ranking of different models. However, accurately matching a model-generated SQL query to a reference SQL query in a benchmark fails for various…

Computation and Language · Computer Science 2023-10-31 Mohammadreza Pourreza , Davood Rafiei