English
Related papers

Related papers: FLEX: Expert-level False-Less EXecution Metric for…

200 papers

Large Language Models (LLMs) have made significant progress in assisting users to query databases in natural language. While LLM-based techniques provide state-of-the-art results on many standard benchmarks, their performance significantly…

Artificial Intelligence · Computer Science 2024-07-09 Nina Narodytska , Shay Vargaftik

While large language models (LLMs) achieve strong performance on text-to-SQL parsing, they sometimes exhibit unexpected failures in which they are confidently incorrect. Building trustworthy text-to-SQL systems thus requires eliciting…

Computation and Language · Computer Science 2025-09-18 Terrance Liu , Shuyi Wang , Daniel Preotiuc-Pietro , Yash Chandarana , Chirag Gupta

The rise of Large Language Models (LLMs) has significantly advanced Text-to-SQL (NL2SQL) systems, yet evaluating the semantic equivalence of generated SQL remains a challenge, especially given ambiguous user queries and multiple valid SQL…

Computation and Language · Computer Science 2025-06-12 Qingyun Zeng , Simin Ma , Arash Niknafs , Ashish Basran , Carol Szabo

Recent advances in large language models (LLMs) have significantly improved the accuracy of Text-to-SQL systems. However, a critical challenge remains: the semantic mismatch between natural language questions (NLQs) and their corresponding…

Computation and Language · Computer Science 2025-08-21 Shaoming Duan , Zirui Wang , Chuanyi Liu , Zhibin Zhu , Yuhao Zhang , Peiyi Han , Liang Yan , Zewu Peng

Text-to-SQL aims to convert natural language questions into executable SQL queries. While previous approaches, such as skeleton-masked selection, have demonstrated strong performance by retrieving similar training examples to guide large…

Computation and Language · Computer Science 2025-10-01 Jimin Lee , Ingeol Baek , Byeongjeong Kim , Hyunkyung Bae , Hwanhee Lee

Translating users' natural language queries (NL) into SQL queries (i.e., Text-to-SQL, a.k.a. NL2SQL) can significantly reduce barriers to accessing relational databases and support various commercial applications. The performance of…

Databases · Computer Science 2025-12-08 Xinyu Liu , Shuyu Shen , Boyan Li , Peixian Ma , Runzhi Jiang , Yuxin Zhang , Ju Fan , Guoliang Li , Nan Tang , Yuyu Luo

Text-to-SQL translates natural language questions into executable SQL queries, enabling intuitive database access for non-experts. While large language models achieve strong performance on Text-to-SQL with prompting, they still struggle…

Computation and Language · Computer Science 2026-05-12 Zhao Tan , Xiping Liu , Qing Shu , Qizhi Wan , Dexi Liu , Changxuan Wan

Text-to-SQL parsing, which aims at converting natural language instructions into executable SQLs, has gained increasing attention in recent years. In particular, Codex and ChatGPT have shown impressive results in this task. However, most of…

With the development of the Large Language Models (LLMs), a large range of LLM-based Text-to-SQL(Text2SQL) methods have emerged. This survey provides a comprehensive review of LLM-based Text2SQL studies. We first enumerate classic…

Computation and Language · Computer Science 2025-06-04 Liang Shi , Zhengju Tang , Nan Zhang , Xiaotong Zhang , Zhi Yang

NoSQL databases have become increasingly popular due to their outstanding performance in handling large-scale, unstructured, and semi-structured data, highlighting the need for user-friendly interfaces to bridge the gap between…

Databases · Computer Science 2025-02-19 Jinwei Lu , Yuanfeng Song , Zhiqian Qin , Haodi Zhang , Chen Zhang , Raymond Chi-Wing Wong

Text-to-SQL models have significantly improved with the adoption of Large Language Models (LLMs), leading to their increasing use in real-world applications. Although many benchmarks exist for evaluating the performance of text-to-SQL…

Databases · Computer Science 2026-04-29 Sepideh Abedini , M. Tamer Özsu

Text-to-SQL translates natural language queries into Structured Query Language (SQL) commands, enabling users to interact with databases using natural language. Essentially, the text-to-SQL task is a text generation task, and its…

Databases · Computer Science 2024-10-10 Xiaohu Zhu , Qian Li , Lizhen Cui , Yongkang Liu

This study investigates various approaches to using Large Language Models (LLMs) for Text-to-SQL program synthesis, focusing on the outcomes and insights derived. Employing the popular Text-to-SQL dataset, spider, the goal was to input a…

Artificial Intelligence · Computer Science 2024-01-24 Richard Roberson , Gowtham Kaki , Ashutosh Trivedi

Generating accurate SQL queries for user questions (text-to-SQL) has been a long-standing challenge since it requires a deep understanding of both the user's question and the corresponding database schema in order to retrieve the desired…

Computation and Language · Computer Science 2024-06-07 Zijin Hong , Zheng Yuan , Hao Chen , Qinggang Zhang , Feiran Huang , Xiao Huang

Large Language models (LLMs) have demonstrated significant potential in text-to-SQL reasoning tasks, yet a substantial performance gap persists between existing open-source models and their closed-source counterparts. In this paper, we…

Computation and Language · Computer Science 2025-09-23 Yu Guo , Dong Jin , Shenghao Ye , Shuangwu Chen , Jian Yang , Xiaobin Tan

While Text-to-SQL remains the dominant approach for database interaction, real-world analytics increasingly require the flexibility of general-purpose programming languages such as Python or Pandas to manage file-based data and complex…

Artificial Intelligence · Computer Science 2026-01-26 Hangle Hu , Chenyu Hou , Bin Cao , Ruizhe Li

SQL dialects vary in syntax, types, and functions across database engines. Text-to-SQL benchmarks, however, predominantly support only SQLite. This creates a critical evaluation gap: cross-dialect evaluation reveals weak per-query agreement…

Computation and Language · Computer Science 2026-05-11 Yotam Perlitz , Elad Venezian , Corentin Royer , Francesco Fusco , Andrea Giovannini

Large Language Models (LLMs) have shown promise in enabling natural language interfaces for structured data querying through text-to-SQL generation. However, their application in real-world Business Intelligence (BI) contexts remains…

Computation and Language · Computer Science 2025-05-02 Jeho Choi

A practical text-to-SQL system should generalize well on a wide variety of natural language questions, unseen database schemas, and novel SQL query structures. To comprehensively evaluate text-to-SQL systems, we introduce a UNIfied…

In recent years,Text-to-SQL, the problem of automatically converting questions posed in natural language to formal SQL queries, has emerged as an important problem at the intersection of natural language processing and data management…

Computation and Language · Computer Science 2024-09-17 Ke Shen , Mayank Kejriwal