English
Related papers

Related papers: Beyond SELECT: A Comprehensive Taxonomy-Guided Ben…

200 papers

Large language models (LLMS) have shown increasing effectiveness in Text-to-SQL tasks. However, another closely related problem, Cross-System SQL Translation (a.k.a., SQL-to-SQL), which adapts a query written for one database system (e.g.,…

Databases · Computer Science 2025-09-30 Wei Zhou , Guoliang Li , Haoyu Wang , Yuxing Han , Xufei Wu , Fan Wu , Xuanhe Zhou

A practical text-to-SQL system should generalize well on a wide variety of natural language questions, unseen database schemas, and novel SQL query structures. To comprehensively evaluate text-to-SQL systems, we introduce a UNIfied…

Recent Text-to-SQL methods leverage large language models (LLMs) by incorporating feedback from the database management system. While these methods effectively address execution errors in SQL queries, they struggle with database mismatches…

Computation and Language · Computer Science 2024-09-02 Zhongyuan Wang , Richong Zhang , Zhijie Nie , Jaein Kim

Text-to-SQL models have significantly improved with the adoption of Large Language Models (LLMs), leading to their increasing use in real-world applications. Although many benchmarks exist for evaluating the performance of text-to-SQL…

Databases · Computer Science 2026-04-29 Sepideh Abedini , M. Tamer Özsu

Text-to-SQL prompt strategies based on Large Language Models (LLMs) achieve remarkable performance on well-known benchmarks. However, when applied to real-world databases, their performance is significantly less than for these benchmarks,…

Recent text-to-SQL systems powered by large language models (LLMs) have demonstrated remarkable performance in translating natural language queries into SQL. However, these systems often struggle with complex database structures and…

Computation and Language · Computer Science 2025-05-22 Haoyuan Ma , Yongliang Shen , Hengwei Liu , Wenqi Zhang , Haolei Xu , Qiuying Peng , Jun Wang , Weiming Lu

Large language models (LLMs) have advanced Text-to-SQL, yet existing solutions still fall short of system-level reliability. The limitation is not merely in individual modules -- e.g., schema linking, reasoning, and verification -- but more…

Databases · Computer Science 2026-04-06 Boyan Li , Chong Chen , Zhujun Xue , Yinan Mei , Yuyu Luo

Text-to-SQL is emerging as a practical interface for real world databases. The dominant paradigm for Text-to-SQL is cross-database or schema-independent, supporting application schemas unseen during training. The schema of a database…

Converting natural language queries into SQL queries is a crucial challenge in both industry and academia, aiming to increase access to databases and large-scale applications. This work examines how in-context learning and chain-of-thought…

Databases · Computer Science 2025-09-30 Saumya Chaturvedi , Aman Chadha , Laurent Bindschaedler

In recent years,Text-to-SQL, the problem of automatically converting questions posed in natural language to formal SQL queries, has emerged as an important problem at the intersection of natural language processing and data management…

Computation and Language · Computer Science 2024-09-17 Ke Shen , Mayank Kejriwal

Despite remarkable progress in text-to-SQL semantic parsing in recent years, the performance of existing parsers is still far from perfect. Specifically, modern text-to-SQL parsers based on deep learning are often over-confident, thus…

Computation and Language · Computer Science 2023-12-07 Shijie Chen , Ziru Chen , Huan Sun , Yu Su

Efficient querying and analysis of large tabular datasets remain significant challenges, especially for users without expertise in programming languages like SQL. Text-to-SQL approaches have shown promising performance on benchmark data;…

Databases · Computer Science 2025-08-27 Yipeng Zhang , Chen Wang , Yuzhe Zhang , Jacky Jiang

Converting natural language questions into SQL queries enables non-expert users to interact with relational databases and has long been a central task for natural language interfaces to data. While the WikiSQL dataset played a key role in…

Computation and Language · Computer Science 2025-12-10 Dzmitry Pihulski , Karol Charchut , Viktoria Novogrodskaia , Jan Kocoń

Text-to-SQL, which provides zero-code interface for operating relational databases, has gained much attention in financial analysis; because, financial professionals may not well-skilled in SQL programming. However, until now, there is no…

Computation and Language · Computer Science 2024-01-22 Chao Zhang , Yuren Mao , Yijiang Fan , Yu Mi , Yunjun Gao , Lu Chen , Dongfang Lou , Jinshu Lin

We present Spider, a large-scale, complex and cross-domain semantic parsing and text-to-SQL dataset annotated by 11 college students. It consists of 10,181 questions and 5,693 unique complex SQL queries on 200 databases with multiple…

Computation and Language · Computer Science 2019-02-05 Tao Yu , Rui Zhang , Kai Yang , Michihiro Yasunaga , Dongxu Wang , Zifan Li , James Ma , Irene Li , Qingning Yao , Shanelle Roman , Zilin Zhang , Dragomir Radev

Mechanistic interpretability research faces a gap between analyzing simple circuits in toy tasks and discovering features in large models. To bridge this gap, we propose text-to-SQL generation as an ideal task to study, as it combines the…

Machine Learning · Computer Science 2025-10-23 Abir Harrasse , Philip Quirke , Clement Neo , Dhruv Nathawani , Luke Marks , Amir Abdullah

Large Language Models (LLMs) have emerged as powerful tools for Text-to-SQL tasks, exhibiting remarkable reasoning capabilities. Different from tasks such as math word problems and commonsense reasoning, SQL solutions have a relatively…

Computation and Language · Computer Science 2024-09-24 Ruilin Luo , Liyuan Wang , Binghuai Lin , Zicheng Lin , Yujiu Yang

Text-to-SQL is a technology that converts natural language queries into the structured query language SQL. A novel research approach that has recently gained attention focuses on methods based on the complexity of SQL queries, achieving…

Computation and Language · Computer Science 2024-06-14 Jiawen Yi , Guo Chen , Zixiang Shen

With the future striving toward data-centric decision-making, seamless access to databases is of utmost importance. There is extensive research on creating an efficient text-to-sql (TEXT2SQL) model to access data from the database. Using a…

Computation and Language · Computer Science 2022-08-10 Ayush Kumar , Parth Nagarkar , Prabhav Nalhe , Sanjeev Vijayakumar

Several large-scale datasets (e.g., WikiSQL, Spider) for developing natural language interfaces to databases have recently been proposed. These datasets cover a wide breadth of domains but fall short on some essential domains, such as…

Computation and Language · Computer Science 2024-06-13 Rahul Kumar , Amar Raja Dibbu , Shrutendra Harsola , Vignesh Subrahmaniam , Ashutosh Modi