English
Related papers

Related papers: Spider 2.0: Evaluating Language Models on Real-Wor…

200 papers

Large language models (LLMS) have shown increasing effectiveness in Text-to-SQL tasks. However, another closely related problem, Cross-System SQL Translation (a.k.a., SQL-to-SQL), which adapts a query written for one database system (e.g.,…

Databases · Computer Science 2025-09-30 Wei Zhou , Guoliang Li , Haoyu Wang , Yuxing Han , Xufei Wu , Fan Wu , Xuanhe Zhou

Text-to-SQL (Text2SQL) aims to map natural language questions to executable SQL queries. Although large language models (LLMs) have driven significant progress, current approaches struggle with poor transferability to open-source LLMs,…

Databases · Computer Science 2025-05-23 Shuai Lyu , Haoran Luo , Ripeng Li , Zhonghong Ou , Jiangfeng Sun , Yang Qin , Xiaoran Shang , Meina Song , Yifan Zhu

Text-to-SQL systems have become crucial for translating natural language into SQL queries in various industries, enabling non-technical users to perform complex data operations. The need for accurate evaluation methods has increased as…

Computation and Language · Computer Science 2024-10-29 Heegyu Kim , Taeyang Jeon , Seunghwan Choi , Seungtaek Choi , Hyunsouk Cho

We present Archer, a challenging bilingual text-to-SQL dataset specific to complex reasoning, including arithmetic, commonsense and hypothetical reasoning. It contains 1,042 English questions and 1,042 Chinese questions, along with 521…

Computation and Language · Computer Science 2024-02-27 Danna Zheng , Mirella Lapata , Jeff Z. Pan

In Natural Language Interfaces to Databases systems, the text-to-SQL technique allows users to query databases by using natural language questions. Though significant progress in this area has been made recently, most parsers may fall short…

Computation and Language · Computer Science 2020-11-10 Yuntao Li , Bei Chen , Qian Liu , Yan Gao , Jian-Guang Lou , Yan Zhang , Dongmei Zhang

Despite remarkable progress in text-to-SQL semantic parsing in recent years, the performance of existing parsers is still far from perfect. Specifically, modern text-to-SQL parsers based on deep learning are often over-confident, thus…

Computation and Language · Computer Science 2023-12-07 Shijie Chen , Ziru Chen , Huan Sun , Yu Su

Recent advancements in large language models (LLMs) have enabled in-context learning (ICL)-based methods that significantly outperform fine-tuning approaches for text-to-SQL tasks. However, their performance is still considerably lower than…

Computation and Language · Computer Science 2024-05-14 Dongjun Lee , Choongwon Park , Jaehyuk Kim , Heesoo Park

The proliferation of unstructured data poses a fundamental challenge to traditional database interfaces. While Text-to-SQL has democratized access to structured data, it remains incapable of interpreting semantic or multi-modal queries.…

Computation and Language · Computer Science 2025-11-07 Zhengren Wang , Dongwen Yao , Bozhou Li , Dongsheng Ma , Bo Li , Zhiyu Li , Feiyu Xiong , Bin Cui , Linpeng Tang , Wentao Zhang

In Text-to-SQL, execution feedback is essential for guiding large language models (LLMs) to reason accurately and generate reliable SQL queries. However, existing methods treat execution feedback solely as a post-hoc signal for correction…

Computation and Language · Computer Science 2025-05-21 Yaxun Dai , Wenxuan Xie , Xialie Zhuang , Tianyu Yang , Yiying Yang , Haiqin Yang , Yuhang Zhao , Pingfu Chao , Wenhao Jiang

The sequence-to-sequence paradigm employed by neural text-to-SQL models typically performs token-level decoding and does not consider generating SQL hierarchically from a grammar. Grammar-based decoding has shown significant improvements…

Computation and Language · Computer Science 2019-06-03 Kevin Lin , Ben Bogin , Mark Neumann , Jonathan Berant , Matt Gardner

Text-to-SQL translates natural language queries into Structured Query Language (SQL) commands, enabling users to interact with databases using natural language. Essentially, the text-to-SQL task is a text generation task, and its…

Databases · Computer Science 2024-10-10 Xiaohu Zhu , Qian Li , Lizhen Cui , Yongkang Liu

Text-to-SQL demands precise reasoning to convert natural language questions into structured queries. While large language models (LLMs) excel in many reasoning tasks, their ability to leverage Chain-of-Thought (CoT) reasoning for…

Machine Learning · Computer Science 2025-03-27 Bohan Zhai , Canwen Xu , Yuxiong He , Zhewei Yao

Text-to-SQL is a key natural language processing task that maps natural language questions to SQL queries, enabling intuitive interaction with web-based databases. Although current methods perform well on benchmarks like BIRD and Spider,…

Computation and Language · Computer Science 2026-02-06 Tao Liu , Jiafan Lu , Bohan Yu , Pengcheng Wu , Liu Haixin , Guoyu Xu , Li Xiangheng , Lixiao Li , Jiaming Hou , Zhao Shijun , Xinglin Lyu , Kunli Zhang , Yuxiang Jia , Hongyin Zan

With the development of the Large Language Models (LLMs), a large range of LLM-based Text-to-SQL(Text2SQL) methods have emerged. This survey provides a comprehensive review of LLM-based Text2SQL studies. We first enumerate classic…

Computation and Language · Computer Science 2025-06-04 Liang Shi , Zhengju Tang , Nan Zhang , Xiaotong Zhang , Zhi Yang

Most modern Text2SQL systems prompt large language models (LLMs) with entire schemas -- mostly column information -- alongside the user's question. While effective on small databases, this approach fails on real-world schemas that exceed…

Databases · Computer Science 2025-12-19 Thanh Dat Hoang , Thanh Tam Nguyen , Thanh Trung Huynh , Hongzhi Yin , Quoc Viet Hung Nguyen

Text-to-SQL ensembles improve over single-candidate generation by drawing multiple SQL candidates and selecting one, but their effectiveness is bounded by Pass@K, the probability that at least one of K candidates is correct. Existing…

Text-to-SQL bridges the gap between natural language and structured database language, thus allowing non-technical users to easily query databases. Traditional approaches model text-to-SQL as a direct translation task, where a given Natural…

Machine Learning · Computer Science 2025-08-12 Anurag Tripathi , Vaibhav Patle , Abhinav Jain , Ayush Pundir , Sairam Menon , Ajeet Kumar Singh , Dorien Herremans

Recent In-Context Learning based methods have achieved remarkable success in Text-to-SQL task. However, there is still a large gap between the performance of these models and human performance on datasets with complex database schema and…

Computation and Language · Computer Science 2024-11-08 Wenxuan Xie , Gaochen Wu , Bowen Zhou

The data-centric paradigm has emerged as a pivotal direction in artificial intelligence (AI), emphasizing the role of high-quality training data. This shift is especially critical in the Text-to-SQL task, where the scarcity, limited…

Computation and Language · Computer Science 2026-02-11 Qifeng Cai , Hao Liang , Chang Xu , Tao Xie , Wentao Zhang , Bin Cui

Resolution of complex SQL issues persists as a significant bottleneck in real-world database applications. Current Large Language Models (LLMs), while adept at text-to-SQL translation, have not been rigorously evaluated on the more…

‹ Prev 1 4 5 6 7 8 10 Next ›