English
Related papers

Related papers: PolySQL: Scaling Text-to-SQL Evaluation Across SQL…

200 papers

In recent years, the task of text-to-SQL translation, which converts natural language questions into executable SQL queries, has gained significant attention for its potential to democratize data access. Despite its promise, challenges such…

Computation and Language · Computer Science 2024-05-28 Adrián Bazaga , Pietro Liò , Gos Micklem

Data augmentation has attracted a lot of research attention in the deep learning era for its ability in alleviating data sparseness. The lack of labeled data for unseen evaluation databases is exactly the major challenge for cross-domain…

Computation and Language · Computer Science 2022-11-16 Kun Wu , Lijie Wang , Zhenghua Li , Ao Zhang , Xinyan Xiao , Hua Wu , Min Zhang , Haifeng Wang

Large Language Models (LLMs) often struggle with the precise logic and schema alignment required for complex Text-to-SQL tasks. While current methods rely heavily on static prompting, they lack the ability to dynamically adapt and…

Computation and Language · Computer Science 2026-05-12 Haolin Yang , Jipeng Zhang , Zhitao He , Alexander Zhou , Yi R. Fung

Text-to-SQL converts natural language questions into executable SQL queries, enabling non-technical users to access relational databases for analytics and intelligent data services. In real-world scenarios, performance is often constrained…

Computation and Language · Computer Science 2026-05-25 Tianhao Qiu , Xiaojun Chen

We present a sequence-to-action parsing approach for the natural language to SQL task that incrementally fills the slots of a SQL query with feasible actions from a pre-defined inventory. To account for the fact that typically there are…

Computation and Language · Computer Science 2018-10-05 Tianze Shi , Kedar Tatwawadi , Kaushik Chakrabarti , Yi Mao , Oleksandr Polozov , Weizhu Chen

Recent advancements in large language models (LLMs) have significantly improved performance on the Text-to-SQL task. However, prior approaches typically rely on static, pre-processed database information provided at inference time, which…

Computation and Language · Computer Science 2025-06-23 Wenxuan Xie , Yaxun Dai , Wenhao Jiang

It is challenging to convert natural language (NL) questions into executable structured query language (SQL) queries for text-to-SQL tasks due to the vast number of database schemas with redundancy, which interferes with semantic learning,…

Databases · Computer Science 2025-02-11 Zhuopan Yang , Yuanzhen Xie , Ruichao Zhong , Yunzhi Tan , Enjie Liu , Zhenguo Yang , Mochi Gao , Bo Hu , Zang Li

While large language models (LLMs) have substantially improved Text-to-SQL generation, a pronounced gap remains between AI systems and human experts on challenging benchmarks such as BIRD-SQL. We argue this gap stems largely from the…

Real-world clinical text-to-SQL requires reasoning over heterogeneous EHR tables, temporal windows, and patient-similarity cohorts to produce executable queries. We introduce CLINSQL, a benchmark of 633 expert-annotated tasks on MIMIC-IV…

Computation and Language · Computer Science 2026-01-16 Yifei Shen , Yilun Zhao , Justice Ou , Tinglin Huang , Arman Cohan

We consider the problem of neural semantic parsing, which translates natural language questions into executable SQL queries. We introduce a new mechanism, execution guidance, to leverage the semantics of SQL. It detects and excludes faulty…

Computation and Language · Computer Science 2018-09-17 Chenglong Wang , Kedar Tatwawadi , Marc Brockschmidt , Po-Sen Huang , Yi Mao , Oleksandr Polozov , Rishabh Singh

Text-to-SQL parsers are crucial in enabling non-experts to effortlessly query relational data. Training such parsers, by contrast, generally requires expertise in annotating natural language (NL) utterances with corresponding SQL queries.…

Computation and Language · Computer Science 2024-08-05 Tomer Wolfson , Daniel Deutch , Jonathan Berant

Evaluating Text-to-SQL agents in private business intelligence (BI) settings is challenging due to the scarcity of realistic, domain-specific data. While synthetic evaluation data offers a scalable solution, existing generation methods fail…

Computation and Language · Computer Science 2026-01-22 Jinhui Liu , Ximeng Zhang , Yanbo Ai , Zhou Yu

Table learning, which lies at the intersection of machine learning and modern database systems, has recently attracted growing attention. However, existing table learning frameworks typically require explicit data export and extensive…

Databases · Computer Science 2026-02-13 Feiyang Chen , Ken Zhong , Aoqian Zhang , Zheng Wang , Li Pan , Jianhua Li

Modern Text-to-SQL systems generate multiple candidate SQL queries and rank them to judge a final prediction. However, existing methods face two limitations. First, they often score functionally equivalent SQL queries inconsistently despite…

Software Engineering · Computer Science 2026-04-29 Hojae Han , Yeonseok Jeong , Seung-won Hwang , Zhewei Yao , Yuxiong He

Text-to-SQL is a fundamental yet challenging task in the NLP area, aiming at translating natural language questions into SQL queries. While recent advances in large language models have greatly improved performance, most existing approaches…

Databases · Computer Science 2025-12-01 Shuozhi Yuan , Limin Chen , Miaomiao Yuan , Zhao Jin

Transforming natural-language requests into reliable, production-ready data transformations remains challenging: correctness depends on precise schema linking and warehouse-specific SQL dialects, while the strongest supervision available…

Artificial Intelligence · Computer Science 2025-10-06 Anni Li , Aria Attar , Paul Dong

Text-to-SQL generation aims to translate natural language questions into SQL statements. In Text-to-SQL based on large language models, schema linking is a widely adopted strategy to streamline the input for LLMs by selecting only relevant…

Computation and Language · Computer Science 2024-11-27 Zhenbiao Cao , Yuanlei Zheng , Zhihao Fan , Xiaojin Zhang , Wei Chen , Xiang Bai

Transforming natural language into SQL queries (NL2SQL) is crucial for data-driven business applications. Existing frameworks, trained on open-source datasets, struggle with complex business logic and lack domain-specific data for…

Databases · Computer Science 2025-07-16 Song Cheng , Qiannan Cheng , Linbo Jin , Lei Yi , Guannan Zhang

Content Warning: This work contains examples that potentially implicate stereotypes, associations, and other harms that could be offensive to individuals in certain social groups.} Large pre-trained language models are acknowledged to carry…

Computation and Language · Computer Science 2023-06-08 Yan Liu , Yan Gao , Zhe Su , Xiaokang Chen , Elliott Ash , Jian-Guang Lou

We present SpotIt+, an open-source tool for evaluating Text-to-SQL systems via bounded equivalence verification. Given a generated SQL query and the ground truth, SpotIt+ actively searches for database instances that differentiate the two…

Databases · Computer Science 2026-05-13 Andrew Tremante , Yang He , Rocky Klopfenstein , Yuepeng Wang , Nina Narodytska , Haoze Wu