English
Related papers

Related papers: Evaluating the Data Model Robustness of Text-to-SQ…

200 papers

Recent text-to-SQL models have achieved strong performance, but their effectiveness remains largely confined to SQLite due to dataset limitations. However, real-world applications require SQL generation across multiple dialects with varying…

Computation and Language · Computer Science 2025-05-26 Jipeng Zhang , Haolin Yang , Kehao Miao , Ruiyuan Zhang , Renjie Pi , Jiahui Gao , Xiaofang Zhou

Text-to-SQL, the task of translating natural language questions into SQL queries, plays a crucial role in enabling non-experts to interact with databases. While recent advancements in large language models (LLMs) have significantly enhanced…

Computation and Language · Computer Science 2025-07-15 Haoyang Li , Shang Wu , Xiaokang Zhang , Xinmei Huang , Jing Zhang , Fuxin Jiang , Shuai Wang , Tieying Zhang , Jianjun Chen , Rui Shi , Hong Chen , Cuiping Li

Recent divide-and-conquer reasoning approaches, particularly those based on Chain-of-Thought (CoT), have substantially improved the Text-to-SQL capabilities of Large Language Models (LLMs). However, when applied to complex enterprise…

Computation and Language · Computer Science 2025-11-27 Zhifeng Hao , Qibin Song , Ruichu Cai , Boyan Xu

Text-to-SQL systems enable users to query databases using natural language, democratizing access to data analytics. However, they face challenges in understanding ambiguous phrasing, domain-specific vocabulary, and complex schema…

Databases · Computer Science 2025-06-17 Tetiana Gladkykh , Kyrylo Kirykov

The rise of Large Language Models (LLMs) has significantly advanced Text-to-SQL (NL2SQL) systems, yet evaluating the semantic equivalence of generated SQL remains a challenge, especially given ambiguous user queries and multiple valid SQL…

Computation and Language · Computer Science 2025-06-12 Qingyun Zeng , Simin Ma , Arash Niknafs , Ashish Basran , Carol Szabo

Supervised Fine-Tuning (SFT) is an effective method for adapting Large Language Models (LLMs) on downstream tasks. However, variability in training data can hinder a model's ability to generalize across domains. This paper studies the…

Computation and Language · Computer Science 2025-10-07 Davood Rafiei , Morgan Lindsay Heisler , Weiwei Zhang , Mohammadreza Pourreza , Yong Zhang

Text-to-SQL tasks have gained attractive improvements since the release of ChatGPT. Among them, agent-based frameworks have been widely used in this field. However, the impact of data-centric strategies on text-to-SQL tasks has rarely been…

Computation and Language · Computer Science 2025-10-28 Yuanzhen Xie , Liu Ye , Jiqun Chu , Mochi Gao , Hehuan Liu , Yunzhi Tan , Bo Hu , Zang Li

Robust evaluation in the presence of linguistic variation is key to understanding the generalization capabilities of Natural Language to SQL (NL2SQL) models, yet existing benchmarks rarely address this factor in a systematic or controlled…

Computation and Language · Computer Science 2025-09-08 Mohammadtaher Safarzadeh , Afshin Oroojlooyjadid , Dan Roth

Natural Language Interfaces for Databases empower non-technical users to interact with data using natural language (NL). Advanced approaches, utilizing either neural sequence-to-sequence or more recent sophisticated large-scale language…

Databases · Computer Science 2026-01-09 Yuankai Fan , Tonghui Ren , Can Huang , Zhenying He , X. Sean Wang

We present a modular, interactive system, SPORTSQL, for natural language querying and visualization of dynamic sports data, with a focus on the English Premier League (EPL). The system translates user questions into executable SQL over a…

Computation and Language · Computer Science 2025-08-26 Sebastian Martinez , Naman Ahuja , Fenil Bardoliya , Chris Bryan , Vivek Gupta

While Large Language Models (LLMs) have significantly advanced Text-to-SQL performance, existing benchmarks predominantly focus on Western contexts and simplified schemas, leaving a gap in real-world, non-Western applications. We present…

Computation and Language · Computer Science 2026-04-16 Aviral Dawar , Roshan Karanth , Vikram Goyal , Dhruv Kumar

Text-to-SQL conversion is a critical innovation, simplifying the transition from complex SQL to intuitive natural language queries, especially significant given SQL's prevalence in the job market across various roles. The rise of Large…

Computation and Language · Computer Science 2024-07-23 Tingkai Zhang , Chaoyu Chen , Cong Liao , Jun Wang , Xudong Zhao , Hang Yu , Jianchao Wang , Jianguo Li , Wenhui Shi

With Large Language Models' (LLMs) emergent abilities on code generation tasks, Text-to-SQL has become one of the most popular downstream applications. Despite the strong results of multiple recent LLM-based Text-to-SQL frameworks, the…

Machine Learning · Computer Science 2025-09-09 Dazhi Peng

Large Language Model-based (LLM-based) Text-to-SQL methods have achieved important progress in generating SQL queries for real-world applications. When confronted with table content-aware questions in real-world scenarios, ambiguous data…

Databases · Computer Science 2025-11-07 Wenbo Xu , Liang Yan , Chuanyi Liu , Peiyi Han , Haifeng Zhu , Yong Xu , Yingwei Liang , Bob Zhang

Recent advancements in large language models (LLMs) have significantly improved performance on the Text-to-SQL task. However, prior approaches typically rely on static, pre-processed database information provided at inference time, which…

Computation and Language · Computer Science 2025-06-23 Wenxuan Xie , Yaxun Dai , Wenhao Jiang

Calibration is crucial as large language models (LLMs) are increasingly deployed to convert natural language queries into SQL for commercial databases. In this work, we investigate calibration techniques for assigning confidence to…

Databases · Computer Science 2024-11-28 Ashwin Ramachandran , Sunita Sarawagi

Large language models have driven major advances in Text-to-SQL generation. However, they suffer from high computational cost, long latency, and data privacy concerns, which make them impractical for many real-world applications. A natural…

In-context learning (ICL) has emerged as a new approach to various natural language processing tasks, utilizing large language models (LLMs) to make predictions based on context that has been supplemented with a few examples or…

Computation and Language · Computer Science 2023-05-23 Linyong Nan , Yilun Zhao , Weijin Zou , Narutatsu Ri , Jaesung Tae , Ellen Zhang , Arman Cohan , Dragomir Radev

Text-to-SQL is a subtask in semantic parsing that has seen rapid progress with the evolution of Large Language Models (LLMs). However, LLMs face challenges due to hallucination issues and a lack of domain-specific database knowledge(such as…

Computation and Language · Computer Science 2025-02-26 Xingyu Ma , Xin Tian , Lingxiang Wu , Xuepeng Wang , Xueming Tang , Jinqiao Wang

Leading models for the text-to-SQL task heavily rely on proprietary Large Language Models (LLMs), posing concerns over data privacy. Closing the performance gap between small open-source models and large proprietary models is crucial to…

Computation and Language · Computer Science 2024-02-05 Mohammadreza Pourreza , Davood Rafiei