English
Related papers

Related papers: LLM-Based SQL Generation: Prompting, Self-Refineme…

200 papers

Text-to-SQL tasks have gained attractive improvements since the release of ChatGPT. Among them, agent-based frameworks have been widely used in this field. However, the impact of data-centric strategies on text-to-SQL tasks has rarely been…

Computation and Language · Computer Science 2025-10-28 Yuanzhen Xie , Liu Ye , Jiqun Chu , Mochi Gao , Hehuan Liu , Yunzhi Tan , Bo Hu , Zang Li

Text-to-SQL (T2SQL) evaluation in production environments poses fundamental challenges that existing benchmarks do not address. Current evaluation methodologies whether rule-based SQL matching or schema-dependent semantic parsers assume…

Artificial Intelligence · Computer Science 2026-05-01 Taslim Jamal Arif , Kuldeep Singh

We present HES-SQL, a novel hybrid training framework that advances Text-to-SQL generation through the integration of thinking-mode-fused supervised fine-tuning (SFT) with Group Relative Policy Optimization (GRPO). Our approach introduces…

Databases · Computer Science 2025-10-13 Suming Qiu , Jing Li , Zhicheng Zhou , Junjie Huang , Linyuan Qiu , Zhijie Sun

Text-to-SQL is a challenging task involving multiple reasoning-intensive subtasks, including natural language understanding, database schema comprehension, and precise SQL query formulation. Existing approaches often rely on handcrafted…

This study presents a comparative analysis of the a complex SQL benchmark, TPC-DS, with two existing text-to-SQL benchmarks, BIRD and Spider. Our findings reveal that TPC-DS queries exhibit a significantly higher level of structural…

Databases · Computer Science 2024-07-30 Limin Ma , Ken Pu , Ying Zhu

Translating natural language into SQL (Test2SQL) is a longstanding challenge at the intersection of natural language understanding and structured data access. While large language models (LLMs) have significantly improved fluency in SQL…

Computation and Language · Computer Science 2026-01-14 Zhewei Yao , Guoheng Sun , Lukasz Borchmann , Gaurav Nuti , Zheyu Shen , Minghang Deng , Bohan Zhai , Hao Zhang , Ang Li , Yuxiong He

Adapting large language models (LLMs) to a targeted task efficiently and effectively remains a fundamental challenge. Such adaptation often requires iteratively improving the model toward a targeted task, yet collecting high-quality…

Computation and Language · Computer Science 2026-04-30 Ting-Wei Li , Sirui Chen , Jiaru Zou , Yingbing Huang , Tianxin Wei , Jingrui He , Hanghang Tong

Transforming natural-language requests into reliable, production-ready data transformations remains challenging: correctness depends on precise schema linking and warehouse-specific SQL dialects, while the strongest supervision available…

Artificial Intelligence · Computer Science 2025-10-06 Anni Li , Aria Attar , Paul Dong

Table Question Answering (TQA) aims to answer natural language questions over structured tables. Large Language Models (LLMs) enable promising solutions to this problem, with operator-centric solutions that generate table manipulation…

Databases · Computer Science 2026-04-02 Fengyu Li , Junhao Zhu , Kaishi Song , Lu Chen , Zhongming Yao , Tianyi Li , Christian S. Jensen

Large Language Models (LLMs) have made significant progress in handling complex programming tasks. However, current methods rely on manual model selection and fixed workflows, which limit their ability to adapt to changing task…

Software Engineering · Computer Science 2026-03-18 Yulin Peng , Haowen Hou , Xinxin Zhu , Ying Tiffany He , F. Richard Yu

In Natural Language Processing (NLP), one of the most important tasks is text-to-SQL semantic parsing, which focuses on enabling users to interact with the database in a more natural manner. In recent years, text-to-SQL has made significant…

Computation and Language · Computer Science 2024-02-26 Saleh Almohaimeed , Saad Almohaimeed , Mansour Al Ghanim , Liqiang Wang

Robust evaluation in the presence of linguistic variation is key to understanding the generalization capabilities of Natural Language to SQL (NL2SQL) models, yet existing benchmarks rarely address this factor in a systematic or controlled…

Computation and Language · Computer Science 2025-09-08 Mohammadtaher Safarzadeh , Afshin Oroojlooyjadid , Dan Roth

Safe deployment of large language models (LLMs) may benefit from a reliable method for assessing their generated content to determine when to abstain or to selectively generate. While likelihood-based metrics such as perplexity are widely…

Computation and Language · Computer Science 2023-12-18 Jie Ren , Yao Zhao , Tu Vu , Peter J. Liu , Balaji Lakshminarayanan

Recent divide-and-conquer reasoning approaches, particularly those based on Chain-of-Thought (CoT), have substantially improved the Text-to-SQL capabilities of Large Language Models (LLMs). However, when applied to complex enterprise…

Computation and Language · Computer Science 2025-11-27 Zhifeng Hao , Qibin Song , Ruichu Cai , Boyan Xu

Transforming unstructured text into structured data is a complex task, requiring semantic understanding, reasoning, and structural comprehension. While Large Language Models (LLMs) offer potential, they often struggle with handling…

Computation and Language · Computer Science 2025-08-13 Rajmohan C , Sarthak Harne , Arvind Agarwal

Text-to-SQL, the task of translating natural language questions into SQL queries, plays a crucial role in enabling non-experts to interact with databases. While recent advancements in large language models (LLMs) have significantly enhanced…

Computation and Language · Computer Science 2025-07-15 Haoyang Li , Shang Wu , Xiaokang Zhang , Xinmei Huang , Jing Zhang , Fuxin Jiang , Shuai Wang , Tieying Zhang , Jianjun Chen , Rui Shi , Hong Chen , Cuiping Li

Leading models for the text-to-SQL task heavily rely on proprietary Large Language Models (LLMs), posing concerns over data privacy. Closing the performance gap between small open-source models and large proprietary models is crucial to…

Computation and Language · Computer Science 2024-02-05 Mohammadreza Pourreza , Davood Rafiei

Converting text into the structured query language (Text2SQL) is a research hotspot in the field of natural language processing (NLP), which has broad application prospects. In the era of big data, the use of databases has penetrated all…

Computation and Language · Computer Science 2023-05-19 Ran Shen , Gang Sun , Hao Shen , Yiling Li , Liangfeng Jin , Han Jiang

When translating natural language questions into SQL queries to answer questions from a database, contemporary semantic parsing models struggle to generalize to unseen database schemas. The generalization challenge lies in (a) encoding the…

Computation and Language · Computer Science 2021-08-25 Bailin Wang , Richard Shin , Xiaodong Liu , Oleksandr Polozov , Matthew Richardson

Recent advances in large language models (LLMs) have significantly improved the accuracy of Text-to-SQL systems. However, a critical challenge remains: the semantic mismatch between natural language questions (NLQs) and their corresponding…

Computation and Language · Computer Science 2025-08-21 Shaoming Duan , Zirui Wang , Chuanyi Liu , Zhibin Zhu , Yuhao Zhang , Peiyi Han , Liang Yan , Zewu Peng