English
Related papers

Related papers: Reflective Reasoning for SQL Generation

200 papers

Large language models (LLMs) have demonstrated strong performance in translating natural language questions into SQL queries (Text-to-SQL). In contrast, small language models (SLMs) ranging from 0.5B to 1.5B parameters currently…

Computation and Language · Computer Science 2025-07-31 Lei Sheng , Shuai-Shuai Xu

Large Language Models (LLMs) can translate natural language into SQL, but small models struggle with multi-table and complex queries in Zero-Shot Learning (ZSL) settings. While Supervised Fine-Tuning (SFT) helps, it falls short for harder…

Machine Learning · Computer Science 2026-05-05 Simone Papicchio , Simone Rossi , Luca Cagliero , Paolo Papotti

Recent advancements in large language models (LLMs) have significantly contributed to the progress of the Text-to-SQL task. A common requirement in many of these works is the post-correction of SQL queries. However, the majority of this…

Databases · Computer Science 2025-01-10 Chaofan Li , Yingxia Shao , Yawen Li , Zheng Liu

This study explores text-to-SQL parsing by leveraging the powerful reasoning capabilities of large language models (LLMs). Despite recent advancements, existing LLM-based methods are still inefficient and struggle to handle cases with wide…

Computation and Language · Computer Science 2025-11-14 Guanming Xiong , Junwei Bao , Hongfei Jiang , Yang Song , Wen Zhao

We explore using T5 (Raffel et al. (2019)) to directly translate natural language questions into SQL statements. General purpose natural language that interfaces to information stored within databases requires flexibly translating natural…

Artificial Intelligence · Computer Science 2020-11-10 Ning Li , Bethany Keller , Mark Butler , Daniel Cer

Text-to-SQL systems powered by Large Language Models have excelled on academic benchmarks but struggle in complex enterprise environments. The primary limitation lies in their reliance on static schema representations, which fails to…

Databases · Computer Science 2026-02-20 Bowen Cao , Weibin Liao , Yushi Sun , Dong Fang , Haitao Li , Wai Lam

While large language models (LLMs) are proficient at question-answering (QA), it is not always clear how (or even if) an answer follows from their latent "beliefs". This lack of interpretability is a growing impediment to widespread use of…

Computation and Language · Computer Science 2023-10-31 Nora Kassner , Oyvind Tafjord , Ashish Sabharwal , Kyle Richardson , Hinrich Schuetze , Peter Clark

Transforming natural language into SQL queries (NL2SQL) is crucial for data-driven business applications. Existing frameworks, trained on open-source datasets, struggle with complex business logic and lack domain-specific data for…

Databases · Computer Science 2025-07-16 Song Cheng , Qiannan Cheng , Linbo Jin , Lei Yi , Guannan Zhang

Large language models (LLMs) suffer from high inference latency due to the auto-regressive decoding process. Speculative decoding accelerates inference by generating multiple draft tokens using a lightweight model and verifying them in…

Machine Learning · Computer Science 2025-05-27 Yixuan Wang , Yijun Liu , Shiyu ji , Yuzhuang Xu , Yang Xu , Qingfu Zhu , Wanxiang Che

Despite strong performance on Text-to-SQL benchmarks, it remains unclear whether LLM-generated SQL programs are structurally reliable. In this work, we investigate the structural behavior of LLM-generated SQL queries and introduce…

Computation and Language · Computer Science 2026-04-09 Yixi Zhou , Fan Zhang , Zhiqiao Guo , Yu Chen , Haipeng Zhang , Preslav Nakov , Zhuohan Xie

Methods to generate text from structured data have advanced significantly in recent years, primarily due to fine-tuning of pre-trained language models on large datasets. However, such models can fail to produce output faithful to the input…

Computation and Language · Computer Science 2023-07-12 Zhuoer Wang , Marcus Collins , Nikhita Vedula , Simone Filice , Shervin Malmasi , Oleg Rokhlenko

Large Language Models (LLMs) can generate SQL queries from natural language questions but struggle with database-specific schemas and tacit domain knowledge. We introduce a framework for continual learning from human feedback in…

Computation and Language · Computer Science 2025-12-01 Thomas Cook , Kelly Patel , Sivapriya Vellaichamy , Udari Madhushani Sehwag , Saba Rahimi , Zhen Zeng , Sumitra Ganesh

Despite their remarkable capabilities, large language models (LLMs) often produce responses containing factual inaccuracies due to their sole reliance on the parametric knowledge they encapsulate. Retrieval-Augmented Generation (RAG), an ad…

Computation and Language · Computer Science 2023-10-19 Akari Asai , Zeqiu Wu , Yizhong Wang , Avirup Sil , Hannaneh Hajishirzi

Text-to-SQLs enables non-expert users to effortlessly retrieve desired information from relational databases using natural language queries. While recent advancements, particularly with Large Language Models (LLMs) like GPT and T5, have…

Databases · Computer Science 2024-10-04 Shouvon Sarker , Xishuang Dong , Xiangfang Li , Lijun Qian

We introduce Refinement Reflection, a new framework for building SMT-based deductive verifiers. The key idea is to reflect the code implementing a user-defined function into the function's (output) refinement type. As a consequence, at uses…

Programming Languages · Computer Science 2019-07-16 Niki Vazou , Anish Tondwalkar , Vikraman Choudhury , Ryan G. Scott , Ryan R. Newton , Philip Wadler , Ranjit Jhala

Recent text-to-SQL systems powered by large language models (LLMs) have demonstrated remarkable performance in translating natural language queries into SQL. However, these systems often struggle with complex database structures and…

Computation and Language · Computer Science 2025-05-22 Haoyuan Ma , Yongliang Shen , Hengwei Liu , Wenqi Zhang , Haolei Xu , Qiuying Peng , Jun Wang , Weiming Lu

SQL-to-Text generation aims at translating structured SQL queries into natural language descriptions, thereby facilitating comprehension of complex database operations for non-technical users. Although large language models (LLMs) have…

Databases · Computer Science 2025-11-19 Sriom Chakrabarti , Chuangtao Ma , Arijit Khan , Sebastian Link

Text-to-SQL, the task of translating natural language questions into SQL queries, is part of various business processes. Its automation, which is an emerging challenge, will empower software practitioners to seamlessly interact with…

Software Engineering · Computer Science 2024-01-10 Yewei Song , Saad Ezzini , Xunzhu Tang , Cedric Lothritz , Jacques Klein , Tegawendé Bissyandé , Andrey Boytsov , Ulrick Ble , Anne Goujon

Deep research agents increasingly automate complex information-seeking tasks, producing evidence-grounded reports via multi-step reasoning, tool use, and synthesis. Their growing role demands scalable, reliable evaluation, positioning…

Computation and Language · Computer Science 2026-05-20 Leyao Wang , Yanan He , Peng Chen , Asaf Yehudai , Yixin Liu , Rex Ying , Michal Shmueli-Scheuer , Arman Cohan

Recently, there has been increasing interest in synthesizing data to improve downstream text-to-SQL tasks. In this paper, we first examined the existing synthesized datasets and discovered that state-of-the-art text-to-SQL algorithms did…