English
Related papers

Related papers: Text-to-SQL Error Correction with Language Models …

200 papers

The introduction of large language models has brought rapid progress on Text-to-SQL benchmarks, but it is not yet easy to build a working enterprise solution. In this paper, we present insights from building an internal chatbot that enables…

Generating accurate SQL queries for user questions (text-to-SQL) has been a long-standing challenge since it requires a deep understanding of both the user's question and the corresponding database schema in order to retrieve the desired…

Computation and Language · Computer Science 2024-06-07 Zijin Hong , Zheng Yuan , Hao Chen , Qinggang Zhang , Feiran Huang , Xiao Huang

Confidence estimation for text-to-SQL aims to assess the reliability of model-generated SQL queries without having access to gold answers. We study this problem in the context of large language models (LLMs), where access to model weights…

Computation and Language · Computer Science 2025-08-21 Sepideh Entezari Maleki , Mohammadreza Pourreza , Davood Rafiei

We present a simple methods to leverage the table content for the BERT-based model to solve the text-to-SQL problem. Based on the observation that some of the table content match some words in question string and some of the table header…

Computation and Language · Computer Science 2020-04-23 Tong Guo , Huilin Gao

We present a sequence-to-action parsing approach for the natural language to SQL task that incrementally fills the slots of a SQL query with feasible actions from a pre-defined inventory. To account for the fact that typically there are…

Computation and Language · Computer Science 2018-10-05 Tianze Shi , Kedar Tatwawadi , Kaushik Chakrabarti , Yi Mao , Oleksandr Polozov , Weizhu Chen

Text-to-SQL is a crucial task toward developing methods for understanding natural language by computers. Recent neural approaches deliver excellent performance; however, models that are difficult to interpret inhibit future developments.…

Computation and Language · Computer Science 2021-02-04 Yasufumi Taniguchi , Hiroki Nakayama , Kubo Takahiro , Jun Suzuki

Training code-switched language models is difficult due to lack of data and complexity in the grammatical structure. Linguistic constraint theories have been used for decades to generate artificial code-switching sentences to cope with this…

Computation and Language · Computer Science 2019-09-19 Genta Indra Winata , Andrea Madotto , Chien-Sheng Wu , Pascale Fung

Text-to-SQL task maps natural language utterances to structured queries that can be issued to a database. State-of-the-art (SOTA) systems rely on finetuning large, pre-trained language models in conjunction with constrained decoding…

Computation and Language · Computer Science 2022-10-20 Lu Zeng , Sree Hari Krishnan Parthasarathi , Dilek Hakkani-Tur

We introduce a framework for generating Chain-of-Thought (CoT) rationales to enhance text-to-SQL model fine-tuning. These rationales consist of intermediate SQL statements and explanations, serving as incremental steps toward constructing…

Computation and Language · Computer Science 2025-03-21 Gaetano Rossiello , Nhan Pham , Michael Glass , Junkyu Lee , Dharmashankar Subramanian

Automatic spelling and grammatical correction systems are one of the most widely used tools within natural language applications. In this thesis, we assume the task of error correction as a type of monolingual machine translation where the…

Computation and Language · Computer Science 2018-10-02 Sina Ahmadi

We present a generative model to map natural language questions into SQL queries. Existing neural network based approaches typically generate a SQL query word-by-word, however, a large portion of the generated results are incorrect or not…

Computation and Language · Computer Science 2018-04-24 Yibo Sun , Duyu Tang , Nan Duan , Jianshu Ji , Guihong Cao , Xiaocheng Feng , Bing Qin , Ting Liu , Ming Zhou

Large Language Models (LLMs) exhibit impressive problem-solving skills across many tasks, but they still underperform compared to humans in various downstream applications, such as text-to-SQL. On the BIRD benchmark leaderboard, human…

Computation and Language · Computer Science 2024-11-21 Zhibo Chu , Zichong Wang , Qitao Qin

Current self-correction approaches in text-to-SQL face two critical limitations: 1) Conventional self-correction methods rely on recursive self-calls of LLMs, resulting in multiplicative computational overhead, and 2) LLMs struggle to…

Computation and Language · Computer Science 2025-06-03 Ge Qu , Jinyang Li , Bowen Qin , Xiaolong Li , Nan Huo , Chenhao Ma , Reynold Cheng

The data-centric paradigm has emerged as a pivotal direction in artificial intelligence (AI), emphasizing the role of high-quality training data. This shift is especially critical in the Text-to-SQL task, where the scarcity, limited…

Computation and Language · Computer Science 2026-02-11 Qifeng Cai , Hao Liang , Chang Xu , Tao Xie , Wentao Zhang , Bin Cui

Evaluating text-to-SQL systems remains largely fragile: correctness is typically judged by executing predicted and gold SQL queries on a single static database, even though the same queries may behave differently under alternative database…

Databases · Computer Science 2026-05-01 Mohammadamin Habibollah , Davood Rafiei

Recent neural approaches to data-to-text generation have mostly focused on improving content fidelity while lacking explicit control over writing styles (e.g., word choices, sentence structures). More traditional systems use templates to…

Computation and Language · Computer Science 2020-10-12 Shuai Lin , Wentao Wang , Zichao Yang , Xiaodan Liang , Frank F. Xu , Eric Xing , Zhiting Hu

In the context of the Text-to-SQL task, table and column descriptions are crucial for bridging the gap between natural language and database schema. This report proposes a method for automatically generating effective database descriptions…

Artificial Intelligence · Computer Science 2025-03-03 Yingqi Gao , Zhiling Luo

There is currently a significant gap between the performance of fine-tuned models and prompting approaches using Large Language Models (LLMs) on the challenging task of text-to-SQL, as evaluated on datasets such as Spider. To improve the…

Computation and Language · Computer Science 2023-11-06 Mohammadreza Pourreza , Davood Rafiei

Large language models (LLMs) have advanced Text-to-SQL, yet existing solutions still fall short of system-level reliability. The limitation is not merely in individual modules -- e.g., schema linking, reasoning, and verification -- but more…

Databases · Computer Science 2026-04-06 Boyan Li , Chong Chen , Zhujun Xue , Yinan Mei , Yuyu Luo

We present a novel approach to data-to-text generation based on iterative text editing. Our approach maximizes the completeness and semantic accuracy of the output text while leveraging the abilities of recent pre-trained models for text…

Computation and Language · Computer Science 2021-01-29 Zdeněk Kasner , Ondřej Dušek