English
Related papers

Related papers: KaggleDBQA: Realistic Evaluation of Text-to-SQL Pa…

200 papers

Most deep learning approaches for text-to-SQL generation are limited to the WikiSQL dataset, which only supports very simple queries over a single table. We focus on the Spider dataset, a complex and cross-domain text-to-SQL task, which…

Computation and Language · Computer Science 2019-08-20 Dongjun Lee

Natural language is hypothetically the best user interface for many domains. However, general models that provide an interface between natural language and any other domain still do not exist. Providing natural language interface to…

Computation and Language · Computer Science 2020-05-18 Jovan Kalajdjieski , Martina Toshevska , Frosina Stojanovska

Text-to-SQL translation enables non-expert users to query relational databases using natural language, with applications in education and business intelligence. This study evaluates three lightweight transformer models - T5-Small,…

Computation and Language · Computer Science 2025-08-07 Chirag Seth , Utkarsh Singh

We present a neural approach called IRNet for complex and cross-domain Text-to-SQL. IRNet aims to address two challenges: 1) the mismatch between intents expressed in natural language (NL) and the implementation details in SQL; 2) the…

Computation and Language · Computer Science 2019-05-30 Jiaqi Guo , Zecheng Zhan , Yan Gao , Yan Xiao , Jian-Guang Lou , Ting Liu , Dongmei Zhang

Text-to-SQL models, which parse natural language (NL) questions to executable SQL queries, are increasingly adopted in real-world applications. However, deploying such models in the real world often requires adapting them to the highly…

Human-Computer Interaction · Computer Science 2025-11-17 Yuan Tian , Daniel Lee , Fei Wu , Tung Mai , Kun Qian , Siddhartha Sahai , Tianyi Zhang , Yunyao Li

Recently, there has been increasing interest in synthesizing data to improve downstream text-to-SQL tasks. In this paper, we first examined the existing synthesized datasets and discovered that state-of-the-art text-to-SQL algorithms did…

Large language models (LLMs) have advanced Text-to-SQL, yet existing solutions still fall short of system-level reliability. The limitation is not merely in individual modules -- e.g., schema linking, reasoning, and verification -- but more…

Databases · Computer Science 2026-04-06 Boyan Li , Chong Chen , Zhujun Xue , Yinan Mei , Yuyu Luo

The potential for improvements brought by Large Language Models (LLMs) in Text-to-SQL systems is mostly assessed on monolingual English datasets. However, LLMs' performance for other languages remains vastly unexplored. In this work, we…

Computation and Language · Computer Science 2024-06-07 Farhad Nooralahzadeh , Yi Zhang , Ellery Smith , Sabine Maennel , Cyril Matthey-Doret , Raphaël de Fondville , Kurt Stockinger

Current SQL generators based on pre-trained language models struggle to answer complex questions requiring domain context or understanding fine-grained table structure. Humans would deal with these unknowns by reasoning over the…

Computation and Language · Computer Science 2022-11-14 Elena Soare , Iain Mackie , Jeffrey Dalton

Text-to-SQL semantic parsing is an important NLP task, which greatly facilitates the interaction between users and the database and becomes the key component in many human-computer interaction systems. Much recent progress in text-to-SQL…

Computation and Language · Computer Science 2022-12-29 Longxu Dou , Yan Gao , Mingyang Pan , Dingzirui Wang , Wanxiang Che , Dechen Zhan , Jian-Guang Lou

Knowledge base question answering (KBQA) is a critical yet challenging task due to the vast number of entities within knowledge bases and the diversity of natural language questions posed by users. Unfortunately, the performance of most…

Computation and Language · Computer Science 2024-01-29 Zhenyu Li , Sunqi Fan , Yu Gu , Xiuxing Li , Zhichao Duan , Bowen Dong , Ning Liu , Jianyong Wang

Conversational, multi-turn, text-to-SQL (CoSQL) tasks map natural language utterances in a dialogue to SQL queries. State-of-the-art (SOTA) systems use large, pre-trained and finetuned language models, such as the T5-family, in conjunction…

Computation and Language · Computer Science 2023-02-23 Sree Hari Krishnan Parthasarathi , Lu Zeng , Dilek Hakkani-Tur

Text-to-SQL is a subtask in semantic parsing that has seen rapid progress with the evolution of Large Language Models (LLMs). However, LLMs face challenges due to hallucination issues and a lack of domain-specific database knowledge(such as…

Computation and Language · Computer Science 2025-02-26 Xingyu Ma , Xin Tian , Lingxiang Wu , Xuepeng Wang , Xueming Tang , Jinqiao Wang

Text-to-SQLs enables non-expert users to effortlessly retrieve desired information from relational databases using natural language queries. While recent advancements, particularly with Large Language Models (LLMs) like GPT and T5, have…

Databases · Computer Science 2024-10-04 Shouvon Sarker , Xishuang Dong , Xiangfang Li , Lijun Qian

The existing text-to-SQL systems have made significant progress in SQL query generation, but they still face numerous challenges. Existing systems often lack retrieval capabilities for open-domain databases, requiring users to manually…

Computation and Language · Computer Science 2025-04-15 Keyan Xu , Dingzirui Wang , Xuanliang Zhang , Qingfu Zhu , Wanxiang Che

Text-to-SQL translates natural language queries into Structured Query Language (SQL) commands, enabling users to interact with databases using natural language. Essentially, the text-to-SQL task is a text generation task, and its…

Databases · Computer Science 2024-10-10 Xiaohu Zhu , Qian Li , Lizhen Cui , Yongkang Liu

Language models have shown promising performance on the task of translating natural language questions into SQL queries (Text-to-SQL). However, most of the state-of-the-art (SOTA) approaches rely on powerful yet closed-source large language…

Computation and Language · Computer Science 2024-02-27 Haoyang Li , Jing Zhang , Hanbing Liu , Ju Fan , Xiaokang Zhang , Jun Zhu , Renjie Wei , Hongyan Pan , Cuiping Li , Hong Chen

Querying a relational database is difficult because it requires users to know both the SQL language and be familiar with the schema. On the other hand, many users possess enough domain familiarity or expertise to describe their desired…

Databases · Computer Science 2020-03-25 Christopher Baik , Zhongjun Jin , Michael Cafarella , H. V. Jagadish

LLMs when used with Retrieval Augmented Generation (RAG), are greatly improving the SOTA of translating natural language queries to structured and correct SQL. Unlike previous reviews, this survey provides a comprehensive study of the…

Computation and Language · Computer Science 2025-02-05 Ali Mohammadjafari , Anthony S. Maida , Raju Gottumukkala

With Large Language Models' (LLMs) emergent abilities on code generation tasks, Text-to-SQL has become one of the most popular downstream applications. Despite the strong results of multiple recent LLM-based Text-to-SQL frameworks, the…

Machine Learning · Computer Science 2025-09-09 Dazhi Peng