English
Related papers

Related papers: Towards Robustness of Text-to-SQL Models against S…

200 papers

In Text-to-SQL semantic parsing, selecting the correct entities (tables and columns) for the generated SQL query is both crucial and challenging; the parser is required to connect the natural language (NL) question and the SQL query to the…

Computation and Language · Computer Science 2020-11-24 Sanxing Chen , Aidan San , Xiaodong Liu , Yangfeng Ji

Natural language interfaces to databases (NLIDB) democratize end user access to relational data. Due to fundamental differences between natural language communication and programming, it is common for end users to issue questions that are…

Computation and Language · Computer Science 2020-08-04 Jichuan Zeng , Xi Victoria Lin , Caiming Xiong , Richard Socher , Michael R. Lyu , Irwin King , Steven C. H. Hoi

Existing refinement methods in LLM-based Text-to-SQL systems exhibit limited effectiveness. They often introduce new errors during the self-correction process and fail to detect and correct semantic inaccuracies. To address these gaps, we…

Artificial Intelligence · Computer Science 2025-05-22 Jikai Chen , Leilei Gan , Ziyu Zhao , Zechuan Wang , Dong Wang , Chenyi Zhuang

Recently it has been shown that state-of-the-art NLP models are vulnerable to adversarial attacks, where the predictions of a model can be drastically altered by slight modifications to the input (such as synonym substitutions). While…

Computation and Language · Computer Science 2023-07-13 Yahan Yang , Soham Dan , Dan Roth , Insup Lee

Text-to-SQL over large analytical databases requires navigating complex schemas, resolving ambiguous queries, and grounding decisions in actual data. Most current systems follow a fixed pipeline where schema elements are retrieved once…

Computation and Language · Computer Science 2026-05-05 Quang Hieu Pham , Yang He , Ping Nie , Canwen Xu , Davood Rafiei , Yuepeng Wang , Xi Ye , Jocelyn Qiaochu Chen

Text-to-SQL translates natural language queries into Structured Query Language (SQL) commands, enabling users to interact with databases using natural language. Essentially, the text-to-SQL task is a text generation task, and its…

Databases · Computer Science 2024-10-10 Xiaohu Zhu , Qian Li , Lizhen Cui , Yongkang Liu

Recently, code-oriented large language models (LLMs) have demonstrated strong capabilities in translating natural language into executable code. Text-to-SQL is a significant application of this ability, enabling non-technical users to…

Artificial Intelligence · Computer Science 2026-04-21 Salmane Chafik , Saad Ezzini , Ismail Berrada

Large language models revolutionize Text2SQL through supervised fine-tuning, yet a crucial limitation is overlooked: the complexity of databases leads to an increased context length, consequently resulting in higher GPU memory demands for…

Databases · Computer Science 2024-10-16 Wen Wuzhenghong , Zhang Yongpan , Pan Su , Sun Yuwei , Lu Pengwei , Ding Cheng

Large language models (LLMs) have advanced Text-to-SQL, yet existing solutions still fall short of system-level reliability. The limitation is not merely in individual modules -- e.g., schema linking, reasoning, and verification -- but more…

Databases · Computer Science 2026-04-06 Boyan Li , Chong Chen , Zhujun Xue , Yinan Mei , Yuyu Luo

Recent advancements in large language models (LLMs) have enabled in-context learning (ICL)-based methods that significantly outperform fine-tuning approaches for text-to-SQL tasks. However, their performance is still considerably lower than…

Computation and Language · Computer Science 2024-05-14 Dongjun Lee , Choongwon Park , Jaehyuk Kim , Heesoo Park

While recent advancements in inference-time learning have improved LLM reasoning on Text-to-SQL tasks, current solutions still struggle to perform well on the most challenging tasks in the Bird-Bench (BIRD) benchmark. This is due to…

Computation and Language · Computer Science 2026-05-11 James Petullo , Nianwen Xue

NoSQL databases have become increasingly popular due to their outstanding performance in handling large-scale, unstructured, and semi-structured data, highlighting the need for user-friendly interfaces to bridge the gap between…

Databases · Computer Science 2025-02-19 Jinwei Lu , Yuanfeng Song , Zhiqian Qin , Haodi Zhang , Chen Zhang , Raymond Chi-Wing Wong

In recent years,Text-to-SQL, the problem of automatically converting questions posed in natural language to formal SQL queries, has emerged as an important problem at the intersection of natural language processing and data management…

Computation and Language · Computer Science 2024-09-17 Ke Shen , Mayank Kejriwal

This paper aims to improve the performance of text-to-SQL parsing by exploring the intrinsic uncertainties in the neural network based approaches (called SUN). From the data uncertainty perspective, it is indisputable that a single SQL can…

Computation and Language · Computer Science 2022-10-31 Bowen Qin , Lihan Wang , Binyuan Hui , Bowen Li , Xiangpeng Wei , Binhua Li , Fei Huang , Luo Si , Min Yang , Yongbin Li

Semantic parsing maps natural language (NL) utterances into logical forms (LFs), which underpins many advanced NLP problems. Semantic parsers gain performance boosts with deep neural networks, but inherit vulnerabilities against adversarial…

Computation and Language · Computer Science 2021-02-04 Shuo Huang , Zhuang Li , Lizhen Qu , Lei Pan

Most modern Text2SQL systems prompt large language models (LLMs) with entire schemas -- mostly column information -- alongside the user's question. While effective on small databases, this approach fails on real-world schemas that exceed…

Databases · Computer Science 2025-12-19 Thanh Dat Hoang , Thanh Tam Nguyen , Thanh Trung Huynh , Hongzhi Yin , Quoc Viet Hung Nguyen

Despite the significant advancements of self-play fine-tuning (SPIN), which can transform a weak large language model (LLM) into a strong one through competitive interactions between models of varying capabilities, it still faces challenges…

Computation and Language · Computer Science 2025-10-14 Yuhao Zhang , Shaoming Duan , Jinhang Su , Chuanyi Liu , Peiyi Han

Relational structures such as schema linking and schema encoding have been validated as a key component to qualitatively translating natural language into SQL queries. However, introducing these structural relations comes with prices: they…

Computation and Language · Computer Science 2022-10-11 Jiexing Qi , Jingyao Tang , Ziwei He , Xiangpeng Wan , Yu Cheng , Chenghu Zhou , Xinbing Wang , Quanshi Zhang , Zhouhan Lin

Explaining the decisions of AI has become vital for fostering appropriate user trust in these systems. This paper investigates explanations for a structured prediction task called ``text-to-SQL Semantic Parsing'', which translates a natural…

Information Retrieval · Computer Science 2024-11-26 Daking Rai , Rydia R. Weiland , Kayla Margaret Gabriella Herrera , Tyler H. Shaw , Ziyu Yao

Despite strong performance on Text-to-SQL benchmarks, it remains unclear whether LLM-generated SQL programs are structurally reliable. In this work, we investigate the structural behavior of LLM-generated SQL queries and introduce…

Computation and Language · Computer Science 2026-04-09 Yixi Zhou , Fan Zhang , Zhiqiao Guo , Yu Chen , Haipeng Zhang , Preslav Nakov , Zhuohan Xie