English
Related papers

Related papers: Towards Robustness of Text-to-SQL Models against S…

200 papers

Translating natural language queries into SQLs in a seq2seq manner has attracted much attention recently. However, compared with abstract-syntactic-tree-based SQL generation, seq2seq semantic parsers face much more challenges, including…

Computation and Language · Computer Science 2023-06-16 Yuntao Li , Zhenpeng Su , Yutian Li , Hanchu Zhang , Sirui Wang , Wei Wu , Yan Zhang

In Text-to-SQL, execution feedback is essential for guiding large language models (LLMs) to reason accurately and generate reliable SQL queries. However, existing methods treat execution feedback solely as a post-hoc signal for correction…

Computation and Language · Computer Science 2025-05-21 Yaxun Dai , Wenxuan Xie , Xialie Zhuang , Tianyu Yang , Yiying Yang , Haiqin Yang , Yuhang Zhao , Pingfu Chao , Wenhao Jiang

We introduce SQLSpace, a human-interpretable, generalizable, compact representation for text-to-SQL examples derived with minimal human intervention. We demonstrate the utility of these representations in evaluation with three use cases:…

Computation and Language · Computer Science 2025-11-03 Neha Srikanth , Victor Bursztyn , Puneet Mathur , Ani Nenkova

Conversational text-to-SQL aims at converting multi-turn natural language queries into their corresponding SQL (Structured Query Language) representations. One of the most intractable problems of conversational text-to-SQL is modelling the…

Computation and Language · Computer Science 2022-07-27 Yuntao Li , Hanchu Zhang , Yutian Li , Sirui Wang , Wei Wu , Yan Zhang

In-context learning of large-language models (LLMs) has achieved remarkable success in the field of natural language processing, while extensive case studies reveal that the single-step chain-of-thought prompting approach faces challenges…

Computation and Language · Computer Science 2024-07-04 Yuanzhen Xie , Xinzhou Jin , Tao Xie , MingXiong Lin , Liang Chen , Chenyun Yu , Lei Cheng , ChengXiang Zhuo , Bo Hu , Zang Li

This work reframes the Text-to-SQL task as a pathway for teaching large language models (LLMs) to reason over and manipulate tabular data--moving beyond the traditional focus on query generation. We propose a two-stage framework that…

Computation and Language · Computer Science 2025-05-05 Josefa Lia Stoisser , Marc Boubnovski Martell , Julien Fauqueur

Translating natural language utterances to executable queries is a helpful technique in making the vast amount of data stored in relational databases accessible to a wider range of non-tech-savvy end users. Prior work in this area has…

Computation and Language · Computer Science 2020-10-21 Karthik Radhakrishnan , Arvind Srikantan , Xi Victoria Lin

Natural Language Interfaces for Databases empower non-technical users to interact with data using natural language (NL). Advanced approaches, utilizing either neural sequence-to-sequence or more recent sophisticated large-scale language…

Databases · Computer Science 2026-01-09 Yuankai Fan , Tonghui Ren , Can Huang , Zhenying He , X. Sean Wang

The surge of state-of-the-art Transformer-based models has undoubtedly pushed the limits of NLP model performance, excelling in a variety of tasks. We cast the spotlight on the underexplored task of Natural Language Inference (NLI), since…

Computation and Language · Computer Science 2025-08-04 Alexandros Koulakos , Maria Lymperaiou , Giorgos Filandrianos , Giorgos Stamou

Text-to-SQL systems empower users to interact with databases using natural language, automatically translating queries into executable SQL code. However, their reliance on database schema information for SQL generation exposes them to…

Computation and Language · Computer Science 2025-06-04 Đorđe Klisura , Anthony Rios

Recent years have seen great success in the use of neural seq2seq models on the text-to-SQL task. However, little work has paid attention to how these models generalize to realistic unseen data, which naturally raises a question: does this…

Computation and Language · Computer Science 2019-08-30 Shuaichen Chang , Pengfei Liu , Yun Tang , Jing Huang , Xiaodong He , Bowen Zhou

Recent In-Context Learning based methods have achieved remarkable success in Text-to-SQL task. However, there is still a large gap between the performance of these models and human performance on datasets with complex database schema and…

Computation and Language · Computer Science 2024-11-08 Wenxuan Xie , Gaochen Wu , Bowen Zhou

LLMs when used with Retrieval Augmented Generation (RAG), are greatly improving the SOTA of translating natural language queries to structured and correct SQL. Unlike previous reviews, this survey provides a comprehensive study of the…

Computation and Language · Computer Science 2025-02-05 Ali Mohammadjafari , Anthony S. Maida , Raju Gottumukkala

Text-to-SQL is a challenging task involving multiple reasoning-intensive subtasks, including natural language understanding, database schema comprehension, and precise SQL query formulation. Existing approaches often rely on handcrafted…

Text-to-SQL systems have achieved strong performance on English benchmarks, yet their behavior in morphologically rich, low-resource languages remains largely unexplored. We introduce BIRDTurk, the first Turkish adaptation of the BIRD…

Text-to-SQL, which maps natural language to SQL queries, has benefited greatly from recent advances in Large Language Models (LLMs). While LLMs offer various paradigms for this task, including prompting and supervised fine-tuning (SFT), SFT…

Computation and Language · Computer Science 2025-09-24 Jinwang Song , Hongying Zan , Kunli Zhang , Lingling Mu , Yingjie Han , Haobo Hua , Min Peng

Crafting adversarial examples has become an important technique to evaluate the robustness of deep neural networks (DNNs). However, most existing works focus on attacking the image classification problem since its input space is continuous…

Machine Learning · Computer Science 2020-04-22 Minhao Cheng , Jinfeng Yi , Pin-Yu Chen , Huan Zhang , Cho-Jui Hsieh

Text-to-SQL systems translate natural language (NL) questions into SQL queries, enabling non-technical users to interact with structured data. While large language models (LLMs) have shown promising results on the text-to-SQL task, they…

Computation and Language · Computer Science 2025-06-06 Yue Gong , Chuan Lei , Xiao Qin , Kapil Vaidya , Balakrishnan Narayanaswamy , Tim Kraska

The schema-guided paradigm overcomes scalability issues inherent in building task-oriented dialogue (TOD) agents with static ontologies. Instead of operating on dialogue context alone, agents have access to hierarchical schemas containing…

Computation and Language · Computer Science 2023-03-20 A. Coca , B. H. Tseng , W. Lin , B. Byrne

Generating accurate SQL from users' natural language questions (text-to-SQL) remains a long-standing challenge due to the complexities involved in user question understanding, database schema comprehension, and SQL generation. Traditional…

Computation and Language · Computer Science 2025-11-25 Zijin Hong , Zheng Yuan , Qinggang Zhang , Hao Chen , Junnan Dong , Feiran Huang , Xiao Huang