English
Related papers

Related papers: MultiSpider: Towards Benchmarking Multilingual Tex…

200 papers

A bottleneck to developing Semantic Parsing (SP) models is the need for a large volume of human-labeled training data. Given the complexity and cost of human annotation for SP, labeled data is often scarce, particularly in multilingual…

Computation and Language · Computer Science 2022-10-17 Andy Rosenbaum , Saleh Soltan , Wael Hamza , Amir Saffari , Marco Damonte , Isabel Groves

In the era of large language models, Text-to-SQL, as a natural language interface for databases, is playing an increasingly important role. The sota Text-to-SQL models have achieved impressive accuracy, but their performance critically…

Databases · Computer Science 2026-02-13 Yafeng Nan , Haifeng Sun , Zirui Zhuang , Qi Qi , Guojun Chu , Jianxin Liao , Dan Pei , Jingyu Wang

This study presents AraSpider, the first Arabic version of the Spider dataset, aimed at improving natural language processing (NLP) in the Arabic-speaking community. Four multilingual translation models were tested for their effectiveness…

Computation and Language · Computer Science 2024-02-13 Ahmed Heakl , Youssef Mohamed , Ahmed B. Zaky

Translating users' natural language queries (NL) into SQL queries (i.e., Text-to-SQL, a.k.a. NL2SQL) can significantly reduce barriers to accessing relational databases and support various commercial applications. The performance of…

Databases · Computer Science 2025-12-08 Xinyu Liu , Shuyu Shen , Boyan Li , Peixian Ma , Runzhi Jiang , Yuxin Zhang , Ju Fan , Guoliang Li , Nan Tang , Yuyu Luo

Large Language models (LLMs) have demonstrated significant potential in text-to-SQL reasoning tasks, yet a substantial performance gap persists between existing open-source models and their closed-source counterparts. In this paper, we…

Computation and Language · Computer Science 2025-09-23 Yu Guo , Dong Jin , Shenghao Ye , Shuangwu Chen , Jian Yang , Xiaobin Tan

A practical text-to-SQL system should generalize well on a wide variety of natural language questions, unseen database schemas, and novel SQL query structures. To comprehensively evaluate text-to-SQL systems, we introduce a UNIfied…

Text-to-SQL translates natural language queries into Structured Query Language (SQL) commands, enabling users to interact with databases using natural language. Essentially, the text-to-SQL task is a text generation task, and its…

Databases · Computer Science 2024-10-10 Xiaohu Zhu , Qian Li , Lizhen Cui , Yongkang Liu

In addressing the task of converting natural language to SQL queries, there are several semantic and syntactic challenges. It becomes increasingly important to understand and remedy the points of failure as the performance of semantic…

Computation and Language · Computer Science 2023-06-01 Parker Glenn , Parag Pravin Dakle , Preethi Raghavan

We study the task of semantic parse correction with natural language feedback. Given a natural language utterance, most semantic parsing systems pose the problem as one-shot translation where the utterance is mapped to a corresponding…

Computation and Language · Computer Science 2020-06-03 Ahmed Elgohary , Saghar Hosseini , Ahmed Hassan Awadallah

Despite recent progress in text-to-SQL parsing, current semantic parsers are still not accurate enough for practical use. In this paper, we investigate how to build automatic text-to-SQL error correction models. Noticing that token-level…

Computation and Language · Computer Science 2023-05-30 Ziru Chen , Shijie Chen , Michael White , Raymond Mooney , Ali Payani , Jayanth Srinivasa , Yu Su , Huan Sun

Recent divide-and-conquer reasoning approaches, particularly those based on Chain-of-Thought (CoT), have substantially improved the Text-to-SQL capabilities of Large Language Models (LLMs). However, when applied to complex enterprise…

Computation and Language · Computer Science 2025-11-27 Zhifeng Hao , Qibin Song , Ruichu Cai , Boyan Xu

Text-to-SQLs enables non-expert users to effortlessly retrieve desired information from relational databases using natural language queries. While recent advancements, particularly with Large Language Models (LLMs) like GPT and T5, have…

Databases · Computer Science 2024-10-04 Shouvon Sarker , Xishuang Dong , Xiangfang Li , Lijun Qian

Text-to-SQL models allow users to interact with a database more easily by generating executable SQL statements from natural-language questions. Despite recent successes on simpler databases and questions, current Text-to-SQL methods still…

Artificial Intelligence · Computer Science 2025-09-10 Heng Hao , Wenjun Hu , Oxana Verkholyak , Davoud Ataee Tarzanagh , Baruch Gutow , Sima Didari , Masoud Faraki , Hankyu Moon , Seungjai Min

Recently, there has been significant progress in studying neural networks to translate text descriptions into SQL queries. Despite achieving good performance on some public benchmarks, existing text-to-SQL models typically rely on the…

Computation and Language · Computer Science 2021-06-22 Yujian Gan , Xinyun Chen , Qiuping Huang , Matthew Purver , John R. Woodward , Jinxia Xie , Pengsheng Huang

Text-to-SQL generation aims to translate natural language questions into SQL statements. In Text-to-SQL based on large language models, schema linking is a widely adopted strategy to streamline the input for LLMs by selecting only relevant…

Computation and Language · Computer Science 2024-11-27 Zhenbiao Cao , Yuanlei Zheng , Zhihao Fan , Xiaojin Zhang , Wei Chen , Xiang Bai

The text-to-SQL problem aims to translate natural language questions into SQL statements to ease the interaction between database systems and end users. Recently, Large Language Models (LLMs) have exhibited impressive capabilities in a…

Databases · Computer Science 2025-04-04 Chen Shen , Jin Wang , Sajjadur Rahman , Eser Kandogan

Text-to-SQL conversion is a critical innovation, simplifying the transition from complex SQL to intuitive natural language queries, especially significant given SQL's prevalence in the job market across various roles. The rise of Large…

Computation and Language · Computer Science 2024-07-23 Tingkai Zhang , Chaoyu Chen , Cong Liao , Jun Wang , Xudong Zhao , Hang Yu , Jianchao Wang , Jianguo Li , Wenhui Shi

Existing text-to-SQL semantic parsers are typically designed for particular settings such as handling queries that span multiple tables, domains or turns which makes them ineffective when applied to different settings. We present UniSAr…

Computation and Language · Computer Science 2022-04-14 Longxu Dou , Yan Gao , Mingyang Pan , Dingzirui Wang , Wanxiang Che , Dechen Zhan , Jian-Guang Lou

Despite significant progress in Natural Language Generation for Indian languages (IndicNLP), there is a lack of datasets around complex structured tasks such as semantic parsing. One reason for this imminent gap is the complexity of the…

Computation and Language · Computer Science 2023-06-06 Divyanshu Aggarwal , Vivek Gupta , Anoop Kunchukuttan

Large Language Models (LLMs) have made significant progress in assisting users to query databases in natural language. While LLM-based techniques provide state-of-the-art results on many standard benchmarks, their performance significantly…

Artificial Intelligence · Computer Science 2024-07-09 Nina Narodytska , Shay Vargaftik