English
Related papers

Related papers: Multilingual Text-to-SQL: Benchmarking the Limits …

200 papers

While Large Language Models (LLMs) have significantly advanced Text-to-SQL performance, existing benchmarks predominantly focus on Western contexts and simplified schemas, leaving a gap in real-world, non-Western applications. We present…

Computation and Language · Computer Science 2026-04-16 Aviral Dawar , Roshan Karanth , Vikram Goyal , Dhruv Kumar

In Natural Language Interfaces to Databases systems, the text-to-SQL technique allows users to query databases by using natural language questions. Though significant progress in this area has been made recently, most parsers may fall short…

Computation and Language · Computer Science 2020-11-10 Yuntao Li , Bei Chen , Qian Liu , Yan Gao , Jian-Guang Lou , Yan Zhang , Dongmei Zhang

Robust evaluation in the presence of linguistic variation is key to understanding the generalization capabilities of Natural Language to SQL (NL2SQL) models, yet existing benchmarks rarely address this factor in a systematic or controlled…

Computation and Language · Computer Science 2025-09-08 Mohammadtaher Safarzadeh , Afshin Oroojlooyjadid , Dan Roth

While Text-to-SQL remains the dominant approach for database interaction, real-world analytics increasingly require the flexibility of general-purpose programming languages such as Python or Pandas to manage file-based data and complex…

Artificial Intelligence · Computer Science 2026-01-26 Hangle Hu , Chenyu Hou , Bin Cao , Ruizhe Li

NoSQL databases have become increasingly popular due to their outstanding performance in handling large-scale, unstructured, and semi-structured data, highlighting the need for user-friendly interfaces to bridge the gap between…

Databases · Computer Science 2025-02-19 Jinwei Lu , Yuanfeng Song , Zhiqian Qin , Haodi Zhang , Chen Zhang , Raymond Chi-Wing Wong

Current Text-to-SQL methods are evaluated and only focused on executable queries, overlooking the semantic alignment challenge -- both in terms of the semantic meaning of the query and the correctness of the execution results. Even…

Computation and Language · Computer Science 2025-11-24 Ashish Kattamuri , Ishita Prasad , Meetu Malhotra , Arpita Vats , Rahul Raja , Albert Lie

Recent improvements in multilingual ASR have not been equally distributed across languages and language varieties. To advance state-of-the-art (SOTA) ASR models, we present the Interspeech 2025 ML-SUPERB 2.0 Challenge. We construct a new…

In addressing the pivotal role of translating natural language queries into SQL commands, we propose a suite of compact, fine-tuned models and self-refine mechanisms to democratize data access and analysis for non-expert users, mitigating…

Artificial Intelligence · Computer Science 2024-09-25 Lixia Wu , Peng Li , Junhong Lou , Lei Fu

SQL dialects vary in syntax, types, and functions across database engines. Text-to-SQL benchmarks, however, predominantly support only SQLite. This creates a critical evaluation gap: cross-dialect evaluation reveals weak per-query agreement…

Computation and Language · Computer Science 2026-05-11 Yotam Perlitz , Elad Venezian , Corentin Royer , Francesco Fusco , Andrea Giovannini

Recent LLM-based Text-to-SQL methods usually suffer from significant performance degradation on "huge" databases and complex user questions that require multi-step reasoning. Moreover, most existing methods neglect the crucial significance…

Computation and Language · Computer Science 2025-03-19 Bing Wang , Changyu Ren , Jian Yang , Xinnian Liang , Jiaqi Bai , LinZheng Chai , Zhao Yan , Qian-Wen Zhang , Di Yin , Xing Sun , Zhoujun Li

Text-to-SQL has emerged as a prominent research area, particularly with the rapid advancement of large language models (LLMs). By enabling users to query databases through natural language rather than SQL, this technology significantly…

Artificial Intelligence · Computer Science 2026-05-11 Yu-Jie Yang , Hung-Fu Chang , Po-An Chen

Converting natural language (NL) questions into SQL queries, referred to as Text-to-SQL, has emerged as a pivotal technology for facilitating access to relational databases, especially for users without SQL knowledge. Recent progress in…

Computation and Language · Computer Science 2025-06-02 Yiming Huang , Jiyu Guo , Wenxin Mao , Cuiyun Gao , Peiyi Han , Chuanyi Liu , Qing Ling

Recent advancements in large language models (LLMs) have enabled in-context learning (ICL)-based methods that significantly outperform fine-tuning approaches for text-to-SQL tasks. However, their performance is still considerably lower than…

Computation and Language · Computer Science 2024-05-14 Dongjun Lee , Choongwon Park , Jaehyuk Kim , Heesoo Park

Recent advancements in large language models (LLMs) have significantly advanced text-to-SQL systems. However, most LLM-based methods often narrowly focus on SQL generation, neglecting the complexities of real-world conversational queries.…

Computation and Language · Computer Science 2025-04-09 Ziming Guo , Chao Ma , Yinggang Sun , Tiancheng Zhao , Guangyao Wang , Hai Huang

Text-to-SQL over large analytical databases requires navigating complex schemas, resolving ambiguous queries, and grounding decisions in actual data. Most current systems follow a fixed pipeline where schema elements are retrieved once…

Computation and Language · Computer Science 2026-05-05 Quang Hieu Pham , Yang He , Ping Nie , Canwen Xu , Davood Rafiei , Yuepeng Wang , Xi Ye , Jocelyn Qiaochu Chen

Recent divide-and-conquer reasoning approaches, particularly those based on Chain-of-Thought (CoT), have substantially improved the Text-to-SQL capabilities of Large Language Models (LLMs). However, when applied to complex enterprise…

Computation and Language · Computer Science 2025-11-27 Zhifeng Hao , Qibin Song , Ruichu Cai , Boyan Xu

Leading models for the text-to-SQL task heavily rely on proprietary Large Language Models (LLMs), posing concerns over data privacy. Closing the performance gap between small open-source models and large proprietary models is crucial to…

Computation and Language · Computer Science 2024-02-05 Mohammadreza Pourreza , Davood Rafiei

Text-to-SQL datasets are essential for training and evaluating text-to-SQL models, but existing datasets often suffer from limited coverage and fail to capture the diversity of real-world applications. To address this, we propose a novel…

Computation and Language · Computer Science 2025-11-25 Hao Wang , Yuanfeng Song , Xiaoming Yin , Xing Chen

Despite recent progress in text-to-SQL parsing, current semantic parsers are still not accurate enough for practical use. In this paper, we investigate how to build automatic text-to-SQL error correction models. Noticing that token-level…

Computation and Language · Computer Science 2023-05-30 Ziru Chen , Shijie Chen , Michael White , Raymond Mooney , Ali Payani , Jayanth Srinivasa , Yu Su , Huan Sun

There is currently a significant gap between the performance of fine-tuned models and prompting approaches using Large Language Models (LLMs) on the challenging task of text-to-SQL, as evaluated on datasets such as Spider. To improve the…

Computation and Language · Computer Science 2023-11-06 Mohammadreza Pourreza , Davood Rafiei