English
Related papers

Related papers: LLMSQL: Upgrading WikiSQL for the LLM Era of Text-…

200 papers

NL2SQL (natural language to SQL) translates natural language questions into SQL queries, thereby making structured data accessible to non-technical users, serving as the foundation for intelligent data applications. State-of-the-art NL2SQL…

The rise of Large Language Models (LLMs) has significantly advanced Text-to-SQL (NL2SQL) systems, yet evaluating the semantic equivalence of generated SQL remains a challenge, especially given ambiguous user queries and multiple valid SQL…

Computation and Language · Computer Science 2025-06-12 Qingyun Zeng , Simin Ma , Arash Niknafs , Ashish Basran , Carol Szabo

The potential for improvements brought by Large Language Models (LLMs) in Text-to-SQL systems is mostly assessed on monolingual English datasets. However, LLMs' performance for other languages remains vastly unexplored. In this work, we…

Computation and Language · Computer Science 2024-06-07 Farhad Nooralahzadeh , Yi Zhang , Ellery Smith , Sabine Maennel , Cyril Matthey-Doret , Raphaël de Fondville , Kurt Stockinger

Although multi-agent collaborative Large Language Models (LLMs) have achieved significant breakthroughs in the Text-to-SQL task, their performance is still constrained by various factors. These factors include the incompleteness of the…

Computation and Language · Computer Science 2025-02-24 Xiangjin Xie , Guangwei Xu , Lingyan Zhao , Ruijie Guo

Recent advancements in Text-to-SQL (Text2SQL) emphasize stimulating the large language models (LLM) on in-context learning, achieving significant results. Nevertheless, they face challenges when dealing with verbose database information and…

Computation and Language · Computer Science 2024-06-04 Zhishuai Li , Xiang Wang , Jingjing Zhao , Sun Yang , Guoqing Du , Xiaoru Hu , Bin Zhang , Yuxiao Ye , Ziyue Li , Rui Zhao , Hangyu Mao

Text-to-SQL parsing is an essential and challenging task. The goal of text-to-SQL parsing is to convert a natural language (NL) question to its corresponding structured query language (SQL) based on the evidences provided by relational…

Computation and Language · Computer Science 2022-08-30 Bowen Qin , Binyuan Hui , Lihan Wang , Min Yang , Jinyang Li , Binhua Li , Ruiying Geng , Rongyu Cao , Jian Sun , Luo Si , Fei Huang , Yongbin Li

Text-to-SQL systems enable users to interact with structured databases using natural language, eliminating the need for specialized programming knowledge. In this work, we introduce GEMMA-SQL, a lightweight and efficient text-to-SQL model…

Computation and Language · Computer Science 2025-11-10 Hari Mohan Pandey , Anshul Gupta , Subham Sarkar , Minakshi Tomer , Schneider Johannes , Yan Gong

Calibration is crucial as large language models (LLMs) are increasingly deployed to convert natural language queries into SQL for commercial databases. In this work, we investigate calibration techniques for assigning confidence to…

Databases · Computer Science 2024-11-28 Ashwin Ramachandran , Sunita Sarawagi

Recent advancements in large language models (LLMs) have significantly improved performance on the Text-to-SQL task. However, prior approaches typically rely on static, pre-processed database information provided at inference time, which…

Computation and Language · Computer Science 2025-06-23 Wenxuan Xie , Yaxun Dai , Wenhao Jiang

Evaluating text-to-SQL systems remains largely fragile: correctness is typically judged by executing predicted and gold SQL queries on a single static database, even though the same queries may behave differently under alternative database…

Databases · Computer Science 2026-05-01 Mohammadamin Habibollah , Davood Rafiei

A significant amount of the world's knowledge is stored in relational databases. However, the ability for users to retrieve facts from a database is limited due to a lack of understanding of query languages such as SQL. We propose Seq2SQL,…

Computation and Language · Computer Science 2017-11-13 Victor Zhong , Caiming Xiong , Richard Socher

In-context learning (ICL) has emerged as a new approach to various natural language processing tasks, utilizing large language models (LLMs) to make predictions based on context that has been supplemented with a few examples or…

Computation and Language · Computer Science 2023-05-23 Linyong Nan , Yilun Zhao , Weijin Zou , Narutatsu Ri , Jaesung Tae , Ellen Zhang , Arman Cohan , Dragomir Radev

Large language models (LLMs) have advanced Text-to-SQL, yet existing solutions still fall short of system-level reliability. The limitation is not merely in individual modules -- e.g., schema linking, reasoning, and verification -- but more…

Databases · Computer Science 2026-04-06 Boyan Li , Chong Chen , Zhujun Xue , Yinan Mei , Yuyu Luo

Large language models (LLMs) with in-context learning have significantly improved the performance of text-to-SQL task. Previous works generally focus on using exclusive SQL generation prompt to improve the LLMs' reasoning ability. However,…

Computation and Language · Computer Science 2024-07-15 Zhenhe Wu , Zhongqiu Li , Jie Zhang , Mengxiang Li , Yu Zhao , Ruiyu Fang , Zhongjiang He , Xuelong Li , Zhoujun Li , Shuangyong Song

Open-weight large language models (LLMs) have significantly advanced performance in the Natural Language to SQL (NL2SQL) task. However, their effectiveness diminishes when dealing with large database schemas, as the context length…

Computation and Language · Computer Science 2025-05-21 Dai Quoc Nguyen , Cong Duy Vu Hoang , Duy Vu , Gioacchino Tangari , Thanh Tien Vu , Don Dharmasiri , Yuan-Fang Li , Long Duong

Text-to-SQL has attracted attention from both the natural language processing and database communities because of its ability to convert the semantics in natural language into SQL queries and its practical application in building natural…

Computation and Language · Computer Science 2022-08-23 Naihao Deng , Yulong Chen , Yue Zhang

Schema linking is a crucial step in Text-to-SQL pipelines. Its goal is to retrieve the relevant tables and columns of a target database for a user's query while disregarding irrelevant ones. However, imperfect schema linking can often…

Computation and Language · Computer Science 2024-08-20 Karime Maamari , Fadhil Abubaker , Daniel Jaroslawicz , Amine Mhedhbi

Translating Natural Language to SQL (NL2SQL) remains a critical bottleneck for democratization of data in enterprises. Although Large Language Models (LLMs) like Gemini 2.5 and other LLMs have demonstrated impressive zero-shot capabilities,…

Artificial Intelligence · Computer Science 2026-03-25 Anshul Solanki , Sanchit Latawa , Koushik Chakraborty , Navneet Kamboj

Recent advances in large language models (LLMs) have significantly improved the accuracy of Text-to-SQL systems. However, a critical challenge remains: the semantic mismatch between natural language questions (NLQs) and their corresponding…

Computation and Language · Computer Science 2025-08-21 Shaoming Duan , Zirui Wang , Chuanyi Liu , Zhibin Zhu , Yuhao Zhang , Peiyi Han , Liang Yan , Zewu Peng

Retrieving operational data from nuclear power plants requires exceptional accuracy and transparency due to the criticality of the decisions it supports. Traditionally, natural language to SQL (NL-to-SQL) approaches have been explored for…

Computation and Language · Computer Science 2025-06-11 Mishca de Costa , Muhammad Anwar , Dave Mercier , Mark Randall , Issam Hammad