English
Related papers

Related papers: Both Ends Count! Just How Good are LLM Agents at "…

200 papers

Generating accurate SQL from users' natural language questions (text-to-SQL) remains a long-standing challenge due to the complexities involved in user question understanding, database schema comprehension, and SQL generation. Traditional…

Computation and Language · Computer Science 2025-11-25 Zijin Hong , Zheng Yuan , Qinggang Zhang , Hao Chen , Junnan Dong , Feiran Huang , Xiao Huang

Large language models (LLMs) know little about enterprise database tables in the private data ecosystem, which substantially differ from web text in structure and content. As LLMs' performance is tied to their training data, a crucial…

Databases · Computer Science 2024-07-31 Çağatay Demiralp , Fabian Wenz , Peter Baile Chen , Moe Kayali , Nesime Tatbul , Michael Stonebraker

The task of Text-to-SQL enables anyone to retrieve information from SQL databases using natural language. While this task has made substantial progress, the two primary evaluation metrics - Execution Accuracy (EXE) and Exact Set Matching…

Computation and Language · Computer Science 2025-06-18 Benjamin G. Ascoli , Yasoda Sai Ram Kandikonda , Jinho D. Choi

Text-to-SQL generation enables non-experts to interact with databases via natural language. Recent advances rely on large closed-source models like GPT-4 that present challenges in accessibility, privacy, and latency. To address these…

Computation and Language · Computer Science 2025-02-18 Satya Krishna Gorti , Ilan Gofman , Zhaoyan Liu , Jiapeng Wu , Noël Vouitsis , Guangwei Yu , Jesse C. Cresswell , Rasa Hosseinzadeh

Text-to-SQL is a fundamental yet challenging task in the NLP area, aiming at translating natural language questions into SQL queries. While recent advances in large language models have greatly improved performance, most existing approaches…

Databases · Computer Science 2025-12-01 Shuozhi Yuan , Limin Chen , Miaomiao Yuan , Zhao Jin

Text-to-SQL systems have become crucial for translating natural language into SQL queries in various industries, enabling non-technical users to perform complex data operations. The need for accurate evaluation methods has increased as…

Computation and Language · Computer Science 2024-10-29 Heegyu Kim , Taeyang Jeon , Seunghwan Choi , Seungtaek Choi , Hyunsouk Cho

Text2SQL, the task of generating SQL queries from natural language text, is a critical challenge in data engineering. Recently, Large Language Models (LLMs) have demonstrated superior performance for this task due to their advanced…

Confidence estimation for text-to-SQL aims to assess the reliability of model-generated SQL queries without having access to gold answers. We study this problem in the context of large language models (LLMs), where access to model weights…

Computation and Language · Computer Science 2025-08-21 Sepideh Entezari Maleki , Mohammadreza Pourreza , Davood Rafiei

Text-to-SQL systems enable users to interact with structured databases using natural language, eliminating the need for specialized programming knowledge. In this work, we introduce GEMMA-SQL, a lightweight and efficient text-to-SQL model…

Computation and Language · Computer Science 2025-11-10 Hari Mohan Pandey , Anshul Gupta , Subham Sarkar , Minakshi Tomer , Schneider Johannes , Yan Gong

Text-to-SQL datasets are essential for training and evaluating text-to-SQL models, but existing datasets often suffer from limited coverage and fail to capture the diversity of real-world applications. To address this, we propose a novel…

Computation and Language · Computer Science 2025-11-25 Hao Wang , Yuanfeng Song , Xiaoming Yin , Xing Chen

Converting natural language (NL) questions into SQL queries, referred to as Text-to-SQL, has emerged as a pivotal technology for facilitating access to relational databases, especially for users without SQL knowledge. Recent progress in…

Computation and Language · Computer Science 2025-06-02 Yiming Huang , Jiyu Guo , Wenxin Mao , Cuiyun Gao , Peiyi Han , Chuanyi Liu , Qing Ling

Text-to-SQL bridges the gap between natural language and structured database language, thus allowing non-technical users to easily query databases. Traditional approaches model text-to-SQL as a direct translation task, where a given Natural…

Machine Learning · Computer Science 2025-08-12 Anurag Tripathi , Vaibhav Patle , Abhinav Jain , Ayush Pundir , Sairam Menon , Ajeet Kumar Singh , Dorien Herremans

Large Language Models (LLMs) can translate natural language into SQL, but small models struggle with multi-table and complex queries in Zero-Shot Learning (ZSL) settings. While Supervised Fine-Tuning (SFT) helps, it falls short for harder…

Machine Learning · Computer Science 2026-05-05 Simone Papicchio , Simone Rossi , Luca Cagliero , Paolo Papotti

Text-to-SQL conversion is a critical innovation, simplifying the transition from complex SQL to intuitive natural language queries, especially significant given SQL's prevalence in the job market across various roles. The rise of Large…

Computation and Language · Computer Science 2024-07-23 Tingkai Zhang , Chaoyu Chen , Cong Liao , Jun Wang , Xudong Zhao , Hang Yu , Jianchao Wang , Jianguo Li , Wenhui Shi

Recent advancements in large language models (LLMs) have significantly advanced text-to-SQL systems. However, most LLM-based methods often narrowly focus on SQL generation, neglecting the complexities of real-world conversational queries.…

Computation and Language · Computer Science 2025-04-09 Ziming Guo , Chao Ma , Yinggang Sun , Tiancheng Zhao , Guangyao Wang , Hai Huang

Text-to-SQL, the process of translating natural language into Structured Query Language (SQL), represents a transformative application of large language models (LLMs), potentially revolutionizing how humans interact with data. This paper…

Text-to-SQL enables users to interact with databases using natural language, simplifying the retrieval and synthesis of information. Despite the remarkable success of large language models (LLMs) in translating natural language questions…

Artificial Intelligence · Computer Science 2024-07-03 Gyubok Lee , Woosog Chay , Seonhee Cho , Edward Choi

Text-to-SQL, the task of translating natural language questions into SQL queries, plays a crucial role in enabling non-experts to interact with databases. While recent advancements in large language models (LLMs) have significantly enhanced…

Computation and Language · Computer Science 2025-07-15 Haoyang Li , Shang Wu , Xiaokang Zhang , Xinmei Huang , Jing Zhang , Fuxin Jiang , Shuai Wang , Tieying Zhang , Jianjun Chen , Rui Shi , Hong Chen , Cuiping Li

The capability gap between open-source and closed-source large language models (LLMs) remains a challenge in text-to-SQL tasks. In this paper, we introduce a synthetic data approach that combines data produced by larger, more powerful…

Computation and Language · Computer Science 2024-08-07 Jiaxi Yang , Binyuan Hui , Min Yang , Jian Yang , Junyang Lin , Chang Zhou

Text-to-SQL systems translate natural language (NL) questions into SQL queries, enabling non-technical users to interact with structured data. While large language models (LLMs) have shown promising results on the text-to-SQL task, they…

Computation and Language · Computer Science 2025-06-06 Yue Gong , Chuan Lei , Xiao Qin , Kapil Vaidya , Balakrishnan Narayanaswamy , Tim Kraska