English
Related papers

Related papers: Evaluating the Text-to-SQL Capabilities of Large L…

200 papers

Pixel-based language models are gaining momentum as alternatives to traditional token-based approaches, promising to circumvent tokenization challenges. However, the inherent perceptual diversity across languages poses a significant hurdle…

Computation and Language · Computer Science 2026-04-14 Chen Hu , Yintao Tai , Antonio Vergari , Frank Keller , Alessandro Suglia

Existing text-to-SQL research only considers complete questions as the input, but lay-users might strive to formulate a complete question. To build a smarter natural language interface to database systems (NLIDB) that also processes…

Computation and Language · Computer Science 2021-10-01 Naihao Deng , Shuaichen Chang , Peng Shi , Tao Yu , Rui Zhang

To be informative, an evaluation must measure how well systems generalize to realistic unseen data. We identify limitations of and propose improvements to current evaluations of text-to-SQL systems. First, we compare human-generated and…

Computation and Language · Computer Science 2020-06-05 Catherine Finegan-Dollak , Jonathan K. Kummerfeld , Li Zhang , Karthik Ramanathan , Sesh Sadasivam , Rui Zhang , Dragomir Radev

Large language models (LLMs) have shown state-of-the-art results in translating natural language questions into SQL queries (Text-to-SQL), a long-standing challenge within the database community. However, security concerns remain largely…

Cryptography and Security · Computer Science 2025-09-09 Meiyu Lin , Haichuan Zhang , Jiale Lao , Renyuan Li , Yuanchun Zhou , Carl Yang , Yang Cao , Mingjie Tang

Despite the recent ubiquity of large language models and their high zero-shot prompted performance across a wide range of tasks, it is still not known how well they perform on tasks which require processing of potentially idiomatic…

Computation and Language · Computer Science 2024-05-16 Dylan Phelps , Thomas Pickard , Maggie Mi , Edward Gow-Smith , Aline Villavicencio

Text-to-SQL parsing and end-to-end question answering (E2E TQA) are two main approaches for Table-based Question Answering task. Despite success on multiple benchmarks, they have yet to be compared and their synergy remains unexplored. In…

Computation and Language · Computer Science 2024-10-01 Siyue Zhang , Anh Tuan Luu , Chen Zhao

Access control is a cornerstone of secure computing, yet large language models often blur role boundaries by producing unrestricted responses. We study role-conditioned refusals, focusing on the LLM's ability to adhere to access control…

Computation and Language · Computer Science 2025-10-10 Đorđe Klisura , Joseph Khoury , Ashish Kundu , Ram Krishnan , Anthony Rios

Understanding textual description to generate code seems to be an achieved capability of instruction-following Large Language Models (LLMs) in zero-shot scenario. However, there is a severe possibility that this translation ability may be…

Recent advances in Text-to-SQL have achieved strong results in static, single-turn tasks, where models generate SQL queries from natural language questions. However, these systems fall short in real-world interactive scenarios, where user…

Databases · Computer Science 2025-11-14 Linzhuang Sun , Tianyu Guo , Hao Liang , Yuying Li , Qifeng Cai , Jingxuan Wei , Bihui Yu , Wentao Zhang , Bin Cui

Text-to-SQL generation aims to translate natural language questions into SQL statements. In Text-to-SQL based on large language models, schema linking is a widely adopted strategy to streamline the input for LLMs by selecting only relevant…

Computation and Language · Computer Science 2024-11-27 Zhenbiao Cao , Yuanlei Zheng , Zhihao Fan , Xiaojin Zhang , Wei Chen , Xiang Bai

Research on parsing language to SQL has largely ignored the structure of the database (DB) schema, either because the DB was very simple, or because it was observed at both training and test time. In Spider, a recently-released text-to-SQL…

Computation and Language · Computer Science 2019-06-04 Ben Bogin , Matt Gardner , Jonathan Berant

Recent In-Context Learning based methods have achieved remarkable success in Text-to-SQL task. However, there is still a large gap between the performance of these models and human performance on datasets with complex database schema and…

Computation and Language · Computer Science 2024-11-08 Wenxuan Xie , Gaochen Wu , Bowen Zhou

Translating natural language utterances to executable queries is a helpful technique in making the vast amount of data stored in relational databases accessible to a wider range of non-tech-savvy end users. Prior work in this area has…

Computation and Language · Computer Science 2020-10-21 Karthik Radhakrishnan , Arvind Srikantan , Xi Victoria Lin

Text-to-SQL, which involves translating natural language into Structured Query Language (SQL), is crucial for enabling broad access to structured databases without expert knowledge. However, designing models for such tasks is challenging…

Computation and Language · Computer Science 2024-03-27 Niklas Wretblad , Fredrik Gordh Riseby , Rahul Biswas , Amin Ahmadi , Oskar Holmström

Applying large, proprietary API-based language models to text-to-SQL tasks poses a significant industry challenge: reliance on massive, schema-heavy prompts results in prohibitive per-token API costs and high latency, hindering scalable…

Computation and Language · Computer Science 2026-03-26 Chinmay Soni , Shivam Chourasia , Gaurav Kumar , Hitesh Kapoor

While Large Language Models have significantly advanced Text2SQL generation, a critical semantic gap persists where syntactically valid queries often misinterpret user intent. To mitigate this challenge, we propose GBV-SQL, a novel…

Artificial Intelligence · Computer Science 2025-09-17 Daojun Chen , Xi Wang , Shenyuan Ren , Qingzhi Ma , Pengpeng Zhao , An Liu

This study explores text-to-SQL parsing by leveraging the powerful reasoning capabilities of large language models (LLMs). Despite recent advancements, existing LLM-based methods are still inefficient and struggle to handle cases with wide…

Computation and Language · Computer Science 2025-11-14 Guanming Xiong , Junwei Bao , Hongfei Jiang , Yang Song , Wen Zhao

Large language models (LLMs) allow users to query databases using natural language by translating questions into executable queries. Despite strong progress on tasks such as Text2SQL, Text2SPARQL, and Text2Cypher, most existing methods…

Computation and Language · Computer Science 2026-05-12 Makbule Gulcin Ozsoy

Large Language Models (LLMs) can translate natural language into SQL, but small models struggle with multi-table and complex queries in Zero-Shot Learning (ZSL) settings. While Supervised Fine-Tuning (SFT) helps, it falls short for harder…

Machine Learning · Computer Science 2026-05-05 Simone Papicchio , Simone Rossi , Luca Cagliero , Paolo Papotti

LaTeX's precision and flexibility in typesetting have made it the gold standard for the preparation of scientific documentation. Large Language Models (LLMs) present a promising opportunity for researchers to produce publication-ready…

Computation and Language · Computer Science 2025-09-16 Sahil Kale , Vijaykant Nadadur