English
Related papers

Related papers: EvoSchema: Towards Text-to-SQL Robustness Against …

200 papers

We explore using T5 (Raffel et al. (2019)) to directly translate natural language questions into SQL statements. General purpose natural language that interfaces to information stored within databases requires flexibly translating natural…

Artificial Intelligence · Computer Science 2020-11-10 Ning Li , Bethany Keller , Mark Butler , Daniel Cer

Text-to-SQL is a task that converts a natural language question into a structured query language (SQL) to retrieve information from a database. Large language models (LLMs) work well in natural language generation tasks, but they are not…

Computation and Language · Computer Science 2023-09-04 Chunxi Guo , Zhiliang Tian , Jintao Tang , Pancheng Wang , Zhihua Wen , Kang Yang , Ting Wang

Many improvements to programming have come from shortening feedback loops, for example with Integrated Development Environments, Unit Testing, Live Programming, and Distributed Version Control. A barrier to feedback that deserves greater…

Programming Languages · Computer Science 2024-12-10 Jonathan Edwards , Tomas Petricek , Tijs van der Storm , Geoffrey Litt

Text-to-SQL is a subtask in semantic parsing that has seen rapid progress with the evolution of Large Language Models (LLMs). However, LLMs face challenges due to hallucination issues and a lack of domain-specific database knowledge(such as…

Computation and Language · Computer Science 2025-02-26 Xingyu Ma , Xin Tian , Lingxiang Wu , Xuepeng Wang , Xueming Tang , Jinqiao Wang

Research in Text-to-SQL conversion has been largely benchmarked against datasets where each text query corresponds to one correct SQL. However, natural language queries over real-life databases frequently involve significant ambiguity about…

Computation and Language · Computer Science 2023-10-23 Adithya Bhaskar , Tushar Tomar , Ashutosh Sathe , Sunita Sarawagi

The task of Text-to-SQL enables anyone to retrieve information from SQL databases using natural language. While this task has made substantial progress, the two primary evaluation metrics - Execution Accuracy (EXE) and Exact Set Matching…

Computation and Language · Computer Science 2025-06-18 Benjamin G. Ascoli , Yasoda Sai Ram Kandikonda , Jinho D. Choi

Schema design, particularly normalization, is a critical yet often overlooked factor in natural language to SQL (NL2SQL) systems. Most prior research evaluates models on fixed schemas, overlooking the influence of design on performance. We…

Computation and Language · Computer Science 2025-10-03 Ryosuke Kohita

Large Language Models (LLMs) are predominantly evaluated on Standard American English (SAE), often overlooking the diversity of global English varieties. This narrow focus may raise fairness concerns as degraded performance on non-standard…

Computation and Language · Computer Science 2025-10-10 Jiyoung Lee , Seungho Kim , Jieun Han , Jun-Min Lee , Kitaek Kim , Alice Oh , Edward Choi

With the future striving toward data-centric decision-making, seamless access to databases is of utmost importance. There is extensive research on creating an efficient text-to-sql (TEXT2SQL) model to access data from the database. Using a…

Computation and Language · Computer Science 2022-08-10 Ayush Kumar , Parth Nagarkar , Prabhav Nalhe , Sanjeev Vijayakumar

Text-to-SQL, which translates a natural language question into an SQL query, has advanced with in-context learning of Large Language Models (LLMs). However, existing methods show little improvement in performance compared to randomly chosen…

Artificial Intelligence · Computer Science 2025-07-23 Jihyung Lee , Jin-Seop Lee , Jaehoon Lee , YunSeok Choi , Jee-Hyong Lee

LLMs have become the go-to choice for code generation tasks, with an exponential increase in the training, development, and usage of LLMs specifically for code generation. To evaluate the ability of LLMs on code, both academic and industry…

Software Engineering · Computer Science 2024-03-29 Chunqiu Steven Xia , Yinlin Deng , Lingming Zhang

We present a comprehensive evaluation of structured decoding for text-to-table generation with large language models (LLMs). While previous work has primarily focused on unconstrained generation of tables, the impact of enforcing structural…

Computation and Language · Computer Science 2025-08-25 Julian Oestreich , Lydia Müller

Text-to-SQL systems translate natural language (NL) questions into SQL queries, enabling non-technical users to interact with structured data. While large language models (LLMs) have shown promising results on the text-to-SQL task, they…

Computation and Language · Computer Science 2025-06-06 Yue Gong , Chuan Lei , Xiao Qin , Kapil Vaidya , Balakrishnan Narayanaswamy , Tim Kraska

In the era of large language models, Text-to-SQL, as a natural language interface for databases, is playing an increasingly important role. The sota Text-to-SQL models have achieved impressive accuracy, but their performance critically…

Databases · Computer Science 2026-02-13 Yafeng Nan , Haifeng Sun , Zirui Zhuang , Qi Qi , Guojun Chu , Jianxin Liao , Dan Pei , Jingyu Wang

This work reframes the Text-to-SQL task as a pathway for teaching large language models (LLMs) to reason over and manipulate tabular data--moving beyond the traditional focus on query generation. We propose a two-stage framework that…

Computation and Language · Computer Science 2025-05-05 Josefa Lia Stoisser , Marc Boubnovski Martell , Julien Fauqueur

Schema evolution is a crucial aspect in database management. The proposed taxonomies of schema changes have neglected the set of operations that involves relationships between entity types: aggregation and references, as well as the…

Controlled table-to-text generation seeks to generate natural language descriptions for highlighted subparts of a table. Previous SOTA systems still employ a sequence-to-sequence generation method, which merely captures the table as a…

Computation and Language · Computer Science 2022-05-10 Fei Wang , Zhewei Xu , Pedro Szekely , Muhao Chen

Text-to-SQL is a crucial task toward developing methods for understanding natural language by computers. Recent neural approaches deliver excellent performance; however, models that are difficult to interpret inhibit future developments.…

Computation and Language · Computer Science 2021-02-04 Yasufumi Taniguchi , Hiroki Nakayama , Kubo Takahiro , Jun Suzuki

Natural Language to SQL (NL2SQL) technology empowers non-expert users to query relational databases without requiring SQL expertise. While large language models (LLMs) have greatly improved NL2SQL algorithms, their rapid development…

Databases · Computer Science 2026-04-21 Shizheng Hou , Wenqi Pei , Nuo Chen , Quang-Trung Ta , Peng Lu , Beng Chin Ooi

Large language models (LLMs) have revolutionized Text-to-SQL generation, allowing users to query structured data using natural language with growing ease. Yet, real-world deployment remains challenging, especially in complex or unseen…

Computation and Language · Computer Science 2026-05-01 Smit Jivani , Sarvam Maheshwari , Sunita Sarawagi