中文
相关论文

相关论文: Same Data, Different Schemas: Robustness of LLM-ba…

200 篇论文

Exploring the generalization of a text-to-SQL parser is essential for a system to automatically adapt the real-world databases. Previous works provided investigations focusing on lexical diversity, including the influence of the synonym and…

人工智能 · 计算机科学 2023-01-24 Jieyu Li , Lu Chen , Ruisheng Cao , Su Zhu , Hongshen Xu , Zhi Chen , Hanchong Zhang , Kai Yu

Text-to-SQL converts natural language questions into executable SQL queries, enabling non-technical users to access relational databases for analytics and intelligent data services. In real-world scenarios, performance is often constrained…

计算与语言 · 计算机科学 2026-05-25 Tianhao Qiu , Xiaojun Chen

With the development of the Large Language Models (LLMs), a large range of LLM-based Text-to-SQL(Text2SQL) methods have emerged. This survey provides a comprehensive review of LLM-based Text2SQL studies. We first enumerate classic…

计算与语言 · 计算机科学 2025-06-04 Liang Shi , Zhengju Tang , Nan Zhang , Xiaotong Zhang , Zhi Yang

The advancements of Large language models (LLMs) have provided great opportunities to text-to-SQL tasks to overcome the main challenges to understand complex domain information and complex database structures in business applications. In…

人工智能 · 计算机科学 2025-05-27 Wenda Zhang

Text-to-SQL enables users to interact with databases using natural language, simplifying the retrieval and synthesis of information. Despite the remarkable success of large language models (LLMs) in translating natural language questions…

人工智能 · 计算机科学 2024-07-03 Gyubok Lee , Woosog Chay , Seonhee Cho , Edward Choi

Large Language Models (LLMs) are transforming scholarly tasks like search and summarization, but their reliability remains uncertain. Current evaluation metrics for testing LLM reliability are primarily automated approaches that prioritize…

人机交互 · 计算机科学 2026-02-25 Anna Martin-Boyle , William Humphreys , Martha Brown , Cara Leckey , Harmanpreet Kaur

Text-to-SQLs enables non-expert users to effortlessly retrieve desired information from relational databases using natural language queries. While recent advancements, particularly with Large Language Models (LLMs) like GPT and T5, have…

数据库 · 计算机科学 2024-10-04 Shouvon Sarker , Xishuang Dong , Xiangfang Li , Lijun Qian

LLMs when used with Retrieval Augmented Generation (RAG), are greatly improving the SOTA of translating natural language queries to structured and correct SQL. Unlike previous reviews, this survey provides a comprehensive study of the…

计算与语言 · 计算机科学 2025-02-05 Ali Mohammadjafari , Anthony S. Maida , Raju Gottumukkala

As large language models (LLMs) are increasingly deployed to perform tasks with minimal human oversight, it is crucial that these models operate robustly. In particular, a model that can solve a given problem should not fail simply because…

机器学习 · 计算机科学 2026-05-18 Philipp Mondorf , Samuel J. Bell , Jesse Dodge , Dieuwke Hupkes

Recent advancements in large language models (LLMs) have significantly advanced text-to-SQL systems. However, most LLM-based methods often narrowly focus on SQL generation, neglecting the complexities of real-world conversational queries.…

计算与语言 · 计算机科学 2025-04-09 Ziming Guo , Chao Ma , Yinggang Sun , Tiancheng Zhao , Guangyao Wang , Hai Huang

Large Language Models (LLMs) have shown useful applications in a variety of tasks, including data wrangling. In this paper, we investigate the use of an off-the-shelf LLM for schema matching. Our objective is to identify semantic…

数据库 · 计算机科学 2024-07-17 Marcel Parciak , Brecht Vandevoort , Frank Neven , Liesbet M. Peeters , Stijn Vansummeren

Large Language Models (LLMs) often struggle with the precise logic and schema alignment required for complex Text-to-SQL tasks. While current methods rely heavily on static prompting, they lack the ability to dynamically adapt and…

计算与语言 · 计算机科学 2026-05-12 Haolin Yang , Jipeng Zhang , Zhitao He , Alexander Zhou , Yi R. Fung

Large language models (LLMs) have advanced Text-to-SQL, yet existing solutions still fall short of system-level reliability. The limitation is not merely in individual modules -- e.g., schema linking, reasoning, and verification -- but more…

数据库 · 计算机科学 2026-04-06 Boyan Li , Chong Chen , Zhujun Xue , Yinan Mei , Yuyu Luo

Large Language Models (LLMs) have demonstrated remarkable performance across various natural language processing tasks. Recently, several LLMs-based pipelines have been developed to enhance learning on graphs with text attributes,…

机器学习 · 计算机科学 2024-07-30 Kai Guo , Zewen Liu , Zhikai Chen , Hongzhi Wen , Wei Jin , Jiliang Tang , Yi Chang

The Text-to-SQL task translates natural language questions into SQL queries, enabling intuitive database interaction for non-experts. While recent methods leveraging Large Language Models (LLMs) achieve strong performance, their reliance on…

计算与语言 · 计算机科学 2026-01-21 Shengmin Piao , Jieun Lee , Sanghyun Park

The text-to-SQL problem aims to translate natural language questions into SQL statements to ease the interaction between database systems and end users. Recently, Large Language Models (LLMs) have exhibited impressive capabilities in a…

数据库 · 计算机科学 2025-04-04 Chen Shen , Jin Wang , Sajjadur Rahman , Eser Kandogan

Large language models (LLMs) have revolutionized natural language interfaces for databases, particularly in text-to-SQL conversion. However, current approaches often generate unreliable outputs when faced with ambiguity or insufficient…

数据库 · 计算机科学 2025-01-22 Kaiwen Chen , Yueting Chen , Xiaohui Yu , Nick Koudas

Large language models (LLMs) often present answers with high apparent confidence despite lacking an explicit mechanism for reasoning about certainty or truth. While existing benchmarks primarily evaluate single-turn accuracy, truthfulness…

计算与语言 · 计算机科学 2026-03-05 Mohammadreza Saadat , Steve Nemzer

Large language models (LLMs) allow users to query databases using natural language by translating questions into executable queries. Despite strong progress on tasks such as Text2SQL, Text2SPARQL, and Text2Cypher, most existing methods…

计算与语言 · 计算机科学 2026-05-12 Makbule Gulcin Ozsoy

The rapid advancement of Large Language Models (LLMs) has established standardized evaluation benchmarks as the primary instrument for model comparison. Yet, their reliability is increasingly questioned due to sensitivity to shallow…

计算与语言 · 计算机科学 2026-02-20 Bogdan Kostić , Conor Fallon , Julian Risch , Alexander Löser