中文
相关论文

相关论文: Benchmarking Text-to-Python against Text-to-SQL: T…

200 篇论文

Text-to-SQL benchmarks have traditionally only tested simple data access as a translation task of natural language to SQL queries. But in reality, users tend to ask diverse questions that require more complex responses including data-driven…

计算与语言 · 计算机科学 2026-01-15 Yue Li , Ran Tao , Derek Hommel , Yusuf Denizay Dönder , Sungyong Chang , David Mimno , Unso Eun Seo Jo

Large Language Models (LLMs) have recently become sophisticated enough to automate many tasks ranging from pattern finding to writing assistance to code generation. In this paper, we examine text-to-SQL generation. We have observed from…

数据库 · 计算机科学 2025-09-04 Vladislav Shkapenyuk , Divesh Srivastava , Theodore Johnson , Parisa Ghane

Large Language Models (LLMs) have made significant progress in assisting users to query databases in natural language. While LLM-based techniques provide state-of-the-art results on many standard benchmarks, their performance significantly…

人工智能 · 计算机科学 2024-07-09 Nina Narodytska , Shay Vargaftik

Although multi-agent collaborative Large Language Models (LLMs) have achieved significant breakthroughs in the Text-to-SQL task, their performance is still constrained by various factors. These factors include the incompleteness of the…

计算与语言 · 计算机科学 2025-02-24 Xiangjin Xie , Guangwei Xu , Lingyan Zhao , Ruijie Guo

Generating accurate SQL from users' natural language questions (text-to-SQL) remains a long-standing challenge due to the complexities involved in user question understanding, database schema comprehension, and SQL generation. Traditional…

计算与语言 · 计算机科学 2025-11-25 Zijin Hong , Zheng Yuan , Qinggang Zhang , Hao Chen , Junnan Dong , Feiran Huang , Xiao Huang

Translating natural language to SQL (Text-to-SQL) is a critical challenge in both database research and data analytics applications. Recent efforts have focused on enhancing SQL reasoning by developing large language models and AI agents…

数据库 · 计算机科学 2026-04-01 Yuxuan Zhu , Tengjun Jin , Yoojin Choi , Daniel Kang

Large-scale Text-to-SQL benchmarks such as BIRD typically assume complete and accurate database annotations as well as readily available external knowledge, which fails to reflect common industrial settings where annotations are missing,…

计算与语言 · 计算机科学 2026-01-15 Jiahui Chen , Lei Fu , Jian Cui , Yu Lei , Zhenning Dong

Relational databases are foundational to numerous domains, including business intelligence, scientific research, and enterprise systems. However, accessing and analyzing structured data often requires proficiency in SQL, which is a skill…

数据库 · 计算机科学 2025-07-10 Luyu Qiu , Jianing Li , Chi Su , Lei Chen

Text-to-SQL conversion is a critical innovation, simplifying the transition from complex SQL to intuitive natural language queries, especially significant given SQL's prevalence in the job market across various roles. The rise of Large…

计算与语言 · 计算机科学 2024-07-23 Tingkai Zhang , Chaoyu Chen , Cong Liao , Jun Wang , Xudong Zhao , Hang Yu , Jianchao Wang , Jianguo Li , Wenhui Shi

Despite the success of large language models (LLMs) in Text-to-SQL tasks, open-source LLMs encounter challenges in contextual understanding and response coherence. To tackle these issues, we present \ours, a systematic methodology tailored…

计算与语言 · 计算机科学 2024-05-14 Xiaojun Chen , Tianle Wang , Tianhao Qiu , Jianbin Qin , Min Yang

Efficient querying and analysis of large tabular datasets remain significant challenges, especially for users without expertise in programming languages like SQL. Text-to-SQL approaches have shown promising performance on benchmark data;…

数据库 · 计算机科学 2025-08-27 Yipeng Zhang , Chen Wang , Yuzhe Zhang , Jacky Jiang

Text-to-SQL allows experts to use databases without in-depth knowledge of them. However, real-world tasks have both query and data ambiguities. Most works on Text-to-SQL focused on query ambiguities and designed chat interfaces for experts…

数据库 · 计算机科学 2023-10-31 Zezhou Huang , Pavan Kalyan Damalapati , Eugene Wu

Text-to-SQL bridges the gap between natural language and structured database language, thus allowing non-technical users to easily query databases. Traditional approaches model text-to-SQL as a direct translation task, where a given Natural…

Text-to-SQL systems powered by Large Language Models have excelled on academic benchmarks but struggle in complex enterprise environments. The primary limitation lies in their reliance on static schema representations, which fails to…

数据库 · 计算机科学 2026-02-20 Bowen Cao , Weibin Liao , Yushi Sun , Dong Fang , Haitao Li , Wai Lam

Text-to-SQL semantic parsing has made significant progress in recent years, with various models demonstrating impressive performance on the challenging Spider benchmark. However, it has also been shown that these models often struggle to…

计算与语言 · 计算机科学 2024-02-14 Irina Saparina , Mirella Lapata

Text-to-SQL, the task of translating natural language questions into SQL queries, has long been a central challenge in NLP. While progress has been significant, applying it to the financial domain remains especially difficult due to complex…

计算金融 · 定量金融 2025-10-03 Avinash Kumar Singh , Bhaskarjit Sarmah , Stefano Pasquali

Evaluating text-to-SQL systems remains largely fragile: correctness is typically judged by executing predicted and gold SQL queries on a single static database, even though the same queries may behave differently under alternative database…

数据库 · 计算机科学 2026-05-01 Mohammadamin Habibollah , Davood Rafiei

NL2SQL systems deployed in industry settings often encounter ambiguous or unanswerable queries, particularly in interactive scenarios with incomplete user clarification. Existing benchmarks typically assume a single source of ambiguity and…

Recent advancements in large language models (LLMs) have enabled in-context learning (ICL)-based methods that significantly outperform fine-tuning approaches for text-to-SQL tasks. However, their performance is still considerably lower than…

计算与语言 · 计算机科学 2024-05-14 Dongjun Lee , Choongwon Park , Jaehyuk Kim , Heesoo Park

Text-to-SQL enables users to interact with databases through natural language, simplifying the retrieval and synthesis of information. Despite the success of large language models (LLMs) in converting natural language questions into SQL…

机器学习 · 计算机科学 2025-04-23 Oleg Somov , Elena Tutubalina