English
Related papers

Related papers: TrustSQL: Benchmarking Text-to-SQL Reliability wit…

200 papers

While Text-to-SQL remains the dominant approach for database interaction, real-world analytics increasingly require the flexibility of general-purpose programming languages such as Python or Pandas to manage file-based data and complex…

Artificial Intelligence · Computer Science 2026-01-26 Hangle Hu , Chenyu Hou , Bin Cao , Ruizhe Li

Modern Text-to-SQL systems generate multiple candidate SQL queries and rank them to judge a final prediction. However, existing methods face two limitations. First, they often score functionally equivalent SQL queries inconsistently despite…

Software Engineering · Computer Science 2026-04-29 Hojae Han , Yeonseok Jeong , Seung-won Hwang , Zhewei Yao , Yuxiong He

The widespread adoption of web applications has made their security a critical concern and has increased the need for systematic ways to assess whether they can be considered trustworthy. However, "trust" assessment remains an open problem…

Cryptography and Security · Computer Science 2026-03-26 Oleksandr Yarotskyi , José D'Abruzzo Pereira , João R. Campos

Large language models (LLMs) have been adopted to perform text-to-SQL tasks, utilizing their in-context learning (ICL) capability to translate natural language questions into structured query language (SQL). However, such a technique faces…

Computation and Language · Computer Science 2025-07-02 Jiawei Shen , Chengcheng Wan , Ruoyi Qiao , Jiazhen Zou , Hang Xu , Yuchen Shao , Yueling Zhang , Weikai Miao , Geguang Pu

Recent advancements in Text-to-SQL have pushed database management systems towards greater democratization of data access. Today's language models are at the core of these advancements. They enable impressive Text-to-SQL generation as…

Computation and Language · Computer Science 2024-06-19 Karime Maamari , Amine Mhedhbi

Existing Text-to-SQL benchmarks primarily focus on single-table queries or limited joins in general-purpose domains, and thus fail to reflect the complexity of domain-specific, multi-table and geospatial reasoning, To address this…

Information Retrieval · Computer Science 2026-03-17 Hanzhou Liu , Kai Yin , Zhitong Chen , Chenyue Liu , Ali Mostafavi

Text-to-SQL parsing tackles the problem of mapping natural language questions to executable SQL queries. In practice, text-to-SQL parsers often encounter various challenging scenarios, requiring them to be generalizable and robust. While…

Computation and Language · Computer Science 2022-10-25 Chang Gao , Bowen Li , Wenxuan Zhang , Wai Lam , Binhua Li , Fei Huang , Luo Si , Yongbin Li

The task of text-to-SQL aims to convert a natural language question into its corresponding SQL query within the context of relational tables. Existing text-to-SQL parsers generate a "plausible" SQL query for an arbitrary user question,…

Computation and Language · Computer Science 2023-05-22 Bing Wang , Yan Gao , Zhoujun Li , Jian-Guang Lou

Large Language Models (LLMs) have emerged as powerful tools for Text-to-SQL tasks, exhibiting remarkable reasoning capabilities. Different from tasks such as math word problems and commonsense reasoning, SQL solutions have a relatively…

Computation and Language · Computer Science 2024-09-24 Ruilin Luo , Liyuan Wang , Binghuai Lin , Zicheng Lin , Yujiu Yang

Large language models (LLMs) are increasingly powering Text-to-SQL (Text2SQL) systems, enabling non-expert users to query industrial databases using natural language. While test-time scaling strategies have shown promise in LLM-based…

Computation and Language · Computer Science 2025-10-14 Jiajing Guo , Kenil Patel , Jorge Piazentin Ono , Wenbin He , Liu Ren

Despite the significant advancements of self-play fine-tuning (SPIN), which can transform a weak large language model (LLM) into a strong one through competitive interactions between models of varying capabilities, it still faces challenges…

Computation and Language · Computer Science 2025-10-14 Yuhao Zhang , Shaoming Duan , Jinhang Su , Chuanyi Liu , Peiyi Han

We introduce SQLSpace, a human-interpretable, generalizable, compact representation for text-to-SQL examples derived with minimal human intervention. We demonstrate the utility of these representations in evaluation with three use cases:…

Computation and Language · Computer Science 2025-11-03 Neha Srikanth , Victor Bursztyn , Puneet Mathur , Ani Nenkova

To elevate the foundational capabilities and generalization prowess of the text-to-SQL model in real-world applications, we integrate model interpretability analysis with execution-guided strategy for semantic parsing of WHERE clauses in…

Artificial Intelligence · Computer Science 2025-08-20 Cong Zhang

Large language models (LLMs) have demonstrated strong capabilities in translating natural language questions about relational databases into SQL queries. In particular, test-time scaling techniques such as Self-Consistency and…

Computation and Language · Computer Science 2025-07-01 Lei Sheng , Shuai-Shuai Xu

Translating natural language questions into SQL queries, known as text-to-SQL, is a long-standing research problem. Effective text-to-SQL synthesis can become very challenging due to (i) the extensive size of database catalogs (descriptions…

Machine Learning · Computer Science 2024-11-27 Shayan Talaei , Mohammadreza Pourreza , Yu-Chen Chang , Azalia Mirhoseini , Amin Saberi

Large Language Models (LLMs) have emerged as a promising solution for converting natural language queries into SQL commands, enabling seamless database interaction. However, these Text-to-SQL (Text2SQL) systems face inherent limitations,…

Information Retrieval · Computer Science 2025-03-25 Prakhar Gurawa , Anjali Dharmik

We present HES-SQL, a novel hybrid training framework that advances Text-to-SQL generation through the integration of thinking-mode-fused supervised fine-tuning (SFT) with Group Relative Policy Optimization (GRPO). Our approach introduces…

Databases · Computer Science 2025-10-13 Suming Qiu , Jing Li , Zhicheng Zhou , Junjie Huang , Linyuan Qiu , Zhijie Sun

The rise of large language models (LLMs) and their tight integration into our daily life make it essential to dedicate efforts towards their trustworthiness. Uncertainty quantification for LLMs can establish more human trust into their…

Computation and Language · Computer Science 2026-05-06 Daniel Yang , Yao-Hung Hubert Tsai , Makoto Yamada

Generating accurate SQL queries for user questions (text-to-SQL) has been a long-standing challenge since it requires a deep understanding of both the user's question and the corresponding database schema in order to retrieve the desired…

Computation and Language · Computer Science 2024-06-07 Zijin Hong , Zheng Yuan , Hao Chen , Qinggang Zhang , Feiran Huang , Xiao Huang

Natural Language Interfaces for Databases empower non-technical users to interact with data using natural language (NL). Advanced approaches, utilizing either neural sequence-to-sequence or more recent sophisticated large-scale language…

Databases · Computer Science 2026-01-09 Yuankai Fan , Tonghui Ren , Can Huang , Zhenying He , X. Sean Wang