English
Related papers

Related papers: SpotIt: Evaluating Text-to-SQL Evaluation with For…

200 papers

Visually-guided image editing, where edits are conditioned on both visual cues and textual prompts, has emerged as a powerful paradigm for fine-grained, controllable content generation. Although recent generative models have shown…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Sara Ghazanfari , Wei-An Lin , Haitong Tian , Ersin Yumer

Recent advances in Text-to-SQL have achieved strong results in static, single-turn tasks, where models generate SQL queries from natural language questions. However, these systems fall short in real-world interactive scenarios, where user…

Databases · Computer Science 2025-11-14 Linzhuang Sun , Tianyu Guo , Hao Liang , Yuying Li , Qifeng Cai , Jingxuan Wei , Bihui Yu , Wentao Zhang , Bin Cui

The current state-of-the-art (SOTA) for automated text-to-SQL still falls well short of expert human performance as measured by execution accuracy (EX) on the BIRD-SQL benchmark. The most accurate methods are also slow and expensive. To…

Computation and Language · Computer Science 2024-04-22 Dayton G. Thorpe , Andrew J. Duberstein , Ian A. Kinsey

Large language models (LLMs) becomes the dominant paradigm for the challenging task of text-to-SQL. LLM-empowered text-to-SQL methods are typically categorized into prompting-based and tuning approaches. Compared to prompting-based methods,…

Recently, there has been increasing interest in synthesizing data to improve downstream text-to-SQL tasks. In this paper, we first examined the existing synthesized datasets and discovered that state-of-the-art text-to-SQL algorithms did…

ScenarioBench is a policy-grounded, trace-aware benchmark for evaluating Text-to-SQL and retrieval-augmented generation in compliance contexts. Each YAML scenario includes a no-peek gold-standard package with the expected decision, a…

Computation and Language · Computer Science 2025-09-30 Zahra Atf , Peter R Lewis

Conversational, multi-turn, text-to-SQL (CoSQL) tasks map natural language utterances in a dialogue to SQL queries. State-of-the-art (SOTA) systems use large, pre-trained and finetuned language models, such as the T5-family, in conjunction…

Computation and Language · Computer Science 2023-02-23 Sree Hari Krishnan Parthasarathi , Lu Zeng , Dilek Hakkani-Tur

Existing Text-to-SQL benchmarks primarily focus on single-table queries or limited joins in general-purpose domains, and thus fail to reflect the complexity of domain-specific, multi-table and geospatial reasoning, To address this…

Information Retrieval · Computer Science 2026-03-17 Hanzhou Liu , Kai Yin , Zhitong Chen , Chenyue Liu , Ali Mostafavi

The text-to-SQL task aims to convert natural language into Structured Query Language (SQL) without bias. Recently, text-to-SQL methods based on large language models (LLMs) have garnered significant attention. The core of mainstream…

Databases · Computer Science 2025-02-25 Zeshun You , Jiebin Yao , Dong Cheng , Zhiwei Wen , Zhiliang Lu , Xianyi Shen

This paper introduces text-2-SQL-4-PM, a bilingual (Portuguese-English) benchmark dataset designed for the text-to-SQL task in the process mining domain. Text-to-SQL conversion facilitates natural language querying of databases, increasing…

Information Retrieval · Computer Science 2025-09-15 Bruno Yui Yamate , Thais Rodrigues Neubauer , Marcelo Fantinato , Sarajane Marques Peres

The conversion of natural language queries into SQL queries, known as Text-to-SQL, is a critical yet challenging task. This paper introduces EPI-SQL, a novel methodological framework leveraging Large Language Models (LLMs) to enhance the…

Computation and Language · Computer Science 2024-04-24 Xiping Liu , Zhao Tan

Text-to-SQL systems facilitate smooth interaction with databases by translating natural language queries into Structured Query Language (SQL), bridging the gap between non-technical users and complex database management systems. This survey…

Artificial Intelligence · Computer Science 2025-01-24 Aditi Singh , Akash Shetty , Abul Ehtesham , Saket Kumar , Tala Talaei Khoei

Formal verification of floating-point arithmetic remains challenging due to non-linear arithmetic behavior and the tight coupling between control and datapath logic. Existing approaches often rely on high-level C models for equivalence…

Logic in Computer Science · Computer Science 2026-03-05 Hansa Mohanty , Vaisakh Naduvodi Viswambharan , Deepak Narayan Gadde

Previous text-to-SQL datasets and systems have primarily focused on user questions with clear intentions that can be answered. However, real user questions can often be ambiguous with multiple interpretations or unanswerable due to a lack…

Online social networks serve as major platforms for disseminating both real and fake news. Many users--intentionally or unintentionally--spread harmful content, misinformation, and rumors in domains such as politics and business.…

Social and Information Networks · Computer Science 2025-10-17 Mohammad Moradi , Mostafa Haghir Chehreghani

Converting natural language (NL) questions into SQL queries, referred to as Text-to-SQL, has emerged as a pivotal technology for facilitating access to relational databases, especially for users without SQL knowledge. Recent progress in…

Computation and Language · Computer Science 2025-06-02 Yiming Huang , Jiyu Guo , Wenxin Mao , Cuiyun Gao , Peiyi Han , Chuanyi Liu , Qing Ling

This paper addresses the problem of single-target tracker performance evaluation. We consider the performance measures, the dataset and the evaluation system to be the most important components of tracker evaluation and propose requirements…

Computer Vision and Pattern Recognition · Computer Science 2016-01-12 Matej Kristan , Jiri Matas , Ales Leonardis , Tomas Vojir , Roman Pflugfelder , Gustavo Fernandez , Georg Nebehay , Fatih Porikli , Luka Cehovin

Incidental scene text spotting is considered one of the most difficult and valuable challenges in the document analysis community. Most existing methods treat text detection and recognition as separate tasks. In this work, we propose a…

Computer Vision and Pattern Recognition · Computer Science 2018-01-16 Xuebo Liu , Ding Liang , Shi Yan , Dagui Chen , Yu Qiao , Junjie Yan

While recent advancements in inference-time learning have improved LLM reasoning on Text-to-SQL tasks, current solutions still struggle to perform well on the most challenging tasks in the Bird-Bench (BIRD) benchmark. This is due to…

Computation and Language · Computer Science 2026-05-11 James Petullo , Nianwen Xue

Exploring the generalization of a text-to-SQL parser is essential for a system to automatically adapt the real-world databases. Previous works provided investigations focusing on lexical diversity, including the influence of the synonym and…

Artificial Intelligence · Computer Science 2023-01-24 Jieyu Li , Lu Chen , Ruisheng Cao , Su Zhu , Hongshen Xu , Zhi Chen , Hanchong Zhang , Kai Yu