English
Related papers

Related papers: KaggleDBQA: Realistic Evaluation of Text-to-SQL Pa…

200 papers

Given a database schema, Text-to-SQL aims to translate a natural language question into the corresponding SQL query. Under the setup of cross-domain, traditional semantic parsing models struggle to adapt to unseen database schemas. To…

Computation and Language · Computer Science 2021-04-15 Zhi Chen , Lu Chen , Yanbin Zhao , Ruisheng Cao , Zihan Xu , Su Zhu , Kai Yu

Question Answering over Tabular Data (Table QA) presents unique challenges due to the diverse structure, size, and data types of real-world tables. The SemEval 2025 Task 8 (DataBench) introduced a benchmark composed of large-scale,…

Computation and Language · Computer Science 2025-09-12 Rishit Tyagi , Mohit Gupta , Rahul Bouri

Text-to-SQL aims to map natural language questions to SQL queries. The sketch-based method combined with execution-guided (EG) decoding strategy has shown a strong performance on the WikiSQL benchmark. However, execution-guided decoding…

Computation and Language · Computer Science 2021-12-13 Binyuan Hui , Xiang Shi , Ruiying Geng , Binhua Li , Yongbin Li , Jian Sun , Xiaodan Zhu

Most of the world's data is stored in relational databases. Accessing these requires specialized knowledge of the Structured Query Language (SQL), putting them out of the reach of many people. A recent research thread in Natural Language…

Computation and Language · Computer Science 2018-11-05 Bojan Petrovski , Ignacio Aguado , Andreea Hossmann , Michael Baeriswyl , Claudiu Musat

Although a few approaches are proposed to convert relational databases to graphs, there is a genuine lack of systematic evaluation across a wider spectrum of databases. Recognising the important issue of query mapping, this paper proposes…

Databases · Computer Science 2023-10-27 Ziyu Zhao , Wei Liu , Tim French , Michael Stewart

Natural Language Interfaces for Databases (NLIDBs) aim to make database querying accessible by allowing users to ask questions in everyday language rather than using formal SQL queries. Despite significant advancements in translation…

Databases · Computer Science 2025-11-19 Panos Ipeirotis , Haotian Zheng

Neural models have shown impressive performance gains in answering queries from natural language text. However, existing works are unable to support database queries, such as "List/Count all female athletes who were born in 20th century",…

Computation and Language · Computer Science 2021-06-03 James Thorne , Majid Yazdani , Marzieh Saeidi , Fabrizio Silvestri , Sebastian Riedel , Alon Halevy

Question-answering for domain-specific applications has recently attracted much interest due to the latest advancements in large language models (LLMs). However, accurately assessing the performance of these applications remains a…

We explore using T5 (Raffel et al. (2019)) to directly translate natural language questions into SQL statements. General purpose natural language that interfaces to information stored within databases requires flexibly translating natural…

Artificial Intelligence · Computer Science 2020-11-10 Ning Li , Bethany Keller , Mark Butler , Daniel Cer

This paper presents TableQuery, a novel tool for querying tabular data using deep learning models pre-trained to answer questions on free text. Existing deep learning methods for question answering on tabular data have various limitations,…

Computation and Language · Computer Science 2022-02-02 Abhijith Neil Abraham , Fariz Rahman , Damanpreet Kaur

Translating Natural Language Queries (NLQs) to Structured Query Language (SQL) in interfaces deployed in relational databases is a challenging task, which has been widely studied in database community recently. Conventional rule based…

Databases · Computer Science 2021-04-13 Arif Usta , Akifhan Karakayali , Özgür Ulusoy

Transforming natural language into SQL queries (NL2SQL) is crucial for data-driven business applications. Existing frameworks, trained on open-source datasets, struggle with complex business logic and lack domain-specific data for…

Databases · Computer Science 2025-07-16 Song Cheng , Qiannan Cheng , Linbo Jin , Lei Yi , Guannan Zhang

The conversion of natural language into SQL language for querying databases (Text-to-SQL) has broad application prospects and has attracted widespread attention. At present, the mainstream Text-to-SQL methods are mainly divided into…

Computation and Language · Computer Science 2025-02-18 Lei Sheng , Shuai-Shuai Xu , Wei Xie

As task-oriented dialog systems are becoming increasingly popular in our lives, more realistic tasks have been proposed and explored. However, new practical challenges arise. For instance, current dialog systems cannot effectively handle…

Computation and Language · Computer Science 2021-12-16 Kun Qian , Ahmad Beirami , Satwik Kottur , Shahin Shayandeh , Paul Crook , Alborz Geramifard , Zhou Yu , Chinnadhurai Sankar

Though recent advances in machine learning have led to significant improvements in natural language interfaces for databases, the accuracy and reliability of these systems remain limited, especially in high-stakes domains. This paper…

Human-Computer Interaction · Computer Science 2024-09-11 Yuan Tian , Jonathan K. Kummerfeld , Toby Jia-Jun Li , Tianyi Zhang

Learning to capture text-table alignment is essential for tasks like text-to-SQL. A model needs to correctly recognize natural language references to columns and values and to ground them in the given database schema. In this paper, we…

Computation and Language · Computer Science 2022-09-01 Xiang Deng , Ahmed Hassan Awadallah , Christopher Meek , Oleksandr Polozov , Huan Sun , Matthew Richardson

The task of semantic parsing is highly useful for dialogue and question answering systems. Many datasets have been proposed to map natural language text into SQL, among which the recent Spider dataset provides cross-domain samples with…

Computation and Language · Computer Science 2019-10-17 Qingkai Min , Yuefeng Shi , Yue Zhang

Text-to-SQL over large analytical databases requires navigating complex schemas, resolving ambiguous queries, and grounding decisions in actual data. Most current systems follow a fixed pipeline where schema elements are retrieved once…

Computation and Language · Computer Science 2026-05-05 Quang Hieu Pham , Yang He , Ping Nie , Canwen Xu , Davood Rafiei , Yuepeng Wang , Xi Ye , Jocelyn Qiaochu Chen

Large language models (LLMs) have emerged as a new paradigm for Text-to-SQL task. However, the absence of a systematical benchmark inhibits the development of designing effective, efficient and economic LLM-based Text-to-SQL solutions. To…

Databases · Computer Science 2023-11-21 Dawei Gao , Haibin Wang , Yaliang Li , Xiuyu Sun , Yichen Qian , Bolin Ding , Jingren Zhou

In recent years,Text-to-SQL, the problem of automatically converting questions posed in natural language to formal SQL queries, has emerged as an important problem at the intersection of natural language processing and data management…

Computation and Language · Computer Science 2024-09-17 Ke Shen , Mayank Kejriwal