English
Related papers

Related papers: ScienceBenchmark: A Complex Real-World Benchmark f…

200 papers

The ability to generate SQL queries from natural language has significant implications for making data accessible to non-specialists. This paper presents a novel approach to fine-tuning open-source large language models (LLMs) for the task…

Databases · Computer Science 2023-12-06 Amine Rebei

We present MatSci-NLP, a natural language benchmark for evaluating the performance of natural language processing (NLP) models on materials science text. We construct the benchmark from publicly available materials science text data to…

Computation and Language · Computer Science 2023-05-16 Yu Song , Santiago Miret , Bang Liu

This paper describes DBPal, a new system to translate natural language utterances into SQL statements using a neural machine translation model. While other recent approaches use neural machine translation to implement a Natural Language…

Text-to-SQL bridges the gap between natural language and structured database language, thus allowing non-technical users to easily query databases. Traditional approaches model text-to-SQL as a direct translation task, where a given Natural…

Machine Learning · Computer Science 2025-08-12 Anurag Tripathi , Vaibhav Patle , Abhinav Jain , Ayush Pundir , Sairam Menon , Ajeet Kumar Singh , Dorien Herremans

Large Language Models (LLMs) have recently become sophisticated enough to automate many tasks ranging from pattern finding to writing assistance to code generation. In this paper, we examine text-to-SQL generation. We have observed from…

Databases · Computer Science 2025-09-04 Vladislav Shkapenyuk , Divesh Srivastava , Theodore Johnson , Parisa Ghane

Natural language to SQL translation (Text-to-SQL) is one of the long-standing problems that has recently benefited from advances in Large Language Models (LLMs). While most academic Text-to-SQL benchmarks request schema description as a…

Computation and Language · Computer Science 2026-01-13 Rajpreet Singh , Novak Boškov , Lawrence Drabeck , Aditya Gudal , Manzoor A. Khan

Existing text-to-SQL research only considers complete questions as the input, but lay-users might strive to formulate a complete question. To build a smarter natural language interface to database systems (NLIDB) that also processes…

Computation and Language · Computer Science 2021-10-01 Naihao Deng , Shuaichen Chang , Peng Shi , Tao Yu , Rui Zhang

Text-to-SQL generation aims to translate natural language questions into SQL statements. In Text-to-SQL based on large language models, schema linking is a widely adopted strategy to streamline the input for LLMs by selecting only relevant…

Computation and Language · Computer Science 2024-11-27 Zhenbiao Cao , Yuanlei Zheng , Zhihao Fan , Xiaojin Zhang , Wei Chen , Xiang Bai

The rise of large language models (LLMs) has significantly impacted various domains, including natural language processing (NLP) and image generation, by making complex computational tasks more accessible. While LLMs demonstrate impressive…

Databases · Computer Science 2024-10-15 Ananya Rahaman , Anny Zheng , Mostafa Milani , Fei Chiang , Rachel Pottinger

Text-to-SQL translates natural language questions into executable SQL queries, enabling intuitive database access for non-experts. While large language models achieve strong performance on Text-to-SQL with prompting, they still struggle…

Computation and Language · Computer Science 2026-05-12 Zhao Tan , Xiping Liu , Qing Shu , Qizhi Wan , Dexi Liu , Changxuan Wan

LLMs have shown impressive progress in natural language processing. However, they still face significant challenges in TableQA, where real-world complexities such as diverse table structures, multilingual data, and domain-specific reasoning…

Computation and Language · Computer Science 2025-09-23 Junnan Zhu , Jingyi Wang , Bohan Yu , Xiaoyu Wu , Junbo Li , Lei Wang , Nan Xu

Translating natural language questions into SQL has become a core challenge in enabling non-technical users to query databases. While recent work has explored large-scale synthetic data generation to improve model performance through…

Artificial Intelligence · Computer Science 2025-10-01 Hasan Alp Caferoğlu , Mehmet Serhat Çelik , Özgür Ulusoy

A Natural Language Interface (NLI) facilitates users to pose queries to retrieve information from a database without using any artificial language such as the Structured Query Language (SQL). Several applications in various domains…

Recently, at Xiaohongshu, the rapid expansion of e-commerce and advertising demands real-time business analytics with high accuracy and low latency. To meet this demand, systems typically rely on converting natural language (NL) queries…

Information Retrieval · Computer Science 2026-04-28 Tong Wang , Yongqin Xu , Jianfeng Zhang , Lingxi Cui , Wenqing Wei , Suzhou Chen , Huan Li , Ke Chen , Lidan Shou

Recent advancements in large language models (LLMs) have significantly contributed to the progress of the Text-to-SQL task. A common requirement in many of these works is the post-correction of SQL queries. However, the majority of this…

Databases · Computer Science 2025-01-10 Chaofan Li , Yingxia Shao , Yawen Li , Zheng Liu

NL2SQL systems deployed in industry settings often encounter ambiguous or unanswerable queries, particularly in interactive scenarios with incomplete user clarification. Existing benchmarks typically assume a single source of ambiguity and…

Text-to-SQL, which involves translating natural language into Structured Query Language (SQL), is crucial for enabling broad access to structured databases without expert knowledge. However, designing models for such tasks is challenging…

Computation and Language · Computer Science 2024-03-27 Niklas Wretblad , Fredrik Gordh Riseby , Rahul Biswas , Amin Ahmadi , Oskar Holmström

Database research and development often require a large number of SQL queries for benchmarking purposes. However, acquiring real-world SQL queries is challenging due to privacy concerns, and existing SQL generation methods are limited in…

Databases · Computer Science 2025-12-03 Jiale Lao , Immanuel Trummer

A significant amount of the world's knowledge is stored in relational databases. However, the ability for users to retrieve facts from a database is limited due to a lack of understanding of query languages such as SQL. We propose Seq2SQL,…

Computation and Language · Computer Science 2017-11-13 Victor Zhong , Caiming Xiong , Richard Socher

Text-to-SQL models have significantly improved with the adoption of Large Language Models (LLMs), leading to their increasing use in real-world applications. Although many benchmarks exist for evaluating the performance of text-to-SQL…

Databases · Computer Science 2026-04-29 Sepideh Abedini , M. Tamer Özsu