English
Related papers

Related papers: Reliable Text-to-SQL with Adaptive Abstention

200 papers

Text-to-SQL models can generate a list of candidate SQL queries, and the best query is often in the candidate list, but not at the top of the list. An effective re-rank method can select the right SQL query from the candidate list and…

Computation and Language · Computer Science 2024-01-05 Zhenwen Li , Tao Xie

In sophisticated existing Text-to-SQL methods exhibit errors in various proportions, including schema-linking errors (incorrect columns, tables, or extra columns), join errors, nested errors, and group-by errors. Consequently, there is a…

Databases · Computer Science 2024-05-17 Sun Yang , Qiong Su , Zhishuai Li , Ziyue Li , Hangyu Mao , Chenxi Liu , Rui Zhao

The proliferation of Large Language Models (LLMs) necessitates valid evaluation methods to guide downstream applications and actionable future improvements. The Item Response Theory (IRT) has recently emerged as a promising framework for…

Methodology · Statistics 2025-12-12 Zhiyu Xu , Jia Liu , Yixin Wang , Yuqi Gu

Extracting structured information from text, such as key-value pairs that could augment tabular data, is quite useful in many enterprise use cases. Although large language models (LLMs) have enabled numerous automated pipelines for…

Computation and Language · Computer Science 2025-07-30 Satyananda Kashyap , Sola Shirai , Nandana Mihindukulasooriya , Horst Samulowitz

This study presents a comparative analysis of the a complex SQL benchmark, TPC-DS, with two existing text-to-SQL benchmarks, BIRD and Spider. Our findings reveal that TPC-DS queries exhibit a significantly higher level of structural…

Databases · Computer Science 2024-07-30 Limin Ma , Ken Pu , Ying Zhu

Recent advances in Large Reasoning Models (LRMs) trained with Long Chain-of-Thought have demonstrated remarkable capabilities in code generation and mathematical reasoning. However, their potential in multi-turn Text-to-SQL tasks remains…

Computation and Language · Computer Science 2026-05-06 Le Zhou , Feng Yao , Fengcai Qiao , Bo Xu , Fangyuan Wang , Boyan Xu

To access data stored in relational databases, users need to understand the database schema and write a query using a query language such as SQL. To simplify this task, text-to-SQL models attempt to translate a user's natural language…

Computation and Language · Computer Science 2020-11-05 Amol Kelkar , Rohan Relan , Vaishali Bhardwaj , Saurabh Vaichal , Chandra Khatri , Peter Relan

Relational database management systems (RDBMSs) are powerful because they are able to optimize and answer queries against any relational database. A natural language interface (NLI) for a database, on the other hand, is tailored to support…

Artificial Intelligence · Computer Science 2018-09-11 Wenlu Wang , Yingtao Tian , Hongyu Xiong , Haixun Wang , Wei-Shinn Ku

Text-based Person Retrieval (TPR) aims to retrieve person images that match the description given a text query. The performance improvement of the TPR model relies on high-quality data for supervised training. However, it is difficult to…

Computer Vision and Pattern Recognition · Computer Science 2024-05-21 Zheng Li , Lijia Si , Caili Guo , Yang Yang , Qiushi Cao

Text-to-SQL aims to translate natural language queries into SQL statements, which is practical as it enables anyone to easily retrieve the desired information from databases. Recently, many existing approaches tackle this problem with Large…

Intent detection is a critical component of task-oriented dialogue systems (TODS) which enables the identification of suitable actions to address user utterances at each dialog turn. Traditional approaches relied on computationally…

Computation and Language · Computer Science 2024-10-03 Gaurav Arora , Shreya Jain , Srujana Merugu

Large language models (LLMs) are increasingly powering Text-to-SQL (Text2SQL) systems, enabling non-expert users to query industrial databases using natural language. While test-time scaling strategies have shown promise in LLM-based…

Computation and Language · Computer Science 2025-10-14 Jiajing Guo , Kenil Patel , Jorge Piazentin Ono , Wenbin He , Liu Ren

Relational databases are foundational to numerous domains, including business intelligence, scientific research, and enterprise systems. However, accessing and analyzing structured data often requires proficiency in SQL, which is a skill…

Databases · Computer Science 2025-07-10 Luyu Qiu , Jianing Li , Chi Su , Lei Chen

Text-to-SQL enables users to interact with databases through natural language, simplifying the retrieval and synthesis of information. Despite the success of large language models (LLMs) in converting natural language questions into SQL…

Machine Learning · Computer Science 2025-04-23 Oleg Somov , Elena Tutubalina

Text-to-SQL (Text2SQL) aims to map natural language questions to executable SQL queries. Although large language models (LLMs) have driven significant progress, current approaches struggle with poor transferability to open-source LLMs,…

Databases · Computer Science 2025-05-23 Shuai Lyu , Haoran Luo , Ripeng Li , Zhonghong Ou , Jiangfeng Sun , Yang Qin , Xiaoran Shang , Meina Song , Yifan Zhu

Text-to-SQL models allow users to interact with a database more easily by generating executable SQL statements from natural-language questions. Despite recent successes on simpler databases and questions, current Text-to-SQL methods still…

Artificial Intelligence · Computer Science 2025-09-10 Heng Hao , Wenjun Hu , Oxana Verkholyak , Davoud Ataee Tarzanagh , Baruch Gutow , Sima Didari , Masoud Faraki , Hankyu Moon , Seungjai Min

Text-to-SQL systems (also known as NL-to-SQL systems) have become an increasingly popular solution for bridging the gap between user capabilities and SQL-based data access. These systems translate user requests in natural language to valid…

Databases · Computer Science 2024-12-02 Jonathan Fürst , Catherine Kosten , Farhad Nooralahzadeh , Yi Zhang , Kurt Stockinger

Recent LLM-based Text-to-SQL methods usually suffer from significant performance degradation on "huge" databases and complex user questions that require multi-step reasoning. Moreover, most existing methods neglect the crucial significance…

Computation and Language · Computer Science 2025-03-19 Bing Wang , Changyu Ren , Jian Yang , Xinnian Liang , Jiaqi Bai , LinZheng Chai , Zhao Yan , Qian-Wen Zhang , Di Yin , Xing Sun , Zhoujun Li

Although Large Language Models (LLMs) have demonstrated extraordinary capabilities in many domains, they still have a tendency to hallucinate and generate fictitious responses to user requests. This problem can be alleviated by augmenting…

Information Retrieval · Computer Science 2023-06-09 Jiongnan Liu , Jiajie Jin , Zihan Wang , Jiehan Cheng , Zhicheng Dou , Ji-Rong Wen

Supervised Fine-Tuning (SFT) is an effective method for adapting Large Language Models (LLMs) on downstream tasks. However, variability in training data can hinder a model's ability to generalize across domains. This paper studies the…

Computation and Language · Computer Science 2025-10-07 Davood Rafiei , Morgan Lindsay Heisler , Weiwei Zhang , Mohammadreza Pourreza , Yong Zhang