English
Related papers

Related papers: N-Best Hypotheses Reranking for Text-To-SQL System…

200 papers

To access data stored in relational databases, users need to understand the database schema and write a query using a query language such as SQL. To simplify this task, text-to-SQL models attempt to translate a user's natural language…

Computation and Language · Computer Science 2020-11-05 Amol Kelkar , Rohan Relan , Vaishali Bhardwaj , Saurabh Vaichal , Chandra Khatri , Peter Relan

The previous state-of-the-art (SOTA) method achieved a remarkable execution accuracy on the Spider dataset, which is one of the largest and most diverse datasets in the Text-to-SQL domain. However, during our reproduction of the business…

Artificial Intelligence · Computer Science 2023-11-01 Guanghu Sui , Zhishuai Li , Ziyue Li , Sun Yang , Jingqing Ruan , Hangyu Mao , Rui Zhao

Recently, large language models (LLMs) have significantly improved the performance of text-to-SQL systems. Nevertheless, many state-of-the-art (SOTA) approaches have overlooked the critical aspect of system robustness. Our experiments…

Computation and Language · Computer Science 2024-12-18 Geling Liu , Yunzhi Tan , Ruichao Zhong , Yuanzhen Xie , Lingchen Zhao , Qian Wang , Bo Hu , Zang Li

Conversational, multi-turn, text-to-SQL (CoSQL) tasks map natural language utterances in a dialogue to SQL queries. State-of-the-art (SOTA) systems use large, pre-trained and finetuned language models, such as the T5-family, in conjunction…

Computation and Language · Computer Science 2023-02-23 Sree Hari Krishnan Parthasarathi , Lu Zeng , Dilek Hakkani-Tur

There is currently a significant gap between the performance of fine-tuned models and prompting approaches using Large Language Models (LLMs) on the challenging task of text-to-SQL, as evaluated on datasets such as Spider. To improve the…

Computation and Language · Computer Science 2023-11-06 Mohammadreza Pourreza , Davood Rafiei

Text-to-SQL models can generate a list of candidate SQL queries, and the best query is often in the candidate list, but not at the top of the list. An effective re-rank method can select the right SQL query from the candidate list and…

Computation and Language · Computer Science 2024-01-05 Zhenwen Li , Tao Xie

Text-to-SQLs enables non-expert users to effortlessly retrieve desired information from relational databases using natural language queries. While recent advancements, particularly with Large Language Models (LLMs) like GPT and T5, have…

Databases · Computer Science 2024-10-04 Shouvon Sarker , Xishuang Dong , Xiangfang Li , Lijun Qian

Language models have shown promising performance on the task of translating natural language questions into SQL queries (Text-to-SQL). However, most of the state-of-the-art (SOTA) approaches rely on powerful yet closed-source large language…

Computation and Language · Computer Science 2024-02-27 Haoyang Li , Jing Zhang , Hanbing Liu , Ju Fan , Xiaokang Zhang , Jun Zhu , Renjie Wei , Hongyan Pan , Cuiping Li , Hong Chen

Text-to-SQL generation aims to translate natural language questions into SQL statements. In Text-to-SQL based on large language models, schema linking is a widely adopted strategy to streamline the input for LLMs by selecting only relevant…

Computation and Language · Computer Science 2024-11-27 Zhenbiao Cao , Yuanlei Zheng , Zhihao Fan , Xiaojin Zhang , Wei Chen , Xiang Bai

Text-to-SQL is a crucial task toward developing methods for understanding natural language by computers. Recent neural approaches deliver excellent performance; however, models that are difficult to interpret inhibit future developments.…

Computation and Language · Computer Science 2021-02-04 Yasufumi Taniguchi , Hiroki Nakayama , Kubo Takahiro , Jun Suzuki

In recent years,Text-to-SQL, the problem of automatically converting questions posed in natural language to formal SQL queries, has emerged as an important problem at the intersection of natural language processing and data management…

Computation and Language · Computer Science 2024-09-17 Ke Shen , Mayank Kejriwal

When translating natural language questions into SQL queries to answer questions from a database, contemporary semantic parsing models struggle to generalize to unseen database schemas. The generalization challenge lies in (a) encoding the…

Computation and Language · Computer Science 2021-08-25 Bailin Wang , Richard Shin , Xiaodong Liu , Oleksandr Polozov , Matthew Richardson

State-of-the-art (SOTA) Text-to-SQL methods still lag significantly behind human experts on challenging benchmarks like BIRD. Current approaches that explore test-time scaling lack an orchestrated strategy and neglect the model's internal…

Computation and Language · Computer Science 2025-12-11 Pengfei Wang , Baolin Sun , Xuemei Dong , Yaxun Dai , Hongwei Yuan , Mengdie Chu , Yingqi Gao , Xiang Qi , Peng Zhang , Ying Yan

We present ReFoRCE, a Text-to-SQL agent that tops the Spider 2.0 leaderboard--a challenging benchmark reflecting complex, real-world Text-to-SQL scenarios. While Text-to-SQL systems enable natural language queries over structured databases,…

Computation and Language · Computer Science 2025-06-05 Minghang Deng , Ashwin Ramachandran , Canwen Xu , Lanxiang Hu , Zhewei Yao , Anupam Datta , Hao Zhang

A practical text-to-SQL system should generalize well on a wide variety of natural language questions, unseen database schemas, and novel SQL query structures. To comprehensively evaluate text-to-SQL systems, we introduce a UNIfied…

Text-to-SQL semantic parsing has made significant progress in recent years, with various models demonstrating impressive performance on the challenging Spider benchmark. However, it has also been shown that these models often struggle to…

Computation and Language · Computer Science 2024-02-14 Irina Saparina , Mirella Lapata

Translating natural language queries into SQLs in a seq2seq manner has attracted much attention recently. However, compared with abstract-syntactic-tree-based SQL generation, seq2seq semantic parsers face much more challenges, including…

Computation and Language · Computer Science 2023-06-16 Yuntao Li , Zhenpeng Su , Yutian Li , Hanchu Zhang , Sirui Wang , Wei Wu , Yan Zhang

Automatic SQL generation has been an active research area, aiming at streamlining the access to databases by writing natural language with the given intent instead of writing SQL. Current SOTA methods for semantic parsing depend on LLMs to…

Machine Learning · Computer Science 2022-09-22 Samuel Arcadinho , David Aparício , Hugo Veiga , António Alegria

Text-to-SQL is a technology that converts natural language queries into the structured query language SQL. A novel research approach that has recently gained attention focuses on methods based on the complexity of SQL queries, achieving…

Computation and Language · Computer Science 2024-06-14 Jiawen Yi , Guo Chen , Zixiang Shen

In addressing the task of converting natural language to SQL queries, there are several semantic and syntactic challenges. It becomes increasingly important to understand and remedy the points of failure as the performance of semantic…

Computation and Language · Computer Science 2023-06-01 Parker Glenn , Parag Pravin Dakle , Preethi Raghavan
‹ Prev 1 2 3 10 Next ›