English
Related papers

Related papers: Beyond Query-Level Comparison: Fine-Grained Reinfo…

200 papers

Current Text-to-SQL methods are evaluated and only focused on executable queries, overlooking the semantic alignment challenge -- both in terms of the semantic meaning of the query and the correctness of the execution results. Even…

Computation and Language · Computer Science 2025-11-24 Ashish Kattamuri , Ishita Prasad , Meetu Malhotra , Arpita Vats , Rahul Raja , Albert Lie

We consider the problem of neural semantic parsing, which translates natural language questions into executable SQL queries. We introduce a new mechanism, execution guidance, to leverage the semantics of SQL. It detects and excludes faulty…

Computation and Language · Computer Science 2018-09-17 Chenglong Wang , Kedar Tatwawadi , Marc Brockschmidt , Po-Sen Huang , Yi Mao , Oleksandr Polozov , Rishabh Singh

Tabular data serves as the backbone of modern data analysis and scientific research. While Large Language Models (LLMs) fine-tuned via Supervised Fine-Tuning (SFT) have significantly improved natural language interaction with such…

We introduce a framework for generating Chain-of-Thought (CoT) rationales to enhance text-to-SQL model fine-tuning. These rationales consist of intermediate SQL statements and explanations, serving as incremental steps toward constructing…

Computation and Language · Computer Science 2025-03-21 Gaetano Rossiello , Nhan Pham , Michael Glass , Junkyu Lee , Dharmashankar Subramanian

Reinforcement learning (RL) training of large language models (LLMs) on unverifiable tasks is challenging even when a reasonable-quality reference answer is available. We propose a constrained RL training framework that (i) optimizes a…

To meet the requirements of real-world applications, it is essential to control generations of large language models (LLMs). Prior research has tried to introduce reinforcement learning (RL) into controllable text generation while most…

Computation and Language · Computer Science 2024-03-19 Wendi Li , Wei Wei , Kaihe Xu , Wenfeng Xie , Dangyang Chen , Yu Cheng

Text-to-SQL enables users to interact with databases using natural language, simplifying the retrieval and synthesis of information. Despite the remarkable success of large language models (LLMs) in translating natural language questions…

Artificial Intelligence · Computer Science 2024-07-03 Gyubok Lee , Woosog Chay , Seonhee Cho , Edward Choi

LLMs when used with Retrieval Augmented Generation (RAG), are greatly improving the SOTA of translating natural language queries to structured and correct SQL. Unlike previous reviews, this survey provides a comprehensive study of the…

Computation and Language · Computer Science 2025-02-05 Ali Mohammadjafari , Anthony S. Maida , Raju Gottumukkala

Translating natural language utterances to executable queries is a helpful technique in making the vast amount of data stored in relational databases accessible to a wider range of non-tech-savvy end users. Prior work in this area has…

Computation and Language · Computer Science 2020-10-21 Karthik Radhakrishnan , Arvind Srikantan , Xi Victoria Lin

Text-to-SQL, the process of translating natural language into Structured Query Language (SQL), represents a transformative application of large language models (LLMs), potentially revolutionizing how humans interact with data. This paper…

Text-to-SQL, the task of translating natural language questions into SQL queries, is part of various business processes. Its automation, which is an emerging challenge, will empower software practitioners to seamlessly interact with…

Software Engineering · Computer Science 2024-01-10 Yewei Song , Saad Ezzini , Xunzhu Tang , Cedric Lothritz , Jacques Klein , Tegawendé Bissyandé , Andrey Boytsov , Ulrick Ble , Anne Goujon

Text-to-SQL transforms the user queries from natural language to executable SQL programs, enabling non-experts to interact with complex databases. Existing prompt-based methods craft meticulous text guidelines and examples to facilitate SQL…

Computation and Language · Computer Science 2025-06-04 Yongdong chi , Hanqing Wang , Zonghan Yang , Jian Yang , Xiao Yan , Yun Chen , Guanhua Chen

Neural based approaches to automatic evaluation of subjective responses have shown superior performance and efficiency compared to traditional rule-based and feature engineering oriented solutions. However, it remains unclear whether the…

Computation and Language · Computer Science 2023-09-07 Brian Cho , Youngbin Jang , Jaewoong Yoon

Tool-integrated Text-to-SQL parsing has emerged as a promising paradigm, framing SQL generation as a sequential decision-making process interleaved with tool execution. However, existing reinforcement learning approaches mainly rely on…

Computation and Language · Computer Science 2026-05-08 Yaxun Dai , Baolin Sun , Junying Wang , Pengfei Wang , Yingqi Gao , Xuemei Dong , Mengdie Chu , Xiang Qi , Pingfu Chao

Reinforcement learning (RL) can align language models with non-differentiable reward signals, such as human preferences. However, a major challenge arises from the sparsity of these reward signals - typically, there is only a single reward…

Computation and Language · Computer Science 2024-02-20 Meng Cao , Lei Shu , Lei Yu , Yun Zhu , Nevan Wichers , Yinxiao Liu , Lei Meng

As large language models (LLMs) are increasingly used in Text-to-SQL tasks, Reinforcement Learning (RL) has become a common method for improving performance. Existing methods primarily rely on static execution feedback, which restricts…

Artificial Intelligence · Computer Science 2025-10-30 Zekun Xu , Siyu Xia , Chuhuai Yue , Jiajun Chai , Mingxue Tian , Xiaohan Wang , Wei Lin , Haoxuan Li , Guojun Yin

Text-to-SQL generation enables non-experts to interact with databases via natural language. Recent advances rely on large closed-source models like GPT-4 that present challenges in accessibility, privacy, and latency. To address these…

Computation and Language · Computer Science 2025-02-18 Satya Krishna Gorti , Ilan Gofman , Zhaoyan Liu , Jiapeng Wu , Noël Vouitsis , Guangwei Yu , Jesse C. Cresswell , Rasa Hosseinzadeh

Text-to-SQL is a pivotal task that bridges natural language understanding and structured data access, yet it remains fundamentally challenging due to semantic ambiguity and complex compositional reasoning. While large language models (LLMs)…

Artificial Intelligence · Computer Science 2025-10-20 Jiayuan Bai , Xuan-guang Pan , Chongyang Tao , Shuai Ma

The text-to-SQL task is an active challenge in Natural Language Processing. Many existing solutions focus on using black-box language models extended with specialized components within customized end-to-end text-to-SQL pipelines. While…

Machine Learning · Computer Science 2025-11-17 Alicja Rączkowska , Riccardo Belluzzo , Piotr Zieliński , Joanna Baran , Paweł Olszewski

Large Language Models (LLMs) can translate natural language into SQL, but small models struggle with multi-table and complex queries in Zero-Shot Learning (ZSL) settings. While Supervised Fine-Tuning (SFT) helps, it falls short for harder…

Machine Learning · Computer Science 2026-05-05 Simone Papicchio , Simone Rossi , Luca Cagliero , Paolo Papotti