English
Related papers

Related papers: FINER-SQL: Boosting Small Language Models for Text…

200 papers

Natural Language to SQL (NL2SQL) has seen significant advancements with large language models (LLMs). However, these models often depend on closed-source systems and high computational resources, posing challenges in data privacy and…

Computation and Language · Computer Science 2025-08-19 Wenqi Pei , Hailing Xu , Hengyuan Zhao , Shizheng Hou , Han Chen , Zining Zhang , Pingyi Luo , Bingsheng He

Leading models for the text-to-SQL task heavily rely on proprietary Large Language Models (LLMs), posing concerns over data privacy. Closing the performance gap between small open-source models and large proprietary models is crucial to…

Computation and Language · Computer Science 2024-02-05 Mohammadreza Pourreza , Davood Rafiei

As large language models (LLMs) are increasingly used in Text-to-SQL tasks, Reinforcement Learning (RL) has become a common method for improving performance. Existing methods primarily rely on static execution feedback, which restricts…

Artificial Intelligence · Computer Science 2025-10-30 Zekun Xu , Siyu Xia , Chuhuai Yue , Jiajun Chai , Mingxue Tian , Xiaohan Wang , Wei Lin , Haoxuan Li , Guojun Yin

Aligning Large Language Models (LLMs) with human preferences is crucial for their deployment in real-world applications. Recent advancements in Self-Rewarding Language Models suggest that an LLM can use its internal reward models (such as…

Artificial Intelligence · Computer Science 2025-02-14 Xin Zhou , Yiwen Guo , Ruotian Ma , Tao Gui , Qi Zhang , Xuanjing Huang

Large Language Models (LLMs) often struggle with the precise logic and schema alignment required for complex Text-to-SQL tasks. While current methods rely heavily on static prompting, they lack the ability to dynamically adapt and…

Computation and Language · Computer Science 2026-05-12 Haolin Yang , Jipeng Zhang , Zhitao He , Alexander Zhou , Yi R. Fung

Recent advancements in large language models (LLMs) have significantly improved performance on the Text-to-SQL task. However, prior approaches typically rely on static, pre-processed database information provided at inference time, which…

Computation and Language · Computer Science 2025-06-23 Wenxuan Xie , Yaxun Dai , Wenhao Jiang

Large Language models (LLMs) have demonstrated significant potential in text-to-SQL reasoning tasks, yet a substantial performance gap persists between existing open-source models and their closed-source counterparts. In this paper, we…

Computation and Language · Computer Science 2025-09-23 Yu Guo , Dong Jin , Shenghao Ye , Shuangwu Chen , Jian Yang , Xiaobin Tan

Text-to-SQL enables users to interact with databases using natural language, simplifying the retrieval and synthesis of information. Despite the remarkable success of large language models (LLMs) in translating natural language questions…

Artificial Intelligence · Computer Science 2024-07-03 Gyubok Lee , Woosog Chay , Seonhee Cho , Edward Choi

Recent advancements in large language models (LLMs) have shifted the post-training paradigm from traditional instruction tuning and human preference alignment toward reinforcement learning (RL) focused on reasoning capabilities. However,…

Artificial Intelligence · Computer Science 2025-11-12 Qianxi He , Qingyu Ren , Shanzhe Lei , Xuhong Wang , Yingchun Wang

Distilling the tool-using capabilities of large language models (LLMs) into smaller, more efficient small language models (SLMs) is a key challenge for their practical application. The predominant approach, supervised fine-tuning (SFT),…

Computation and Language · Computer Science 2025-10-29 ChangSu Choi , Hoyun Song , Dongyeon Kim , WooHyeon Jung , Minkyung Cho , Sunjin Park , NohHyeob Bae , Seona Yu , KyungTae Lim

Large language models (LLMs) have emerged as a new paradigm for Text-to-SQL task. However, the absence of a systematical benchmark inhibits the development of designing effective, efficient and economic LLM-based Text-to-SQL solutions. To…

Databases · Computer Science 2023-11-21 Dawei Gao , Haibin Wang , Yaliang Li , Xiuyu Sun , Yichen Qian , Bolin Ding , Jingren Zhou

Text-to-SQL, the task of translating natural language questions into SQL queries, is part of various business processes. Its automation, which is an emerging challenge, will empower software practitioners to seamlessly interact with…

Software Engineering · Computer Science 2024-01-10 Yewei Song , Saad Ezzini , Xunzhu Tang , Cedric Lothritz , Jacques Klein , Tegawendé Bissyandé , Andrey Boytsov , Ulrick Ble , Anne Goujon

Reinforcement learning (RL) has been widely adopted to enhance the performance of large language models (LLMs) on Text-to-SQL tasks. However, existing methods often rely on execution-based or LLM-based Bradley-Terry reward models. The…

Machine Learning · Computer Science 2025-10-06 Han Weng , Puzhen Wu , Longjie Cui , Yi Zhan , Boyi Liu , Yuanfeng Song , Dun Zeng , Yingxiang Yang , Qianru Zhang , Dong Huang , Xiaoming Yin , Yang Sun , Xing Chen

Large language models (LLMs) are known for their exceptional performance across a range of natural language processing tasks, but their deployment comes at a high computational and financial cost. On the other hand, smaller language models…

Computation and Language · Computer Science 2024-09-24 Adarsh MS , Jithin VG , Ditto PS

Text-to-SQL aims at generating SQL queries for the given natural language questions and thus helping users to query databases. Prompt learning with large language models (LLMs) has emerged as a recent approach, which designs prompts to lead…

Information Retrieval · Computer Science 2023-09-06 Chunxi Guo , Zhiliang Tian , Jintao Tang , Shasha Li , Zhihua Wen , Kaixuan Wang , Ting Wang

Text-to-SQLs enables non-expert users to effortlessly retrieve desired information from relational databases using natural language queries. While recent advancements, particularly with Large Language Models (LLMs) like GPT and T5, have…

Databases · Computer Science 2024-10-04 Shouvon Sarker , Xishuang Dong , Xiangfang Li , Lijun Qian

Text-to-SQL, the task of translating natural language questions into SQL queries, has significantly advanced with the introduction of Large Language Models (LLMs), broadening database accessibility for a wide range of users. Despite…

Large Language Models (LLMs) have emerged as powerful tools for Text-to-SQL tasks, exhibiting remarkable reasoning capabilities. Different from tasks such as math word problems and commonsense reasoning, SQL solutions have a relatively…

Computation and Language · Computer Science 2024-09-24 Ruilin Luo , Liyuan Wang , Binghuai Lin , Zicheng Lin , Yujiu Yang

Text-to-SQL is a technology that converts natural language queries into the structured query language SQL. A novel research approach that has recently gained attention focuses on methods based on the complexity of SQL queries, achieving…

Computation and Language · Computer Science 2024-06-14 Jiawen Yi , Guo Chen , Zixiang Shen

Large Language Models (LLMs) exhibit impressive problem-solving skills across many tasks, but they still underperform compared to humans in various downstream applications, such as text-to-SQL. On the BIRD benchmark leaderboard, human…

Computation and Language · Computer Science 2024-11-21 Zhibo Chu , Zichong Wang , Qitao Qin