English
Related papers

Related papers: SQLCritic: Correcting Text-to-SQL Generation via C…

200 papers

Text-to-SQL enables users to interact with databases through natural language, simplifying the retrieval and synthesis of information. Despite the success of large language models (LLMs) in converting natural language questions into SQL…

Machine Learning · Computer Science 2025-04-23 Oleg Somov , Elena Tutubalina

Large language models (LLMs) have demonstrated remarkable evaluation and critique capabilities, providing insightful feedback and identifying flaws in various tasks. However, limited research has explored which types of critiques are most…

Computation and Language · Computer Science 2025-06-30 Tianshu Yu , Chao Xiang , Mingchuan Yang , Pei Ke , Bosi Wen , Cunxiang Wang , Jiale Cheng , Li Zhang , Xinyu Mu , Chuxiong Sun , Minlie Huang

Recently, there has been significant progress in studying neural networks to translate text descriptions into SQL queries. Despite achieving good performance on some public benchmarks, existing text-to-SQL models typically rely on the…

Computation and Language · Computer Science 2021-06-22 Yujian Gan , Xinyun Chen , Qiuping Huang , Matthew Purver , John R. Woodward , Jinxia Xie , Pengsheng Huang

Text-to-SQL enables users to interact with databases through natural language, simplifying access to structured data. Although highly capable large language models (LLMs) achieve strong accuracy for complex queries, they incur unnecessary…

Databases · Computer Science 2024-11-08 Mohammadhossein Malekpour , Nour Shaheen , Foutse Khomh , Amine Mhedhbi

Text-to-SQL tasks have gained attractive improvements since the release of ChatGPT. Among them, agent-based frameworks have been widely used in this field. However, the impact of data-centric strategies on text-to-SQL tasks has rarely been…

Computation and Language · Computer Science 2025-10-28 Yuanzhen Xie , Liu Ye , Jiqun Chu , Mochi Gao , Hehuan Liu , Yunzhi Tan , Bo Hu , Zang Li

While Text-to-SQL remains the dominant approach for database interaction, real-world analytics increasingly require the flexibility of general-purpose programming languages such as Python or Pandas to manage file-based data and complex…

Artificial Intelligence · Computer Science 2026-01-26 Hangle Hu , Chenyu Hou , Bin Cao , Ruizhe Li

Large Language Models (LLMs) exhibit impressive problem-solving skills across many tasks, but they still underperform compared to humans in various downstream applications, such as text-to-SQL. On the BIRD benchmark leaderboard, human…

Computation and Language · Computer Science 2024-11-21 Zhibo Chu , Zichong Wang , Qitao Qin

Code review is critical for ensuring software quality and maintainability. With the rapid growth in software scale and complexity, code review has become a bottleneck in the development process because of its time-consuming and…

Software Engineering · Computer Science 2026-02-24 Yuxin Zhang , Yuxia Zhang , Zeyu Sun , Yanjie Jiang , Hui Liu

Recent advances in Text-to-SQL have achieved strong results in static, single-turn tasks, where models generate SQL queries from natural language questions. However, these systems fall short in real-world interactive scenarios, where user…

Databases · Computer Science 2025-11-14 Linzhuang Sun , Tianyu Guo , Hao Liang , Yuying Li , Qifeng Cai , Jingxuan Wei , Bihui Yu , Wentao Zhang , Bin Cui

A practical text-to-SQL system should generalize well on a wide variety of natural language questions, unseen database schemas, and novel SQL query structures. To comprehensively evaluate text-to-SQL systems, we introduce a UNIfied…

In-context learning (ICL) has emerged as a new approach to various natural language processing tasks, utilizing large language models (LLMs) to make predictions based on context that has been supplemented with a few examples or…

Computation and Language · Computer Science 2023-05-23 Linyong Nan , Yilun Zhao , Weijin Zou , Narutatsu Ri , Jaesung Tae , Ellen Zhang , Arman Cohan , Dragomir Radev

Question Answering over Tabular Data (Table QA) presents unique challenges due to the diverse structure, size, and data types of real-world tables. The SemEval 2025 Task 8 (DataBench) introduced a benchmark composed of large-scale,…

Computation and Language · Computer Science 2025-09-12 Rishit Tyagi , Mohit Gupta , Rahul Bouri

Safe deployment of large language models (LLMs) may benefit from a reliable method for assessing their generated content to determine when to abstain or to selectively generate. While likelihood-based metrics such as perplexity are widely…

Computation and Language · Computer Science 2023-12-18 Jie Ren , Yao Zhao , Tu Vu , Peter J. Liu , Balaji Lakshminarayanan

Knowledge editing aims to update the embedded knowledge within Large Language Models (LLMs). However, existing approaches, whether through parameter modification or external memory integration, often suffer from inconsistent evaluation…

Computation and Language · Computer Science 2025-05-27 Guoxiu He , Xin Song , Futing Wang , Aixin Sun

Transforming natural language into SQL queries (NL2SQL) is crucial for data-driven business applications. Existing frameworks, trained on open-source datasets, struggle with complex business logic and lack domain-specific data for…

Databases · Computer Science 2025-07-16 Song Cheng , Qiannan Cheng , Linbo Jin , Lei Yi , Guannan Zhang

In addressing the task of converting natural language to SQL queries, there are several semantic and syntactic challenges. It becomes increasingly important to understand and remedy the points of failure as the performance of semantic…

Computation and Language · Computer Science 2023-06-01 Parker Glenn , Parag Pravin Dakle , Preethi Raghavan

Large Language Models (LLMs) show strong potential for automating model generation from natural-language descriptions. A common approach begins with an initial model generation, followed by an iterative critique-refine loop in which the…

Software Engineering · Computer Science 2025-12-01 Parham Khamsepour , Mark Cole , Ish Ashraf , DaYuan Tan , Sandeep Puri , Mehrdad Sabetzadeh , Shiva Nejati

Converting text into the structured query language (Text2SQL) is a research hotspot in the field of natural language processing (NLP), which has broad application prospects. In the era of big data, the use of databases has penetrated all…

Computation and Language · Computer Science 2023-05-19 Ran Shen , Gang Sun , Hao Shen , Yiling Li , Liangfeng Jin , Han Jiang

Recent advances in reinforcement learning (RL) using numerical rewards have significantly enhanced the complex reasoning capabilities of large language models (LLMs). However, we identify three fundamental limitations of purely numerical…

Computation and Language · Computer Science 2026-02-23 Xiaoying Zhang , Yipeng Zhang , Hao Sun , Kaituo Feng , Chaochao Lu , Chao Yang , Helen Meng

In-context learning of large-language models (LLMs) has achieved remarkable success in the field of natural language processing, while extensive case studies reveal that the single-step chain-of-thought prompting approach faces challenges…

Computation and Language · Computer Science 2024-07-04 Yuanzhen Xie , Xinzhou Jin , Tao Xie , MingXiong Lin , Liang Chen , Chenyun Yu , Lei Cheng , ChengXiang Zhuo , Bo Hu , Zang Li