English
Related papers

Related papers: Tool-Assisted Agent on SQL Inspection and Refineme…

200 papers

In Text-to-SQL generation, large language models (LLMs) have shown strong generalization and adaptability. However, LLMs sometimes generate hallucinations, i.e.,unrealistic or illogical content, which leads to incorrect SQL queries and…

Software Engineering · Computer Science 2025-12-30 Bo Yang , Yinfen Xia , Weisong Sun , Yang Liu

In-context learning (ICL) has emerged as a new approach to various natural language processing tasks, utilizing large language models (LLMs) to make predictions based on context that has been supplemented with a few examples or…

Computation and Language · Computer Science 2023-05-23 Linyong Nan , Yilun Zhao , Weijin Zou , Narutatsu Ri , Jaesung Tae , Ellen Zhang , Arman Cohan , Dragomir Radev

The rise of Large Language Models (LLMs) has significantly advanced Text-to-SQL (NL2SQL) systems, yet evaluating the semantic equivalence of generated SQL remains a challenge, especially given ambiguous user queries and multiple valid SQL…

Computation and Language · Computer Science 2025-06-12 Qingyun Zeng , Simin Ma , Arash Niknafs , Ashish Basran , Carol Szabo

The task of Text-to-SQL enables anyone to retrieve information from SQL databases using natural language. While this task has made substantial progress, the two primary evaluation metrics - Execution Accuracy (EXE) and Exact Set Matching…

Computation and Language · Computer Science 2025-06-18 Benjamin G. Ascoli , Yasoda Sai Ram Kandikonda , Jinho D. Choi

Simulations, although powerful in accurately replicating real-world systems, often remain inaccessible to non-technical users due to their complexity. Conversely, large language models (LLMs) provide intuitive, language-based interactions…

Computation and Language · Computer Science 2025-05-22 Jacob Kleiman , Kevin Frank , Joseph Voyles , Sindy Campagna

The recent advancements introduced by Large Language Models (LLMs) have transformed how Artificial Intelligence (AI) can support complex, real world tasks, pushing research outside the text boundaries towards multi modal contexts and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Federico Toschi , Nicolò Brunello , Andrea Sassella , Vincenzo Scotti , Mark James Carman

Text-to-SQL is a technology that converts natural language queries into the structured query language SQL. A novel research approach that has recently gained attention focuses on methods based on the complexity of SQL queries, achieving…

Computation and Language · Computer Science 2024-06-14 Jiawen Yi , Guo Chen , Zixiang Shen

While integrating tools like Code Interpreter and Search has significantly enhanced Large Language Model (LLM) reasoning in models like ChatGPT Agent and Gemini-Pro, practical guidance on optimal tool use is lacking. The core challenge is…

Computation and Language · Computer Science 2025-10-03 Yongchao Chen , Jiefeng Chen , Rui Meng , Ji Yin , Na Li , Chuchu Fan , Chi Wang , Tomas Pfister , Jinsung Yoon

As large language model (LLM) assistants become increasingly integrated into enterprise workflows, their ability to generate accurate, semantically aligned, and executable outputs is critical. However, current conversational business…

Computation and Language · Computer Science 2026-01-08 Yan Sun , Ming Cai , Stanley Kok

Despite the success of large language models (LLMs) in Text-to-SQL tasks, open-source LLMs encounter challenges in contextual understanding and response coherence. To tackle these issues, we present \ours, a systematic methodology tailored…

Computation and Language · Computer Science 2024-05-14 Xiaojun Chen , Tianle Wang , Tianhao Qiu , Jianbin Qin , Min Yang

Large Language Models (LLMs) have demonstrated strong performance on various tasks. To unleash their power on the Text-to-SQL task, we propose $R^3$ (Review-Rebuttal-Revision), a consensus-based multi-agent system for Text-to-SQL tasks.…

Computation and Language · Computer Science 2024-07-12 Hanchen Xia , Feng Jiang , Naihao Deng , Cunxiang Wang , Guojiang Zhao , Rada Mihalcea , Yue Zhang

Text-To-SQL (T2S) conversion based on large language models (LLMs) has found a wide range of applications, by leveraging the capabilities of LLMs in interpreting the query intent expressed in natural language. Existing research focuses on…

Databases · Computer Science 2024-10-30 Ziyang Zheng , Haipeng Jing , Canyu Rui , Askar Hamdulla , Dong Wang

Modern Large Language Model (LLM) agents promise end to end assistance with real-world software tasks, yet existing benchmarks evaluate LLM agents almost exclusively in pre-baked environments where every dependency is pre-installed. To fill…

Software Engineering · Computer Science 2025-07-15 Avi Arora , Jinu Jang , Roshanak Zilouchian Moghaddam

Recent advancements in large language models (LLMs) have enabled in-context learning (ICL)-based methods that significantly outperform fine-tuning approaches for text-to-SQL tasks. However, their performance is still considerably lower than…

Computation and Language · Computer Science 2024-05-14 Dongjun Lee , Choongwon Park , Jaehyuk Kim , Heesoo Park

High-quality, error-free datasets are a key ingredient in building reliable, accurate, and unbiased machine learning (ML) models. However, real world datasets often suffer from errors due to sensor malfunctions, data entry mistakes, or…

Machine Learning · Computer Science 2025-03-11 Tommaso Bendinelli , Artur Dox , Christian Holz

Equivalence checking of SQL queries is an intractable problem often encountered in settings ranging from grading SQL submissions to debugging query optimizers. Despite recent work toward developing practical solutions, only simple queries…

Databases · Computer Science 2025-06-10 Rajat Singh , Srikanta Bedathur

Data analysts use SQL queries to access and manipulate data on their databases. However, these queries are often challenging to write, and small mistakes can lead to unexpected data output. Recent work has explored several ways to…

We present ReFoRCE, a Text-to-SQL agent that tops the Spider 2.0 leaderboard--a challenging benchmark reflecting complex, real-world Text-to-SQL scenarios. While Text-to-SQL systems enable natural language queries over structured databases,…

Computation and Language · Computer Science 2025-06-05 Minghang Deng , Ashwin Ramachandran , Canwen Xu , Lanxiang Hu , Zhewei Yao , Anupam Datta , Hao Zhang

Natural Language to SQL systems (NL-to-SQL) have recently shown a significant increase in accuracy for natural language to SQL query translation. This improvement is due to the emergence of transformer-based language models, and the…

Efficient querying and analysis of large tabular datasets remain significant challenges, especially for users without expertise in programming languages like SQL. Text-to-SQL approaches have shown promising performance on benchmark data;…

Databases · Computer Science 2025-08-27 Yipeng Zhang , Chen Wang , Yuzhe Zhang , Jacky Jiang