English
Related papers

Related papers: BAPPA: Benchmarking Agents, Plans, and Pipelines f…

200 papers

Text-to-SQL has emerged as a prominent research area, particularly with the rapid advancement of large language models (LLMs). By enabling users to query databases through natural language rather than SQL, this technology significantly…

Artificial Intelligence · Computer Science 2026-05-11 Yu-Jie Yang , Hung-Fu Chang , Po-An Chen

The conversion of natural language into SQL language for querying databases (Text-to-SQL) has broad application prospects and has attracted widespread attention. At present, the mainstream Text-to-SQL methods are mainly divided into…

Computation and Language · Computer Science 2025-02-18 Lei Sheng , Shuai-Shuai Xu , Wei Xie

Large Language Models have recently shown impressive capabilities in reasoning and code generation, making them promising tools for natural language interfaces to relational databases. However, existing approaches often fail to generalize…

Databases · Computer Science 2026-02-03 Wenjia Jiang , Yiwei Wang , Boyan Han , Joey Tianyi Zhou , Chi Zhang

Sequential multi-agent systems built with large language models (LLMs) can automate complex software tasks, but they are hard to trust because errors quietly pass from one stage to the next. We study a traceable and accountable pipeline,…

Artificial Intelligence · Computer Science 2025-10-10 Amine Barrak

Text-to-SQL tasks have gained attractive improvements since the release of ChatGPT. Among them, agent-based frameworks have been widely used in this field. However, the impact of data-centric strategies on text-to-SQL tasks has rarely been…

Computation and Language · Computer Science 2025-10-28 Yuanzhen Xie , Liu Ye , Jiqun Chu , Mochi Gao , Hehuan Liu , Yunzhi Tan , Bo Hu , Zang Li

Large language models (LLMs) have shown remarkable capabilities in code translation, yet their performance deteriorates in low-resource programming domains such as Fortran and emerging frameworks like CUDA, where high-quality parallel data…

Programming Languages · Computer Science 2025-12-04 Le Chen , Nuo Xu , Winson Chen , Bin Lei , Pei-Hung Lin , Dunzhi Zhou , Rajeev Thakur , Caiwen Ding , Ali Jannesari , Chunhua Liao

With the growing popularity of Large Reasoning Models and their results in solving mathematical problems, it becomes crucial to measure their capabilities. We introduce a pipeline for both automatic and interactive verification as a more…

Artificial Intelligence · Computer Science 2026-02-25 Varvara Sazonova , Dmitri Shmelkin , Stanislav Kikot , Vasily Motolygin

Large language models have demonstrated excellent performance in many tasks, including Text-to-SQL, due to their powerful in-context learning capabilities. They are becoming the mainstream approach for Text-to-SQL. However, these methods…

Computation and Language · Computer Science 2025-02-21 Yonghui Kong , Hongbing Hu , Dan Zhang , Siyuan Chai , Fan Zhang , Wei Wang

Relational databases excel at structured data analysis, but real-world queries increasingly require capabilities beyond standard SQL, such as semantically matching entities across inconsistent names, extracting information not explicitly…

Databases · Computer Science 2026-05-15 Yin Lin , Tianjing Zeng , Zhongjun Ding , Rong Zhu , Bolin Ding , H. V. Jagadish , Jingren Zhou

Small language models (SLMs; 1-12B params, sometimes up to 20B) are sufficient and often superior for agentic workloads where the objective is schema- and API-constrained accuracy rather than open-ended generation. We synthesize recent…

Artificial Intelligence · Computer Science 2025-10-07 Raghav Sharma , Manan Mehta

Large language models (LLMs) are increasingly powering Text-to-SQL (Text2SQL) systems, enabling non-expert users to query industrial databases using natural language. While test-time scaling strategies have shown promise in LLM-based…

Computation and Language · Computer Science 2025-10-14 Jiajing Guo , Kenil Patel , Jorge Piazentin Ono , Wenbin He , Liu Ren

In this work, we address question answering (QA) over a hybrid of tabular and textual data that are very common content on the Web (e.g. SEC filings), where discrete reasoning capabilities are often required. Recently, large language models…

Computation and Language · Computer Science 2024-10-01 Fengbin Zhu , Ziyang Liu , Fuli Feng , Chao Wang , Moxin Li , Tat-Seng Chua

Agents equipped with search tools have emerged as effective solutions for knowledge-intensive tasks. While Large Language Models (LLMs) exhibit strong reasoning capabilities, their high computational cost limits practical deployment for…

Artificial Intelligence · Computer Science 2026-04-07 Yizhou Liu , Qi Sun , Yulin Chen , Siyue Zhang , Chen Zhao

Multi-agent systems built from prompted large language models can improve multi-round reasoning, yet most existing pipelines rely on fixed, trajectory-wide communication patterns that are poorly matched to the stage-dependent needs of…

Artificial Intelligence · Computer Science 2026-02-06 Yuxing Lu , Yucheng Hu , Xukai Zhao , Jiuxin Cao

Data preparation (DP) transforms raw data into a form suitable for downstream applications, typically by composing operations into executable pipelines. Building such pipelines is time-consuming and requires sophisticated programming…

Information Retrieval · Computer Science 2025-11-11 Yuhang Ge , Yachuan Liu , Zhangyan Ye , Yuren Mao , Yunjun Gao

Text2SQL, the task of generating SQL queries from natural language text, is a critical challenge in data engineering. Recently, Large Language Models (LLMs) have demonstrated superior performance for this task due to their advanced…

Open-source pre-trained Large Language Models (LLMs) exhibit strong language understanding and generation capabilities, making them highly successful in a variety of tasks. However, when used as agents for dealing with complex problems in…

Computation and Language · Computer Science 2024-04-01 Qinhao Zhou , Zihan Zhang , Xiang Xiang , Ke Wang , Yuchuan Wu , Yongbin Li

Research in Text-to-SQL conversion has been largely benchmarked against datasets where each text query corresponds to one correct SQL. However, natural language queries over real-life databases frequently involve significant ambiguity about…

Computation and Language · Computer Science 2023-10-23 Adithya Bhaskar , Tushar Tomar , Ashutosh Sathe , Sunita Sarawagi

LLMs when used with Retrieval Augmented Generation (RAG), are greatly improving the SOTA of translating natural language queries to structured and correct SQL. Unlike previous reviews, this survey provides a comprehensive study of the…

Computation and Language · Computer Science 2025-02-05 Ali Mohammadjafari , Anthony S. Maida , Raju Gottumukkala

Recently, to comprehensively improve Vision Language Models (VLMs) for Visual Question Answering (VQA), several methods have been proposed to further reinforce the inference capabilities of VLMs to independently tackle VQA tasks rather than…

Computer Vision and Pattern Recognition · Computer Science 2025-02-17 Zeqing Wang , Wentao Wan , Qiqing Lao , Runmeng Chen , Minjie Lang , Xiao Wang , Keze Wang , Liang Lin