English
Related papers

Related papers: RoboPhD: Self-Improving Text-to-SQL Through Autono…

200 papers

Recent advancements in Text-to-SQL, driven by large language models, are democratizing data access. Despite these advancements, enterprise deployments remain challenging due to the need to capture business-specific knowledge, handle complex…

Artificial Intelligence · Computer Science 2025-03-28 Karime Maamari , Connor Landy , Amine Mhedhbi

Recent advances in large language models have sparked growing interest in AI agents capable of solving complex, real-world tasks. However, most existing agent systems rely on manually crafted configurations that remain static after…

Artificial Intelligence · Computer Science 2025-09-03 Jinyuan Fang , Yanwen Peng , Xi Zhang , Yingxu Wang , Xinhao Yi , Guibin Zhang , Yi Xu , Bin Wu , Siwei Liu , Zihao Li , Zhaochun Ren , Nikos Aletras , Xi Wang , Han Zhou , Zaiqiao Meng

The current state-of-the-art (SOTA) for automated text-to-SQL still falls well short of expert human performance as measured by execution accuracy (EX) on the BIRD-SQL benchmark. The most accurate methods are also slow and expensive. To…

Computation and Language · Computer Science 2024-04-22 Dayton G. Thorpe , Andrew J. Duberstein , Ian A. Kinsey

Sponge attacks increasingly threaten LLM systems by inducing excessive computation and DoS. Existing defenses either rely on statistical filters that fail on semantically meaningful attacks or use static LLM-based detectors that struggle to…

Cryptography and Security · Computer Science 2026-01-28 Nirhoshan Sivaroopan , Kanchana Thilakarathna , Albert Zomaya , Manu , Yi Guo , Jo Plested , Tim Lynar , Jack Yang , Wangli Yang

Improving Large Language Model (LLM) agents for sequential decision-making tasks typically requires extensive task-specific knowledge engineering--custom prompts, curated examples, and specialized observation/action spaces. We investigate a…

Machine Learning · Computer Science 2025-05-20 Vishnu Sarukkai , Zhiqiang Xie , Kayvon Fatahalian

End-to-end task-oriented dialogue (TOD) systems have achieved promising performance by leveraging sophisticated natural language understanding and natural language generation capabilities of pre-trained models. This work enables the TOD…

Computation and Language · Computer Science 2023-08-17 Jianguo Zhang , Stephen Roller , Kun Qian , Zhiwei Liu , Rui Meng , Shelby Heinecke , Huan Wang , Silvio Savarese , Caiming Xiong

State-of-the-art (SOTA) Text-to-SQL methods still lag significantly behind human experts on challenging benchmarks like BIRD. Current approaches that explore test-time scaling lack an orchestrated strategy and neglect the model's internal…

Computation and Language · Computer Science 2025-12-11 Pengfei Wang , Baolin Sun , Xuemei Dong , Yaxun Dai , Hongwei Yuan , Mengdie Chu , Yingqi Gao , Xiang Qi , Peng Zhang , Ying Yan

LLMs have advanced text-to-SQL generation, yet monolithic architectures struggle with complex reasoning and schema diversity. We propose AGENTIQL, an agent-inspired multi-expert framework that combines a reasoning agent for question…

Computation and Language · Computer Science 2025-10-15 Omid Reza Heidari , Siobhan Reid , Yassine Yaakoubi

Designing and optimizing multi-agent systems (MAS) is a complex, labor-intensive process of "Agent Engineering." Existing automatic optimization methods, primarily focused on flat prompt tuning, lack the structural awareness to debug the…

Artificial Intelligence · Computer Science 2026-04-23 Shan He , Runze Wang , Zhuoyun Du , Huiyu Bai , Zouying Cao , Yu Cheng , Bo Zheng

Text-to-SQL demands precise reasoning to convert natural language questions into structured queries. While large language models (LLMs) excel in many reasoning tasks, their ability to leverage Chain-of-Thought (CoT) reasoning for…

Machine Learning · Computer Science 2025-03-27 Bohan Zhai , Canwen Xu , Yuxiong He , Zhewei Yao

Recent progress in autonomous code generation has fueled excitement around AI agents capable of accelerating scientific discovery by running experiments. However, there is currently no benchmark that evaluates whether such agents can…

Artificial Intelligence · Computer Science 2025-06-25 Gyeongwon James Kim , Alex Wilf , Louis-Philippe Morency , Daniel Fried

Autonomous agentic systems are largely static after deployment: they do not learn from user interactions, and recurring failures persist until the next human-driven update ships a fix. Self-evolving agents have emerged in response, but all…

Artificial Intelligence · Computer Science 2026-05-26 Qianshu Cai , Yonggang Zhang , Xianzhang Jia , Huajiang Zheng , Wei Xue , Jun Song , Xinmei Tian , Yike Guo

Recent advances in LLM-based Text-to-SQL have achieved remarkable gains on public benchmarks such as BIRD and Spider. Yet, these systems struggle to scale in realistic enterprise settings with large, complex schemas, diverse SQL dialects,…

Artificial Intelligence · Computer Science 2026-01-23 Asim Biswal , Chuan Lei , Xiao Qin , Aodong Li , Balakrishnan Narayanaswamy , Tim Kraska

Failure is inevitable for embodied navigation in complex environments. To enhance the resilience, replanning (RP) is a viable option, where the robot is allowed to fail, but is capable of adjusting plan until success. However, existing RP…

Robotics · Computer Science 2026-03-04 Guoliang Li , Ruihua Han , Chengyang Li , He Li , Shuai Wang , Wenchao Ding , Hong Zhang , Chengzhong Xu

Large Language Models (LLMs) have recently become sophisticated enough to automate many tasks ranging from pattern finding to writing assistance to code generation. In this paper, we examine text-to-SQL generation. We have observed from…

Databases · Computer Science 2025-09-04 Vladislav Shkapenyuk , Divesh Srivastava , Theodore Johnson , Parisa Ghane

Text-to-SQLs enables non-expert users to effortlessly retrieve desired information from relational databases using natural language queries. While recent advancements, particularly with Large Language Models (LLMs) like GPT and T5, have…

Databases · Computer Science 2024-10-04 Shouvon Sarker , Xishuang Dong , Xiangfang Li , Lijun Qian

Automating the adaptation of software engineering (SE) research artifacts across datasets is essential for scalability and reproducibility, yet it remains largely unstudied. Recent advances in large language model (LLM)-based multi-agent…

Software Engineering · Computer Science 2025-11-27 Jingyi Chen , Xiaoyan Guo , Songqiang Chen , Shing-Chi Cheung , Jiasi Shen

Automated red teaming frameworks for Large Language Models (LLMs) have become increasingly sophisticated, yet many still formulate attack optimization primarily in the prompt space. In other words, these methods mainly search for better…

Computation and Language · Computer Science 2026-05-19 Yunhao Chen , Xin Wang , Juncheng Li , Yixu Wang , Jie Li , Yan Teng , Yingchun Wang , Xingjun Ma

The data-centric paradigm has emerged as a pivotal direction in artificial intelligence (AI), emphasizing the role of high-quality training data. This shift is especially critical in the Text-to-SQL task, where the scarcity, limited…

Computation and Language · Computer Science 2026-02-11 Qifeng Cai , Hao Liang , Chang Xu , Tao Xie , Wentao Zhang , Bin Cui

Recent In-Context Learning based methods have achieved remarkable success in Text-to-SQL task. However, there is still a large gap between the performance of these models and human performance on datasets with complex database schema and…

Computation and Language · Computer Science 2024-11-08 Wenxuan Xie , Gaochen Wu , Bowen Zhou