English
Related papers

Related papers: MTIR-SQL: Multi-turn Tool-Integrated Reasoning Rei…

200 papers

Natural Language to SQL (NL2SQL) enables intuitive interactions with databases by transforming natural language queries into structured SQL statements. Despite recent advancements in enhancing human-computer interaction within database…

Databases · Computer Science 2025-10-10 Peixian Ma , Xialie Zhuang , Chengjin Xu , Xuhui Jiang , Ran Chen , Jian Guo

Text-to-SQL models allow users to interact with a database more easily by generating executable SQL statements from natural-language questions. Despite recent successes on simpler databases and questions, current Text-to-SQL methods still…

Artificial Intelligence · Computer Science 2025-09-10 Heng Hao , Wenjun Hu , Oxana Verkholyak , Davoud Ataee Tarzanagh , Baruch Gutow , Sima Didari , Masoud Faraki , Hankyu Moon , Seungjai Min

This paper investigates Reinforcement Learning (RL) approaches to enhance the reasoning capabilities of Large Language Model (LLM) agents in long-horizon, multi-turn scenarios. Although RL algorithms such as Group Relative Policy…

Reinforcement learning (RL) has emerged as an effective paradigm for enhancing model reasoning. However, existing RL methods like GRPO typically rely on unstructured self-sampling to fit scalar rewards, often producing inefficient rollouts…

Computation and Language · Computer Science 2026-05-18 Jinyang Wu , Chonghua Liao , Mingkuan Feng , Shuai Zhang , Zhengqi Wen , Haoran Luo , Ling Yang , Huazhe Xu , Jianhua Tao

In the era of large language models, Text-to-SQL, as a natural language interface for databases, is playing an increasingly important role. The sota Text-to-SQL models have achieved impressive accuracy, but their performance critically…

Databases · Computer Science 2026-02-13 Yafeng Nan , Haifeng Sun , Zirui Zhuang , Qi Qi , Guojun Chu , Jianxin Liao , Dan Pei , Jingyu Wang

Multimodal Large Language Models (MLLMs) have gained significant traction for their ability to process diverse input data types and generate coherent, contextually relevant outputs across various applications. While supervised fine-tuning…

Machine Learning · Computer Science 2025-03-31 Zhiyuan Liu , Yuting Zhang , Feng Liu , Changwang Zhang , Ying Sun , Jun Wang

Current Text-to-SQL methods are evaluated and only focused on executable queries, overlooking the semantic alignment challenge -- both in terms of the semantic meaning of the query and the correctness of the execution results. Even…

Computation and Language · Computer Science 2025-11-24 Ashish Kattamuri , Ishita Prasad , Meetu Malhotra , Arpita Vats , Rahul Raja , Albert Lie

Reinforcement learning (RL) has been widely adopted to enhance the performance of large language models (LLMs) on Text-to-SQL tasks. However, existing methods often rely on execution-based or LLM-based Bradley-Terry reward models. The…

Machine Learning · Computer Science 2025-10-06 Han Weng , Puzhen Wu , Longjie Cui , Yi Zhan , Boyi Liu , Yuanfeng Song , Dun Zeng , Yingxiang Yang , Qianru Zhang , Dong Huang , Xiaoming Yin , Yang Sun , Xing Chen

This study explores text-to-SQL parsing by leveraging the powerful reasoning capabilities of large language models (LLMs). Despite recent advancements, existing LLM-based methods are still inefficient and struggle to handle cases with wide…

Computation and Language · Computer Science 2025-11-14 Guanming Xiong , Junwei Bao , Hongfei Jiang , Yang Song , Wen Zhao

Large language models (LLMs) with in-context learning have significantly improved the performance of text-to-SQL task. Previous works generally focus on using exclusive SQL generation prompt to improve the LLMs' reasoning ability. However,…

Computation and Language · Computer Science 2024-07-15 Zhenhe Wu , Zhongqiu Li , Jie Zhang , Mengxiang Li , Yu Zhao , Ruiyu Fang , Zhongjiang He , Xuelong Li , Zhoujun Li , Shuangyong Song

Large Language Models (LLMs) are widely used as judges to evaluate response quality, providing a scalable alternative to human evaluation. However, most LLM judges operate solely on intrinsic text-based reasoning, limiting their ability to…

Computation and Language · Computer Science 2026-02-24 Ran Xu , Jingjing Chen , Jiayu Ye , Yu Wu , Jun Yan , Carl Yang , Hongkun Yu

Table reasoning, encompassing tasks such as table question answering, fact verification, and text-to-SQL, requires precise understanding of structured tabular data, coupled with numerical computation and code manipulation for effective…

Computation and Language · Computer Science 2025-06-03 Fangyu Lei , Jinxiang Meng , Yiming Huang , Tinghong Chen , Yun Zhang , Shizhu He , Jun Zhao , Kang Liu

Fine-tuning large language models (LLMs) for specific domain tasks has achieved great success in Text-to-SQL tasks. However, these fine-tuned models often face challenges with multi-turn Text-to-SQL tasks caused by ambiguous or unanswerable…

Artificial Intelligence · Computer Science 2024-11-12 Yinggang Sun , Ziming Guo , Haining Yu , Chuanyi Liu , Xiang Li , Bingxuan Wang , Xiangzhan Yu , Tiancheng Zhao

Tool-integrated reasoning (TIR) augments large language models (LLMs) with the ability to invoke external tools during long-form reasoning, such as search engines and code interpreters, to solve tasks beyond the capabilities of internal…

Artificial Intelligence · Computer Science 2025-06-03 Hongru Wang , Cheng Qian , Wanjun Zhong , Xiusi Chen , Jiahao Qiu , Shijue Huang , Bowen Jin , Mengdi Wang , Kam-Fai Wong , Heng Ji

Text-to-SQL demands precise reasoning to convert natural language questions into structured queries. While large language models (LLMs) excel in many reasoning tasks, their ability to leverage Chain-of-Thought (CoT) reasoning for…

Machine Learning · Computer Science 2025-03-27 Bohan Zhai , Canwen Xu , Yuxiong He , Zhewei Yao

Multimodal large language models (MLLMs) have shown promising capabilities in reasoning tasks, yet still struggle with complex problems requiring explicit self-reflection and self-correction, especially compared to their unimodal text-based…

Computation and Language · Computer Science 2025-10-07 Zhongwei Wan , Zhihao Dou , Che Liu , Yu Zhang , Dongfei Cui , Qinjian Zhao , Hui Shen , Jing Xiong , Yi Xin , Yifan Jiang , Chaofan Tao , Yangfan He , Mi Zhang , Shen Yan

We introduce ToRL (Tool-Integrated Reinforcement Learning), a framework for training large language models (LLMs) to autonomously use computational tools via reinforcement learning. Unlike supervised fine-tuning, ToRL allows models to…

Computation and Language · Computer Science 2025-04-01 Xuefeng Li , Haoyang Zou , Pengfei Liu

We study why Tool-Integrated Reasoning (TIR) makes Large Language Models (LLMs) more capable. While LLMs integrated with tools like Python code interpreters show great promise, a principled theory explaining why this paradigm is effective…

Machine Learning · Computer Science 2025-08-27 Heng Lin , Zhongwen Xu

While reasoning models (e.g., DeepSeek R1) trained with reinforcement learning (RL), excel in textual reasoning, they struggle in scenarios requiring structured problem-solving, such as geometric reasoning, concise computation, or complex…

Computation and Language · Computer Science 2025-04-18 Jiazhan Feng , Shijue Huang , Xingwei Qu , Ge Zhang , Yujia Qin , Baoquan Zhong , Chengquan Jiang , Jinxin Chi , Wanjun Zhong

Trajectory planning is a core task in autonomous driving, requiring the prediction of safe and comfortable paths across diverse scenarios. Integrating Multi-modal Large Language Models (MLLMs) with Reinforcement Learning (RL) has shown…

Robotics · Computer Science 2026-02-02 Xidong Li , Mingyu Guo , Chenchao Xu , Bailin Li , Wenjing Zhu , Yangang Zou , Rui Chen , Zehuan Wang