English
Related papers

Related papers: Try, Check and Retry: A Divide-and-Conquer Framewo…

200 papers

As large language models (LLMs) advance, their inability to autonomously execute tasks by directly interacting with external tools remains a critical limitation. Traditional methods rely on inputting tool descriptions as context, which is…

Computation and Language · Computer Science 2025-04-01 Renxi Wang , Xudong Han , Lei Ji , Shu Wang , Timothy Baldwin , Haonan Li

Large Language Model (LLM) agents increasingly use external tools for complex tasks and rely on embedding-based retrieval to select a small top-k subset for reasoning. As these systems scale, the robustness of this retrieval stage is…

Computation and Language · Computer Science 2026-03-17 Hussein Jawad , Nicolas J-B Brunel

Recent advancements in function calling and tool use have significantly enhanced the capabilities of large language models (LLMs) by enabling them to interact with external information sources and execute complex tasks. However, the limited…

Machine Learning · Computer Science 2024-09-05 Suhong Moon , Siddharth Jha , Lutfi Eren Erdogan , Sehoon Kim , Woosang Lim , Kurt Keutzer , Amir Gholami

Large language models excel at basic reasoning but struggle with tasks that require interaction with external tools. We present RLFactory, a plug-and-play reinforcement learning post-training framework for multi-round tool use. RLFactory…

Machine Learning · Computer Science 2025-09-10 Jiajun Chai , Guojun Yin , Zekun Xu , Chuhuai Yue , Yi Jia , Siyu Xia , Xiaohan Wang , Jiwen Jiang , Xiaoguang Li , Chengqi Dong , Hang He , Wei Lin

Tool-augmented large language models (LLMs) are attracting widespread attention when accessing up-to-date knowledge and alleviating hallucination issues. Nowadays, advanced closed-source LLMs (e.g., ChatGPT) have demonstrated surprising…

Computation and Language · Computer Science 2024-08-29 Anchun Gui , Jian Li , Yong Dai , Nan Du , Han Xiao

Large Language Model (LLM) agents significantly extend the capabilities of standalone LLMs, empowering them to interact with external tools (e.g., APIs, functions) and complete various tasks in a self-directed fashion. The challenge of tool…

Artificial Intelligence · Computer Science 2024-02-19 Weizhou Shen , Chenliang Li , Hongzhan Chen , Ming Yan , Xiaojun Quan , Hehong Chen , Ji Zhang , Fei Huang

Large language models (LLMs) have shown impressive performance in reasoning benchmarks with the emergence of Chain-of-Thought (CoT), particularly in multi-choice question (MCQ). However, current works equally resolve questions regardless of…

Computation and Language · Computer Science 2024-04-04 Zijie Meng , Yan Zhang , Zhaopeng Feng , Zuozhu Liu

The ubiquity and value of tables as semi-structured data across various domains necessitate advanced methods for understanding their complexity and vast amounts of information. Despite the impressive capabilities of large language models…

Computation and Language · Computer Science 2024-11-14 Deyi Ji , Lanyun Zhu , Siqi Gao , Peng Xu , Hongtao Lu , Jieping Ye , Feng Zhao

Previous research has typically concentrated on leveraging the internal knowledge of Large Language Models (LLMs) to answer known questions (i.e., \textit{internal reasoning such as generate-then-read}). In contrast, for questions that fall…

Computation and Language · Computer Science 2025-01-28 Hongru Wang , Boyang Xue , Baohang Zhou , Tianhua Zhang , Cunxiang Wang , Huimin Wang , Guanhua Chen , Kam-fai Wong

Test-Time Scaling (TTS) is an important method for improving the performance of Large Language Models (LLMs) by using additional computation during the inference phase. However, current studies do not systematically analyze how policy…

Computation and Language · Computer Science 2025-02-11 Runze Liu , Junqi Gao , Jian Zhao , Kaiyan Zhang , Xiu Li , Biqing Qi , Wanli Ouyang , Bowen Zhou

The tool-using capability of large language models (LLMs) enables them to access up-to-date external information and handle complex tasks. Current approaches to enhancing this capability primarily rely on distilling advanced models by data…

Computation and Language · Computer Science 2025-05-13 Xu Huang , Weiwen Liu , Xingshan Zeng , Yuefeng Huang , Xinlong Hao , Yuxian Wang , Yirong Zeng , Chuhan Wu , Yasheng Wang , Ruiming Tang , Defu Lian

Tool-integrated reasoning (TIR) enables large language models (LLMs) to enhance their capabilities by interacting with external tools, such as code interpreters (CI). Most recent studies focus on exploring various methods to equip LLMs with…

Computation and Language · Computer Science 2026-05-12 Luan Zhang , Dandan Song , Zhijing Wu , Zhengyu Chen , Chen Zhang , Yuhang Tian , Huipeng Ma , Chenhao Li , Changzhi Zhou , Xudong Li , Shuhao Zhang

Tool invocation significantly enhances the capabilities of Large Language Models (LLMs), yet challenges persist, particularly in complex task scenarios. Current methods, such as instruction-enhanced reasoning and supervised fine-tuning,…

Artificial Intelligence · Computer Science 2025-08-07 Yifei Lu , Fanghua Ye , Jian Li , Qiang Gao , Cheng Liu , Haibo Luo , Nan Du , Xiaolong Li , Feiliang Ren

Large language models (LLMs) are increasingly powering Text-to-SQL (Text2SQL) systems, enabling non-expert users to query industrial databases using natural language. While test-time scaling strategies have shown promise in LLM-based…

Computation and Language · Computer Science 2025-10-14 Jiajing Guo , Kenil Patel , Jorge Piazentin Ono , Wenbin He , Liu Ren

Recent research has demonstrated that Large Language Models (LLMs) can enhance their capabilities by utilizing external tools. However, three pivotal questions remain unanswered: (1) How effective are current LLMs in utilizing tools? (2)…

Computation and Language · Computer Science 2023-10-26 Minghao Li , Yingxiu Zhao , Bowen Yu , Feifan Song , Hangyu Li , Haiyang Yu , Zhoujun Li , Fei Huang , Yongbin Li

While reasoning models (e.g., DeepSeek R1) trained with reinforcement learning (RL), excel in textual reasoning, they struggle in scenarios requiring structured problem-solving, such as geometric reasoning, concise computation, or complex…

Computation and Language · Computer Science 2025-04-18 Jiazhan Feng , Shijue Huang , Xingwei Qu , Ge Zhang , Yujia Qin , Baoquan Zhong , Chengquan Jiang , Jinxin Chi , Wanjun Zhong

Large language models (LLMs) have significantly advanced natural language processing, particularly through the integration of external tools and APIs. However, their effectiveness is frequently hampered by parameter mis-filling during tool…

Computation and Language · Computer Science 2025-06-03 Yue Cui , Liuyi Yao , Shuchang Tao , Weijie Shi , Yaliang Li , Bolin Ding , Xiaofang Zhou

Augmenting large language models (LLMs) with external tools has emerged as a promising approach to extend their utility, enabling them to solve practical tasks. Previous methods manually parse tool documentation and create in-context…

Computation and Language · Computer Science 2025-03-05 Zhengliang Shi , Shen Gao , Lingyong Yan , Yue Feng , Xiuyi Chen , Zhumin Chen , Dawei Yin , Suzan Verberne , Zhaochun Ren

Large Language Models (LLMs) have demonstrated remarkable progress in reasoning across diverse domains. However, effective reasoning in real-world tasks requires adapting the reasoning strategy to the demands of the problem, ranging from…

Computation and Language · Computer Science 2025-08-19 Xinda Jia , Jinpeng Li , Zezhong Wang , Jingjing Li , Xingshan Zeng , Yasheng Wang , Weinan Zhang , Yong Yu , Weiwen Liu

Large Language Models (LLMs) have made significant strides in Natural Language Processing and coding, yet they struggle with robustness and accuracy in complex function calls. To tackle these challenges, this paper introduces ADC, an…

Software Engineering · Computer Science 2024-12-30 Wei Zhang , Yi Zhang , Li Zhu , Qianghuai Jia , Feijun Jiang , Hongcheng Guo , Zhoujun Li , Mengping Zhou