English
Related papers

Related papers: Adaptive Tool Generation with Models as Tools and …

200 papers

Although recent tool-augmented benchmarks involve complex requests, evaluation remains limited to answer matching, neglecting critical trajectory aspects like efficiency, hallucination, and adaptivity. The most straightforward method for…

Artificial Intelligence · Computer Science 2026-05-26 Wonjoong Kim , Sangwu Park , Yeonjun In , Sein Kim , Dongha Lee , Chanyoung Park

Agentic retrieval-augmented generation (RAG) formulates question answering as a multi-step interaction between reasoning and information retrieval, and has recently been advanced by reinforcement learning (RL) with outcome-based…

Computation and Language · Computer Science 2026-01-13 Tianhua Zhang , Kun Li , Junan Li , Yunxiang Li , Hongyin Luo , Xixin Wu , James Glass , Helen Meng

Tool use represents a critical capability for AI agents, with recent advances focusing on leveraging reinforcement learning (RL) to scale up the explicit reasoning process to achieve better performance. However, there are some key…

Artificial Intelligence · Computer Science 2026-03-17 Yirong Zeng , Xiao Ding , Yufei Liu , Yuxian Wang , Qunyao Du , Yutai Hou , Wu Ning , Haonan Song , Duyu Tang , Dandan Tu , Bing Qin , Ting Liu

Large reasoning models (LRMs) have achieved strong performance enhancement through scaling test time computation, but due to the inherent limitations of the underlying language models, they still have shortcomings in tasks that require…

Computation and Language · Computer Science 2026-04-20 Ruotao Xu , Yixin Ji , Yu Luo , Jinpeng Li , Dong Li , Peifeng Li , Juntao Li , Min Zhang

Modeling human-like action-to-reaction generation has significant real-world applications, like human-robot interaction and games. Despite recent advancements in single-person motion generation, it is still challenging to well handle…

Human-Computer Interaction · Computer Science 2025-03-24 Wenhui Tan , Boyuan Li , Chuhao Jin , Wenbing Huang , Xiting Wang , Ruihua Song

Reinforcement learning (RL) has emerged as an effective paradigm for enhancing model reasoning. However, existing RL methods like GRPO typically rely on unstructured self-sampling to fit scalar rewards, often producing inefficient rollouts…

Computation and Language · Computer Science 2026-05-18 Jinyang Wu , Chonghua Liao , Mingkuan Feng , Shuai Zhang , Zhengqi Wen , Haoran Luo , Ling Yang , Huazhe Xu , Jianhua Tao

Modern Large Language Models (LLMs) have shown rapid improvements in reasoning capabilities, driven largely by reinforcement learning (RL) with verifiable rewards. Here, we ask whether these LLMs can self-improve without the need for…

Computation and Language · Computer Science 2026-02-04 Yufan Zhuang , Chandan Singh , Liyuan Liu , Yelong Shen , Dinghuai Zhang , Jingbo Shang , Jianfeng Gao , Weizhu Chen

Large language models have achieved strong performance on medical reasoning benchmarks, yet their deployment in clinical settings demands rigorous verification to ensure factual accuracy. While reward models offer a scalable approach for…

Artificial Intelligence · Computer Science 2026-01-29 Hang Zhang , Ruheng Wang , Yuelyu Ji , Mingu Kwak , Xizhi Wu , Chenyu Li , Li Zhang , Wenqi Shi , Yifan Peng , Yanshan Wang

Effective tool use is essential for large language models (LLMs) to interact with their environment. However, progress is limited by the lack of efficient reinforcement learning (RL) frameworks specifically designed for tool use, due to…

Computation and Language · Computer Science 2026-04-16 Junjie Ye , Changhao Jiang , Zhengyin Du , Yufei Xu , Xuesong Yao , Zhiheng Xi , Xiaoran Fan , Qi Zhang , Tao Gui , Xuanjing Huang , Jiecao Chen

Recommendation Systems have become integral to modern user experiences, but lack transparency in their decision-making processes. Existing explainable recommendation methods are hindered by reliance on a post-hoc paradigm, wherein…

Information Retrieval · Computer Science 2024-12-04 Xiaohan Yu , Li Zhang , Chong Chen

Language models (LMs) trained on web-scale datasets are largely successful due to their ability to memorize large amounts of training data, even if only present in a few examples. These capabilities are often desirable in evaluation on…

Machine Learning · Computer Science 2024-11-04 Elvis Hsieh , Preston Fu , Jonathan Chen

Tool learning with foundation models aims to endow AI systems with the ability to invoke external resources -- such as APIs, computational utilities, and specialized models -- to solve complex tasks beyond the reach of standalone language…

Computer Vision and Pattern Recognition · Computer Science 2026-04-17 Gabriele Mattioli , Evelyn Turri , Sara Sarto , Lorenzo Baraldi , Marcella Cornia , Lorenzo Baraldi , Rita Cucchiara

Tool-Integrated Reasoning has emerged as a key paradigm to augment Large Language Models (LLMs) with computational capabilities, yet integrating tool-use into long Chain-of-Thought (long CoT) remains underexplored, largely due to the…

Computation and Language · Computer Science 2026-01-19 Kun Li , Zenan Xu , Junan Li , Zengrui Jin , Jinghao Deng , Zexuan Qiu , Bo Zhou

Large language models (LLMs) have been routinely used to solve various tasks using step-by-step reasoning. However, the structure of intermediate reasoning steps, or thoughts, is rigid and unidirectional, such as chains, trees, or…

Artificial Intelligence · Computer Science 2024-12-30 Sijia Chen , Baochun Li

Large language models (LLMs) are increasingly used as tool-augmented agents for multi-step decision making, yet training robust tool-using agents remains challenging. Existing methods still require manual intervention, depend on…

Recent advancements in large language models (LLMs) have demonstrated that progressive refinement, rather than providing a single answer, results in more accurate and thoughtful outputs. However, existing methods often rely heavily on…

Computation and Language · Computer Science 2024-10-18 Chengyu Du , Jinyi Han , Yizhou Ying , Aili Chen , Qianyu He , Haokun Zhao , Sirui Xia , Haoran Guo , Jiaqing Liang , Zulong Chen , Liangyue Li , Yanghua Xiao

Recently, large language models (LLMs) have shown remarkable reasoning capabilities via large-scale reinforcement learning (RL). However, leveraging the RL algorithm to empower effective multi-tool collaborative reasoning in LLMs remains an…

Computation and Language · Computer Science 2025-05-23 Guanting Dong , Yifei Chen , Xiaoxi Li , Jiajie Jin , Hongjin Qian , Yutao Zhu , Hangyu Mao , Guorui Zhou , Zhicheng Dou , Ji-Rong Wen

Empowering large language models (LLMs) with effective tool utilization capabilities is crucial for enabling AI agents to solve complex problems. However, current models face two major limitations: (1) unreliable tool planning and…

Computation and Language · Computer Science 2025-06-06 Zhiyuan Ma , Jiayu Liu , Xianzhen Luo , Zhenya Huang , Qingfu Zhu , Wanxiang Che

Multi-agent systems have evolved into practical LLM-driven collaborators for many applications, gaining robustness from diversity and cross-checking. However, multi-agent RL (MARL) training is resource-intensive and unstable: co-adapting…

Tool-integrated reasoning (TIR) augments large language models (LLMs) with the ability to invoke external tools during long-form reasoning, such as search engines and code interpreters, to solve tasks beyond the capabilities of internal…

Artificial Intelligence · Computer Science 2025-06-03 Hongru Wang , Cheng Qian , Wanjun Zhong , Xiusi Chen , Jiahao Qiu , Shijue Huang , Bowen Jin , Mengdi Wang , Kam-Fai Wong , Heng Ji