English
Related papers

Related papers: Toolken+: Improving LLM Tool Usage with Reranking …

200 papers

Training Large Language Models (LLMs) with Group Relative Policy Optimization (GRPO) encounters a significant challenge: models often fail to produce accurate responses, particularly in small-scale architectures. This limitation not only…

Computation and Language · Computer Science 2025-10-10 Fu Chen , Peng Wang , Xiyin Li , Wen Li , Shichi Lei , Dongdong Xiang

When to solve math problems, most language models take a sampling strategy to predict next word according conditional probabilities. In the math reasoning step, it may generate wrong answer. Considering math problems are deterministic, we…

Computation and Language · Computer Science 2023-07-19 Gang Chen

Large Language Model (LLM) agents increasingly use external tools for complex tasks and rely on embedding-based retrieval to select a small top-k subset for reasoning. As these systems scale, the robustness of this retrieval stage is…

Computation and Language · Computer Science 2026-03-17 Hussein Jawad , Nicolas J-B Brunel

We present REARANK, a large language model (LLM)-based listwise reasoning reranking agent. REARANK explicitly reasons before reranking, significantly improving both performance and interpretability. Leveraging reinforcement learning and…

Information Retrieval · Computer Science 2025-05-27 Le Zhang , Bo Wang , Xipeng Qiu , Siva Reddy , Aishwarya Agrawal

Recently, tool learning with large language models (LLMs) has emerged as a promising paradigm for augmenting the capabilities of LLMs to tackle highly complex problems. Despite growing attention and rapid advancements in this field, the…

Computation and Language · Computer Science 2024-11-05 Changle Qu , Sunhao Dai , Xiaochi Wei , Hengyi Cai , Shuaiqiang Wang , Dawei Yin , Jun Xu , Ji-Rong Wen

The development of state-of-the-art large language models is commonly understood as a two-stage process involving pre-training and post-training. We point out the need for an additional intermediate stage called reinforcement mid-training…

Computation and Language · Computer Science 2025-09-30 Yijun Tian , Shaoyu Chen , Zhichao Xu , Yawei Wang , Jinhe Bi , Peng Han , Wei Wang

Tool-augmented large language models (LLMs) are increasingly employed in real-world applications, but tool usage errors still hinder their reliability. We introduce ToolCritic, a diagnostic framework that evaluates and improves LLM behavior…

Artificial Intelligence · Computer Science 2025-10-21 Hassan Hamad , Yingru Xu , Liang Zhao , Wenbo Yan , Narendra Gyanchandani

Large Language Models (LLMs) have demonstrated remarkable capabilities and have been extensively deployed across various domains, including recommender systems. Prior research has employed specialized \textit{prompts} to leverage the…

Information Retrieval · Computer Science 2024-04-02 Sichun Luo , Bowei He , Haohan Zhao , Wei Shao , Yanlin Qi , Yinya Huang , Aojun Zhou , Yuxuan Yao , Zongpeng Li , Yuanzhang Xiao , Mingjie Zhan , Linqi Song

With the rise of LLMs, there is an increasing need for intelligent recommendation assistants that can handle complex queries and provide personalized, reasoning-driven recommendations. LLM-based recommenders show potential but face…

Information Retrieval · Computer Science 2026-04-10 Jiani Huang , Shijie Wang , Liangbo Ning , Wenqi Fan , Qing Li

The widespread adoption of Large Language Models (LLMs) as re-rankers is shifting recommender systems towards a user-centric paradigm. However, a significant gap remains: current re-rankers often lack mechanisms for fine-grained user…

Information Retrieval · Computer Science 2025-11-25 Wenxi Dai , Wujiang Xu , Pinhuan Wang , Dimitris N. Metaxas

Large Language Models (LLM) have been widely used in reranking. Computational overhead and large context lengths remain a challenging issue for LLM rerankers. Efficient reranking usually involves selecting a subset of the ranked list from…

Information Retrieval · Computer Science 2026-05-29 Nilanjan Sinhababu , Soumedhik Bharati , Debasis Ganguly , Pabitra Mitra

Large language models (LLMs) have demonstrated strong capabilities in language understanding and reasoning, yet they remain limited when tackling real-world tasks that require up-to-date knowledge, precise operations, or specialized tool…

Machine Learning · Computer Science 2025-09-17 Yabo Zhang , Yihan Zeng , Qingyun Li , Zhen Hu , Kavin Han , Wangmeng Zuo

Issue localization, the process of identifying code locations that need modification to resolve software issues, is a critical yet challenging task in software development. The semantic gap between natural language issue descriptions and…

Software Engineering · Computer Science 2025-08-07 Zexiong Ma , Chao Peng , Qunhong Zeng , Pengfei Gao , Yanzhen Zou , Bing Xie

Learning-to-Rank (LTR) is a supervised machine learning approach that constructs models specifically designed to order a set of items or documents based on their relevance or importance to a given query or context. Despite significant…

Information Retrieval · Computer Science 2026-04-17 Camilo Gomez , Pengyang Wang , Yanjie Fu

Tool learning is increasingly important for large language models (LLMs) to effectively coordinate and utilize a diverse set of tools in order to solve complex real-world tasks. By selecting and integrating appropriate tools, LLMs extend…

Machine Learning · Computer Science 2026-01-21 Zheng Fang , Wolfgang Mayer , Zeyu Zhang , Jian Wang , Hong-Yu Zhang , Wanli Li , Zaiwen Feng

Large language models (LLMs) transcend passive generation and act as goal-directed agents by invoking external tools. Reinforcement learning (RL) offers a principled framework for optimizing these emergent tool-use policies, yet the…

Computation and Language · Computer Science 2026-02-05 Zihan Lin , Xiaohan Wang , Jie Cao , Jiajun Chai , Guojun Yin , Wei Lin , Ran He

Large language models (LLMs) have displayed massive improvements in reasoning and decision-making skills and can hold natural conversations with users. Many recent works seek to augment LLM-based assistants with external tools so they can…

Computation and Language · Computer Science 2023-11-21 Nicholas Farn , Richard Shin

Reinforcement learning (RL) has become a cornerstone for enhancing the reasoning capabilities of large language models (LLMs), with recent innovations such as Group Relative Policy Optimization (GRPO) demonstrating exceptional…

Computation and Language · Computer Science 2025-05-20 Zhihe Yang , Xufang Luo , Zilong Wang , Dongqi Han , Zhiyuan He , Dongsheng Li , Yunjian Xu

Reinforcement learning (RL) has been widely used in training large language models (LLMs) for preventing unexpected outputs, eg reducing harmfulness and errors. However, existing RL methods mostly adopt the instance-level reward, which is…

Computation and Language · Computer Science 2024-06-18 Zhipeng Chen , Kun Zhou , Wayne Xin Zhao , Junchen Wan , Fuzheng Zhang , Di Zhang , Ji-Rong Wen

Large language models (LLMs) are increasingly employed for complex multi-step planning tasks, where the tool retrieval (TR) step is crucial for achieving successful outcomes. Two prevalent approaches for TR are single-step retrieval, which…

Information Retrieval · Computer Science 2023-12-19 Raviteja Anantha , Bortik Bandyopadhyay , Anirudh Kashi , Sayantan Mahinder , Andrew W Hill , Srinivas Chappidi