English
Related papers

Related papers: Optimizing Agentic Reasoning with Retrieval via Sy…

200 papers

Retrieval-augmented generation (RAG) improves factual grounding, yet most systems rely on flat chunk retrieval and provide limited control over multi-step synthesis. We propose an Explainable Innovation Engine that upgrades the knowledge…

Artificial Intelligence · Computer Science 2026-03-11 Renwei Meng

Work-in-Progress (WiP) prediction is critical for predictive process monitoring, enabling accurate anticipation of workload fluctuations and optimized operational planning. This paper proposes a retrieval-augmented, multi-agent framework…

Multiagent Systems · Computer Science 2025-12-24 Yousef Mehrdad Bibalan , Behrouz Far , Mohammad Moshirpour , Bahareh Ghiyasian

Large Language Models (LLMs) trained with reinforcement learning and verifiable rewards have achieved strong results on complex reasoning tasks. Recent work extends this paradigm to a multi-agent setting, where a meta-thinking agent…

Artificial Intelligence · Computer Science 2025-11-05 Zhiwei Zhang , Xiaomin Li , Yudi Lin , Hui Liu , Ramraj Chandradevan , Linlin Wu , Minhua Lin , Fali Wang , Xianfeng Tang , Qi He , Suhang Wang

Humans integrate multiple sensory modalities (e.g. visual and audio) to build a causal understanding of the physical world. In this work, we propose a novel type of intrinsic motivation for Reinforcement Learning (RL) that encourages the…

Computer Vision and Pattern Recognition · Computer Science 2020-07-28 Chuang Gan , Xiaoyu Chen , Phillip Isola , Antonio Torralba , Joshua B. Tenenbaum

Large language models (LLMs) have recently demonstrated remarkable progress in reasoning capabilities through reinforcement learning with verifiable rewards (RLVR). By leveraging simple rule-based rewards, RL effectively incentivizes LLMs…

Artificial Intelligence · Computer Science 2025-07-25 Shiye Lei , Zhihao Cheng , Kai Jia , Dacheng Tao

Agentic reinforcement learning has advanced large language models (LLMs) to reason through long chain-of-thought trajectories while interleaving external tool use. Existing approaches assume a fixed inventory of tools, limiting LLM agents'…

Computation and Language · Computer Science 2025-12-16 Jiaru Zou , Ling Yang , Yunzhe Qi , Sirui Chen , Mengting Ai , Ke Shen , Jingrui He , Mengdi Wang

LLM-based search agents are increasingly trained on entity-centric synthetic data to solve complex, knowledge-intensive tasks. However, prevailing training methods like Group Relative Policy Optimization (GRPO) discard this rich entity…

Computation and Language · Computer Science 2026-02-25 Yida Zhao , Kuan Li , Xixi Wu , Liwen Zhang , Dingchu Zhang , Baixuan Li , Maojia Song , Zhuo Chen , Chenxi Wang , Xinyu Wang , Kewei Tu , Pengjun Xie , Jingren Zhou , Yong Jiang

Pretrained large Language Models (LLMs) are able to answer questions that are unlikely to have been encountered during training. However a diversity of potential applications exist in the broad domain of reasoning systems and considerations…

Computation and Language · Computer Science 2024-11-27 Tim Hartill

Retrieval-Augmented Generation (RAG) effectively improves the accuracy of Large Language Models (LLMs). However, retrieval noises significantly undermine the quality of LLMs' generation, necessitating the development of denoising…

Computation and Language · Computer Science 2026-04-21 Xinping Zhao , Shouzheng Huang , Yan Zhong , Xinshuo Hu , Meishan Zhang , Baotian Hu , Min Zhang

Large Reasoning Models (LRMs) achieve strong performance on complex tasks by leveraging long Chain-of-Thought (CoT), but often suffer from overthinking, leading to excessive reasoning steps and high inference latency. Existing CoT…

Computation and Language · Computer Science 2026-04-13 Yi Sui , Chaozhuo Li , Dawei Song

Retrieval-Augmented Generation (RAG) integrates external knowledge with Large Language Models (LLMs) to enhance factual correctness and mitigate hallucination. However, dense retrievers often become the bottleneck of RAG systems due to…

Computation and Language · Computer Science 2025-10-27 Yuan Li , Qi Luo , Xiaonan Li , Bufan Li , Qinyuan Cheng , Bo Wang , Yining Zheng , Yuxin Wang , Zhangyue Yin , Xipeng Qiu

Recent advances in reinforcement learning have proved that given an environment we can learn to perform a task in that environment if we have access to some form of a reward function (dense, sparse or derived from IRL). But most of the…

Machine Learning · Computer Science 2019-05-28 Aadil Hayat , Utsav Singh , Vinay P. Namboodiri

Expansion-enhanced sparse lexical representation improves information retrieval (IR) by minimizing vocabulary mismatch problems during lexical matching. In this paper, we explore the potential of jointly learning dense semantic…

Machine Learning · Computer Science 2024-05-24 Biplob Biswas , Rajiv Ramnath

The rapid development of large language model (LLM)-based agents has unlocked new possibilities for autonomous multi-turn reasoning and tool-augmented decision-making. However, their real-world deployment is hindered by severe…

Rule-based reasoning is acknowledged as one of the fundamental problems of reasoning. While recent studies show that large reasoning models (LRMs) have remarkable reasoning capabilities enhanced by reinforcement learning (RL), real…

Computation and Language · Computer Science 2026-02-17 Yang Liu , Jiaqi Li , Zilong Zheng

Large reasoning models (LRMs) have recently achieved significant progress in complex reasoning tasks, aided by reinforcement learning with verifiable rewards. However, LRMs often suffer from overthinking, expending excessive computation on…

Artificial Intelligence · Computer Science 2025-08-19 Chuhuai Yue , Chengqi Dong , Yinan Gao , Hang He , Jiajun Chai , Guojun Yin , Wei Lin

Large language models (LLMs) sometimes demonstrate poor performance on knowledge-intensive tasks, commonsense reasoning is one of them. Researchers typically address these issues by retrieving related knowledge from knowledge graphs or…

Computation and Language · Computer Science 2024-10-15 Jiachun Li , Pengfei Cao , Chenhao Wang , Zhuoran Jin , Yubo Chen , Kang Liu , Xiaojian Jiang , Jiexin Xu , Jun Zhao

Retrieval-augmented generation (RAG) extends large language models (LLMs) with external knowledge, but it must balance limited effective context, redundant retrieved evidence, and the loss of fine-grained facts under aggressive compression.…

Computation and Language · Computer Science 2026-04-24 Yiqiao Jin , Rachneet Kaur , Zhen Zeng , Sumitra Ganesh , Srijan Kumar

Retrieval-augmented generation (RAG) is a common strategy to reduce hallucinations in Large Language Models (LLMs). While reinforcement learning (RL) can enable LLMs to act as search agents by activating retrieval capabilities, existing…

Computation and Language · Computer Science 2025-05-13 Ziyang Huang , Xiaowei Yuan , Yiming Ju , Jun Zhao , Kang Liu

Improving the reasoning capabilities of large language models (LLMs) has attracted considerable interest. Recent approaches primarily focus on improving the reasoning process to yield a more precise final answer. However, in scenarios…

Computation and Language · Computer Science 2024-05-27 Xiaoxia Cheng , Zeqi Tan , Wei Xue , Weiming Lu