English
Related papers

Related papers: OPERA: A Reinforcement Learning--Enhanced Orchestr…

200 papers

Retrieval-Augmented Generation (RAG) expands the knowledge of Large Language Models (LLMs), yet current static retrieval methods struggle with complex, multi-hop problems. While recent dynamic retrieval strategies offer improvements, they…

Computation and Language · Computer Science 2026-04-23 Haijian Liang , Zenghao Niu , Junjie Wu , Changwang Zhang , Wangchunshu Zhou , Jun Wang

Parallel thinking has emerged as a new paradigm for large reasoning models (LRMs) in tackling complex problems. Recent methods leverage Reinforcement Learning (RL) to enhance parallel thinking, aiming to address the limitations in…

Artificial Intelligence · Computer Science 2026-02-10 Qi Guo , Jianing Wang , Deyang Kong , Xiangyu Xi , Jianfei Zhang , Yi Lu , Jingang Wang , Wei Wang , Shikun Zhang , Wei Ye

Retrieval-Augmented Generation (RAG) has become a standard approach for knowledge-intensive question answering, but existing systems remain brittle on multi-hop questions, where solving the task requires chaining multiple retrieval and…

Multimodal Retrieval-Augmented Generation (MRAG) has shown promise in mitigating hallucinations in Multimodal Large Language Models (MLLMs) by incorporating external knowledge. However, existing methods typically adhere to rigid retrieval…

Computation and Language · Computer Science 2026-04-07 Chunyi Peng , Zhipeng Xu , Zhenghao Liu , Yishan Li , Yukun Yan , Shuo Wang , Yu Gu , Minghe Yu , Ge Yu , Maosong Sun

Complex dialog systems often use retrieved evidence to facilitate factual responses. Such RAG (Retrieval Augmented Generation) systems retrieve from massive heterogeneous data stores that are usually architected as multiple indexes or APIs…

Information Retrieval · Computer Science 2024-08-01 Ashutosh Joshi , Sheikh Muhammad Sarwar , Samarth Varshney , Sreyashi Nag , Shrivats Agrawal , Juhi Naik

Retrieval-augmented generation (RAG) has demonstrated strong performance in single-hop question answering (QA) by integrating external knowledge into large language models (LLMs). However, its effectiveness remains limited in multi-hop QA,…

Computation and Language · Computer Science 2026-01-13 Ningning Zhang , Chi Zhang , Zhizhong Tan , Xingxing Yang , Weiping Deng , Wenyong Wang

Retrieval-Augmented Generation (RAG) has demonstrated significant effectiveness in enhancing large language models (LLMs) for complex multi-hop question answering (QA). For multi-hop QA tasks, current iterative approaches predominantly rely…

Computation and Language · Computer Science 2026-01-19 Yuling Shi , Maolin Sun , Zijun Liu , Mo Yang , Yixiong Fang , Tianran Sun , Xiaodong Gu

Multi-hop question answering (QA) requires models to retrieve and reason over multiple pieces of evidence. While Retrieval-Augmented Generation (RAG) has made progress in this area, existing methods often suffer from two key limitations:…

Computation and Language · Computer Science 2025-04-01 Yuelyu Ji , Rui Meng , Zhuochun Li , Daqing He

Retrieval-Augmented Generation (RAG) systems for Large Language Models (LLMs) hold promise in knowledge-intensive tasks but face limitations in complex multi-step reasoning. While recent methods have integrated RAG with chain-of-thought…

Computation and Language · Computer Science 2025-01-15 Zhongxiang Sun , Qipeng Wang , Weijie Yu , Xiaoxue Zang , Kai Zheng , Jun Xu , Xiao Zhang , Song Yang , Han Li

Retrieval-Augmented Generation (RAG) shows promise for enterprise knowledge work, yet it often underperforms in high-stakes decision settings that require deep synthesis, strict traceability, and recovery from underspecified prompts.…

Information Retrieval · Computer Science 2026-01-27 Xincheng You , Qi Sun , Neha Bora , Huayi Li , Shubham Goel , Kang Li , Sean Culatana

Complex information needs in real-world search scenarios demand deep reasoning and knowledge synthesis across diverse sources, which traditional retrieval-augmented generation (RAG) pipelines struggle to address effectively. Current…

Artificial Intelligence · Computer Science 2025-11-03 Jiajie Jin , Xiaoxi Li , Guanting Dong , Yuyao Zhang , Yutao Zhu , Yang Zhao , Hongjin Qian , Zhicheng Dou

The Group Relative Policy Optimization (GRPO) algorithm has demonstrated considerable success in enhancing the reasoning capabilities of large language models (LLMs), as evidenced by DeepSeek-R1. However, the absence of intermediate…

Machine Learning · Computer Science 2025-06-06 Fei Ding , Baiqiao Wang , Zijian Zeng , Youwei Wang

Test-time scaling has emerged as an effective way to improve language models on challenging reasoning tasks. However, most existing methods treat each problem in isolation and do not systematically reuse knowledge from prior reasoning…

Computation and Language · Computer Science 2026-04-21 Di Wu , Devendra Singh Sachan , Wen-tau Yih , Mingda Chen

While Retrieval-Augmented Generation (RAG) has exhibited promise in utilizing external knowledge, its generation process heavily depends on the quality and accuracy of the retrieved context. Large language models (LLMs) struggle to evaluate…

Computation and Language · Computer Science 2025-10-13 Shi-Qi Yan , Quan Liu , Zhen-Hua Ling

We present MA-RAG, a Multi-Agent framework for Retrieval-Augmented Generation (RAG) that addresses the inherent ambiguities and reasoning challenges in complex information-seeking tasks. Unlike conventional RAG methods that rely on…

Computation and Language · Computer Science 2025-10-14 Thang Nguyen , Peter Chin , Yu-Wing Tai

Multi-hop question answering (QA) requires systems to iteratively retrieve evidence and reason across multiple hops. While recent RAG and agentic methods report strong results, the underlying retrieval--reasoning \emph{process} is often…

Computation and Language · Computer Science 2026-01-05 Yuelyu Ji , Zhuochun Li , Rui Meng , Daqing He

There hardly exists a general solver that is efficient for scheduling problems due to their diversity and complexity. In this study, we develop a two-stage framework, in which reinforcement learning (RL) and traditional operations research…

Artificial Intelligence · Computer Science 2021-03-11 Yongming He , Guohua Wu , Yingwu Chen , Witold Pedrycz

Multi-hop question answering is a challenging task with distinct industrial relevance, and Retrieval-Augmented Generation (RAG) methods based on large language models (LLMs) have become a popular approach to tackle this task. Owing to the…

Computation and Language · Computer Science 2025-01-31 Zhouyu Jiang , Mengshu Sun , Lei Liang , Zhiqiang Zhang

Deep research agents (DRAs) integrate LLM reasoning with external tools. Memory systems enable DRAs to leverage historical experiences, which are essential for efficient reasoning and autonomous evolution. Existing methods rely on…

Artificial Intelligence · Computer Science 2026-04-21 Jingyang Qiao , Weicheng Meng , Yu Cheng , Zhihang Lin , Zhizhong Zhang , Xin Tan , Jingyu Gong , Kun Shao , Yuan Xie

Large language models (LLMs) demonstrate strong reasoning abilities via Chain-of-Thought (CoT), but their token-level generation encourages local decisions and lacks global planning, often leading to redundant or inaccurate reasoning.…