English
Related papers

Related papers: Reinforced Informativeness Optimization for Long-F…

200 papers

Large Reasoning Models (LRMs) exhibit remarkable reasoning abilities but rely primarily on parametric knowledge, limiting factual accuracy. While recent works equip reinforcement learning (RL)-based LRMs with retrieval capabilities, they…

Computation and Language · Computer Science 2025-05-20 Zhicheng Lee , Shulin Cao , Jinxin Liu , Jiajie Zhang , Weichuan Liu , Xiaoyin Che , Lei Hou , Juanzi Li

Retrieval Augmented Generation (RAG) has become prevalent in question-answering (QA) tasks due to its ability of utilizing search engine to enhance the quality of long-form question-answering (LFQA). Despite the emergence of various open…

Computation and Language · Computer Science 2024-07-02 Tianchi Cai , Zhiwen Tan , Xierui Song , Tao Sun , Jiyan Jiang , Yunqi Xu , Yinger Zhang , Jinjie Gu

Retrieval-augmented generation (RAG) is a key means to effectively enhance large language models (LLMs) in many knowledge-based tasks. However, existing RAG methods struggle with knowledge-intensive reasoning tasks, because useful…

Computation and Language · Computer Science 2024-10-28 Zhuoqun Li , Xuanang Chen , Haiyang Yu , Hongyu Lin , Yaojie Lu , Qiaoyu Tang , Fei Huang , Xianpei Han , Le Sun , Yongbin Li

Retrieval-Augmented Generation (RAG) integrates external knowledge with Large Language Models (LLMs) to enhance factual correctness and mitigate hallucination. However, dense retrievers often become the bottleneck of RAG systems due to…

Computation and Language · Computer Science 2025-10-27 Yuan Li , Qi Luo , Xiaonan Li , Bufan Li , Qinyuan Cheng , Bo Wang , Yining Zheng , Yuxin Wang , Zhangyue Yin , Xipeng Qiu

Reinforcement learning has recently shown promise in improving retrieval-augmented generation (RAG). Despite these advances, its effectiveness in multi-hop question answering (QA) remains limited by two fundamental limitations: (i) global…

Computation and Language · Computer Science 2026-03-17 Jinchang Luo , Mingquan Cheng , Fan Wan , Ni Li , Xiaoling Xia , Shuangshuang Tian , Tingcheng Bian , Haiwei Wang , Haohuan Fu , Yan Tao

Reinforcement learning (RL) has become a standard paradigm for refining large language models (LLMs) beyond pre-training and instruction tuning. A prominent line of work is RL with verifiable rewards (RLVR), which leverages automatically…

Machine Learning · Computer Science 2025-09-23 Bonan Zhang , Zhongqi Chen , Bowen Song , Qinya Li , Fan Wu , Guihai Chen

Reinforcement learning (RL) based on the final answer's reward has driven recent progress in small language models (SLMs) on reasoning-heavy tasks such as math and code. However, applying the same techniques to retrieval-augmented…

Computation and Language · Computer Science 2026-03-03 Abhinav Java , Srivathsan Koundinyan , Nagarajan Natarajan , Amit Sharma

Reinforcement Learning with Verifiable Rewards (RLVR) has significantly advanced the reasoning capabilities of Large Language Models (LLMs) by optimizing them against factual outcomes. However, this paradigm falters in long-context…

Computation and Language · Computer Science 2026-03-03 Guanzheng Chen , Michael Qizhe Shieh , Lidong Bing

In financial Retrieval-Augmented Generation (RAG) systems, models frequently rely on retrieved documents to generate accurate responses due to the time-sensitive nature of the financial domain. While retrieved documents help address…

Artificial Intelligence · Computer Science 2026-02-06 Taoye Yin , Haoyuan Hu , Yaxin Fan , Xinhao Chen , Xinya Wu , Kai Deng , Kezun Zhang , Feng Wang

Inspired by the success of reinforcement learning (RL) in Large Language Model (LLM) training for domains like math and code, recent works have begun exploring how to train LLMs to use search engines more effectively as tools for…

Computation and Language · Computer Science 2026-02-05 Zhichao Xu , Zongyu Wu , Yun Zhou , Aosong Feng , Kang Zhou , Sangmin Woo , Kiran Ramnath , Yijun Tian , Xuan Qi , Weikang Qiu , Lin Lee Cheong , Haibo Ding

Reinforcement learning-based retrieval-augmented generation (RAG) methods enhance the reasoning abilities of large language models (LLMs). However, most rely only on final-answer rewards, overlooking intermediate reasoning quality. This…

Computation and Language · Computer Science 2025-08-07 Jie He , Victor Gutiérrez-Basulto , Jeff Z. Pan

Reinforcement Learning (RL) has enabled Large Language Models (LLMs) to achieve remarkable reasoning in domains like mathematics and coding, where verifiable rewards provide clear signals. However, extending this paradigm to financial…

Artificial Intelligence · Computer Science 2026-01-09 Rui Sun , Yifan Sun , Sheng Xu , Li Zhao , Jing Li , Daxin Jiang , Cheng Hua , Zuo Bai

Long-Context Question Answering (LCQA), a challenging task, aims to reason over long-context documents to yield accurate answers to questions. Existing long-context Large Language Models (LLMs) for LCQA often struggle with the "lost in the…

Computation and Language · Computer Science 2024-11-04 Qingfei Zhao , Ruobing Wang , Yukuo Cen , Daren Zha , Shicheng Tan , Yuxiao Dong , Jie Tang

While reinforcement learning has unlocked unprecedented complex reasoning in large language models, it has also amplified their propensity for hallucination, creating a critical trade-off between capability and reliability. This work…

Computation and Language · Computer Science 2025-12-11 Yudong Wang , Zhe Yang , Wenhan Ma , Zhifang Sui , Liang Zhao

While Retrieval-Augmented Generation (RAG) mitigates hallucination and knowledge staleness in Large Language Models (LLMs), existing frameworks often falter on complex, multi-hop queries that require synthesizing information from disparate…

Computation and Language · Computer Science 2025-10-28 Mohammad Aghajani Asl , Majid Asgari-Bidhendi , Behrooz Minaei-Bidgoli

Retrieval-Augmented Generation (RAG) significantly improves the factuality of Large Language Models (LLMs), yet standard pipelines often lack mechanisms to verify inter- mediate reasoning, leaving them vulnerable to hallucinations in…

Computation and Language · Computer Science 2026-03-12 Eeham Khan , Luis Rodriguez , Marc Queudot

Retrieval-augmented generation (RAG) enhances the text generation capabilities of large language models (LLMs) by integrating external knowledge and up-to-date information. However, traditional RAG systems are limited by static workflows…

Financial documents--such as 10-Ks, 10-Qs, and investor presentations--span hundreds of pages and combine diverse modalities, including dense narrative text, structured tables, and complex figures. Answering questions over such content…

Computation and Language · Computer Science 2026-04-13 Chinmay Gondhalekar , Urjitkumar Patel , Fang-Chun Yeh

Retrieval-Augmented Generation (RAG) is an effective approach to enhance the factual accuracy of large language models (LLMs) by retrieving information from external databases, which are typically composed of diverse sources, to supplement…

Machine Learning · Computer Science 2025-10-15 Jeongyeon Hwang , Junyoung Park , Hyejin Park , Dongwoo Kim , Sangdon Park , Jungseul Ok

Reinforcement learning (RL) has emerged as a critical technique for enhancing LLM-based deep search agents. However, existing approaches primarily rely on binary outcome rewards, which fail to capture the comprehensiveness and factuality of…

Computation and Language · Computer Science 2026-01-12 Jiajie Zhang , Xin Lv , Ling Feng , Lei Hou , Juanzi Li
‹ Prev 1 2 3 10 Next ›