English
Related papers

Related papers: When should I search more: Adaptive Complex Query …

200 papers

Retrieval-Augmented Generation (RAG) improves Large Language Model (LLM) performance on knowledge-intensive tasks but depends heavily on initial search query quality. Current methods, often using Reinforcement Learning (RL), typically focus…

Computation and Language · Computer Science 2025-04-16 Alan Dao , Thinh Le

In data exploration, executing complex non-aggregate queries over large databases can be time-consuming. Our paper introduces a novel approach to address this challenge, focusing on finding an optimized subset of data, referred to as the…

Databases · Computer Science 2024-01-31 Susan B. Davidson , Tova Milo , Kathy Razmadze , Gal Zeevi

Retrieval-Augmented Generation (RAG) systems have recently shown remarkable advancements by integrating retrieval mechanisms into language models, enhancing their ability to produce more accurate and contextually relevant responses.…

Computation and Language · Computer Science 2025-01-14 Siran Li , Linus Stenzel , Carsten Eickhoff , Seyed Ali Bahrainian

Agentic Retrieval-Augmented Generation (RAG) systems enhance Large Language Models (LLMs) by enabling dynamic, multi-step reasoning and information retrieval. However, these systems often exhibit sub-optimal search behaviors like…

Computation and Language · Computer Science 2025-10-10 Peilin Wu , Mian Zhang , Xinlu Zhang , Xinya Du , Zhiyu Zoey Chen

In this paper, a unified framework for exploration in reinforcement learning (RL) is proposed based on an option-critic model. The proposed framework learns to integrate a set of diverse exploration strategies so that the agent can…

Machine Learning · Computer Science 2024-09-10 Woojun Kim , Jeonghye Kim , Youngchul Sung

This study presents a novel computer system performance optimization and adaptive workload management scheduling algorithm based on Q-learning. In modern computing environments, characterized by increasing data volumes, task complexity, and…

Machine Learning · Computer Science 2024-11-11 Pochun Li , Yuyang Xiao , Jinghua Yan , Xuan Li , Xiaoye Wang

Retrieval-augmented generation (RAG) integrates large language models ( LLM s) with retrievers to access external knowledge, improving the factuality of LLM generation in knowledge-grounded tasks. To optimize the RAG performance, most…

Information Retrieval · Computer Science 2025-05-07 Zhengliang Shi , Lingyong Yan , Weiwei Sun , Yue Feng , Pengjie Ren , Xinyu Ma , Shuaiqiang Wang , Dawei Yin , Maarten de Rijke , Zhaochun Ren

Large Language Models (LLMs), despite their remarkable capabilities, are prone to generating hallucinated or outdated content due to their static internal knowledge. While Retrieval-Augmented Generation (RAG) integrated with Reinforcement…

Computation and Language · Computer Science 2026-01-14 Zhiwen Tan , Jiaming Huang , Qintong Wu , Hongxuan Zhang , Chenyi Zhuang , Jinjie Gu

Retrieval Augmented Generation (RAG) has proven to be highly effective in boosting the generative performance of language model in knowledge-intensive tasks. However, existing RAG framework either indiscriminately perform retrieval or rely…

Artificial Intelligence · Computer Science 2025-01-03 Xiaqiang Tang , Qiang Gao , Jian Li , Nan Du , Qi Li , Sihong Xie

Many traditional algorithms for solving combinatorial optimization problems involve using hand-crafted heuristics that sequentially construct a solution. Such heuristics are designed by domain experts and may often be suboptimal due to the…

Machine Learning · Computer Science 2020-12-25 Nina Mazyavkina , Sergey Sviridov , Sergei Ivanov , Evgeny Burnaev

Agentic reinforcement learning (RL) trains large language models to autonomously call tools during reasoning, with search as the most common application. These models excel at multi-step reasoning tasks, but their safety properties are not…

Computation and Language · Computer Science 2025-10-21 Yushi Yang , Shreyansh Padarha , Andrew Lee , Adam Mahdi

Retrieval-Augmented Generation (RAG) enhances large language models (LLMs) by integrating up-to-date external knowledge, yet real-world web environments present unique challenges. These limitations manifest as two key challenges: pervasive…

Information Retrieval · Computer Science 2026-03-24 Yuqin Dai , Shuo Yang , Guoqing Wang , Yong Deng , Zhanwei Zhang , Jun Yin , Pengyu Zeng , Zhenzhe Ying , Changhua Meng , Can Yi , Yuchen Zhou , Weiqiang Wang , Shuai Lu

Large language models (LLMs) excel at natural language tasks but are limited by their static parametric knowledge, especially in knowledge-intensive task. Retrieval-augmented generation (RAG) mitigates this by integrating external…

Artificial Intelligence · Computer Science 2025-10-10 Yi Jiang , Lei Shen , Lujie Niu , Sendong Zhao , Wenbo Su , Bo Zheng

While Retrieval-Augmented Generation (RAG) has exhibited promise in utilizing external knowledge, its generation process heavily depends on the quality and accuracy of the retrieved context. Large language models (LLMs) struggle to evaluate…

Computation and Language · Computer Science 2025-10-13 Shi-Qi Yan , Quan Liu , Zhen-Hua Ling

Reinforcement learning (RL) is emerging as a powerful paradigm for enabling large language models (LLMs) to perform complex reasoning tasks. Recent advances indicate that integrating RL with retrieval-augmented generation (RAG) allows LLMs…

Computation and Language · Computer Science 2025-08-13 Wentao Jiang , Xiang Feng , Zengmao Wang , Yong Luo , Pingbo Xu , Zhe Chen , Bo Du , Jing Zhang

Retrieval-Augmented Generation (RAG) has emerged as a powerful approach to mitigate large language model (LLM) hallucinations by incorporating external knowledge retrieval. However, existing RAG frameworks often apply retrieval…

Information Retrieval · Computer Science 2025-07-29 Jinyan Su , Jennifer Healey , Preslav Nakov , Claire Cardie

Optimizing queries for Retrieval-Augmented Generation (RAG) systems poses a significant challenge, particularly across diverse modal indices. We introduce RL-QR, a novel annotation-free reinforcement learning framework for query rewriting…

Computer Vision and Pattern Recognition · Computer Science 2025-12-15 Sungguk Cha , DongWook Kim , Taeseung Hahn , Mintae Kim , Youngsub Han , Byoung-Ki Jeon

Retrieval-augmented generation (RAG) is widely utilized to incorporate external knowledge into large language models, thereby enhancing factuality and reducing hallucinations in question-answering (QA) tasks. A standard RAG pipeline…

Computation and Language · Computer Science 2025-10-08 Yiqun Chen , Lingyong Yan , Weiwei Sun , Xinyu Ma , Yi Zhang , Shuaiqiang Wang , Dawei Yin , Yiming Yang , Jiaxin Mao

Efficiently acquiring external knowledge and up-to-date information is essential for effective reasoning and text generation in large language models (LLMs). Prompting advanced LLMs with reasoning capabilities to use search engines during…

Computation and Language · Computer Science 2025-08-07 Bowen Jin , Hansi Zeng , Zhenrui Yue , Jinsung Yoon , Sercan Arik , Dong Wang , Hamed Zamani , Jiawei Han

Deep reinforcement learning (RL) models, despite their efficiency in learning an optimal policy in static environments, easily loses previously learned knowledge (i.e., catastrophic forgetting). It leads RL models to poor performance in…

Machine Learning · Computer Science 2025-09-08 Wonseo Jang , Dongjae Kim