English
Related papers

Related papers: PentaRAG: Large-Scale Intelligent Knowledge Retrie…

200 papers

Retrieval Augmented Generation (RAG) is emerging as a powerful technique to enhance the capabilities of Generative AI models by reducing hallucination. Thus, the increasing prominence of RAG alongside Large Language Models (LLMs) has…

Computation and Language · Computer Science 2025-11-06 Ranul Dayarathne , Uvini Ranaweera , Upeksha Ganegoda

As Large Language Models (LLMs) increasingly address domain-specific problems, their application in the financial sector has expanded rapidly. Tasks that are both highly valuable and time-consuming, such as analyzing financial statements,…

Computation and Language · Computer Science 2024-11-28 Joohyun Lee , Minji Roh

Retrieval-augmented generation (RAG) can enhance the generation quality of large language models (LLMs) by incorporating external token databases. However, retrievals from large databases can constitute a substantial portion of the overall…

Computation and Language · Computer Science 2024-03-12 Wenqi Jiang , Shuai Zhang , Boran Han , Jie Wang , Bernie Wang , Tim Kraska

Financial documents--such as 10-Ks, 10-Qs, and investor presentations--span hundreds of pages and combine diverse modalities, including dense narrative text, structured tables, and complex figures. Answering questions over such content…

Computation and Language · Computer Science 2026-04-13 Chinmay Gondhalekar , Urjitkumar Patel , Fang-Chun Yeh

Retrieval-augmented generation (RAG) has recently become a very popular task for Large Language Models (LLMs). Evaluating them on multi-turn RAG conversations, where the system is asked to generate a response to a question in the context of…

Retrieval-augmented generation (RAG) methods encounter difficulties when addressing complex questions like multi-hop queries. While iterative retrieval methods improve performance by gathering additional information, current approaches…

Computation and Language · Computer Science 2024-09-27 Ziyuan Zhuang , Zhiyang Zhang , Sitao Cheng , Fangkai Yang , Jia Liu , Shujian Huang , Qingwei Lin , Saravan Rajmohan , Dongmei Zhang , Qi Zhang

Fine-tuning is an immensely resource-intensive process when retraining Large Language Models (LLMs) to incorporate a larger body of knowledge. Although many fine-tuning techniques have been developed to reduce the time and computational…

Computation and Language · Computer Science 2025-08-01 Hruday Markondapatnaikuni , Basem Suleiman , Abdelkarim Erradi , Shijing Chen

Retrieval-augmented generation (RAG) is a promising method for addressing some of the memory-related challenges associated with Large Language Models (LLMs). Two separate systems form the RAG pipeline, the retriever and the reader, and the…

Computation and Language · Computer Science 2024-11-13 Alexandria Leto , Cecilia Aguerrebere , Ishwar Bhati , Ted Willke , Mariano Tepper , Vy Ai Vo

Iterative retrieval refers to the process in which the model continuously queries the retriever during generation to enhance the relevance of the retrieved knowledge, thereby improving the performance of Retrieval-Augmented Generation…

Computation and Language · Computer Science 2024-12-02 Tian Yu , Shaolei Zhang , Yang Feng

Large language models (LLMs) with retrieval augmented-generation (RAG) have been the optimal choice for scalable generative AI solutions in the recent past. Although RAG implemented with AI agents (agentic-RAG) has been recently…

Artificial Intelligence · Computer Science 2024-11-19 Sohini Roychowdhury , Marko Krema , Anvar Mahammad , Brian Moore , Arijit Mukherjee , Punit Prakashchandra

Organizations seeking to utilize Large Language Models (LLMs) for knowledge querying and analysis often encounter challenges in maintaining an LLM fine-tuned on targeted, up-to-date information that keeps answers relevant and grounded.…

Graph-based Retrieval-augmented generation (RAG) has become a widely studied approach for improving the reasoning, accuracy, and factuality of Large Language Models (LLMs). However, many existing graph-based RAG systems overlook the high…

Artificial Intelligence · Computer Science 2025-11-11 Qiao Xiao , Hong Ting Tsang , Jiaxin Bai

We present DynaRAG, a retrieval-augmented generation (RAG) framework designed to handle both static and time-sensitive information needs through dynamic knowledge integration. Unlike traditional RAG pipelines that rely solely on static…

Computation and Language · Computer Science 2026-03-20 Penghao Liang , Mengwei Yuan , Jianan Liu , Jing Yang , Xianyou Li , Weiran Yan , Yichao Wu

Multi-modal Retrieval-Augmented Generation (RAG) has become a critical method for empowering LLMs by leveraging candidate visual documents. However, current methods consider the entire document as the basic retrieval unit, introducing…

Computer Vision and Pattern Recognition · Computer Science 2025-12-23 Yinglu Li , Zhiying Lu , Zhihang Liu , Yiwei Sun , Chuanbin Liu , Hongtao Xie

Large language models (LLMs) have demonstrated remarkable capabilities in a wide range of tasks, yet their application to specialized domains remains challenging due to the need for deep expertise. Retrieval-Augmented generation (RAG) has…

Computation and Language · Computer Science 2025-09-30 Qinggang Zhang , Shengyuan Chen , Yuanchen Bei , Zheng Yuan , Huachi Zhou , Zijin Hong , Hao Chen , Yilin Xiao , Chuang Zhou , Junnan Dong , Yi Chang , Xiao Huang

Retrieval-Augmented Generation (RAG) has shown significant improvements in various natural language processing tasks by integrating the strengths of large language models (LLMs) and external knowledge databases. However, RAG introduces long…

Distributed, Parallel, and Cluster Computing · Computer Science 2024-04-26 Chao Jin , Zili Zhang , Xuanlin Jiang , Fangyue Liu , Xin Liu , Xuanzhe Liu , Xin Jin

Retrieval-augmented generation (RAG) methods can enhance the performance of LLMs by incorporating retrieved knowledge chunks into the generation process. In general, the retrieval and generation steps usually have different requirements for…

Information Retrieval · Computer Science 2025-04-16 Peiru Yang , Xintian Li , Zhiyang Hu , Jiapeng Wang , Jinhua Yin , Huili Wang , Lizhi He , Shuai Yang , Shangguang Wang , Yongfeng Huang , Tao Qi

Long-Context Question Answering (LCQA), a challenging task, aims to reason over long-context documents to yield accurate answers to questions. Existing long-context Large Language Models (LLMs) for LCQA often struggle with the "lost in the…

Computation and Language · Computer Science 2024-11-04 Qingfei Zhao , Ruobing Wang , Yukuo Cen , Daren Zha , Shicheng Tan , Yuxiao Dong , Jie Tang

Large Language Models (LLMs) have swiftly emerged as vital resources for different applications in the biomedical and healthcare domains; however, these models encounter issues such as generating inaccurate information or hallucinations.…

Computation and Language · Computer Science 2024-05-06 Mingchen Li , Halil Kilicoglu , Hua Xu , Rui Zhang

Retrieval-Augmented Generation (RAG) is widely used to mitigate hallucinations of Large Language Models (LLMs) by leveraging external knowledge. While effective for simple queries, traditional RAG systems struggle with large-scale,…

Computation and Language · Computer Science 2025-11-11 Luyao Zhuang , Shengyuan Chen , Yilin Xiao , Huachi Zhou , Yujing Zhang , Hao Chen , Qinggang Zhang , Xiao Huang