English
Related papers

Related papers: Long Context RAG Performance of Large Language Mod…

200 papers

Augmenting Large Language Models (LLMs) with information retrieval capabilities (i.e., Retrieval-Augmented Generation (RAG)) has proven beneficial for knowledge-intensive tasks. However, understanding users' contextual search intent when…

Computation and Language · Computer Science 2024-09-25 Nirmal Roy , Leonardo F. R. Ribeiro , Rexhina Blloshmi , Kevin Small

Retrieval-Augmented Generation (RAG) systems rely on retrieved documents being concatenated into a model's input context, making both document ordering and context size critical yet controversial design choices. Prior work reports…

Information Retrieval · Computer Science 2026-05-28 Jorge Gabín , Anxo Perez , Javier Parapar

Retrieval-augmented generation (RAG) is a promising way to improve large language models (LLMs) for generating more factual, accurate, and up-to-date content. Existing methods either optimize prompts to guide LLMs in leveraging retrieved…

Computation and Language · Computer Science 2024-12-12 Yutao Zhu , Zhaoheng Huang , Zhicheng Dou , Ji-Rong Wen

Large language models (LLMs) have demonstrated remarkable capabilities in a wide range of tasks, yet their application to specialized domains remains challenging due to the need for deep expertise. Retrieval-Augmented generation (RAG) has…

Computation and Language · Computer Science 2025-09-30 Qinggang Zhang , Shengyuan Chen , Yuanchen Bei , Zheng Yuan , Huachi Zhou , Zijin Hong , Hao Chen , Yilin Xiao , Chuang Zhou , Junnan Dong , Yi Chang , Xiao Huang

Large Language Models (LLMs) have advanced artificial intelligence by enabling human-like text generation and natural language understanding. However, their reliance on static training data limits their ability to respond to dynamic,…

Artificial Intelligence · Computer Science 2026-04-02 Aditi Singh , Abul Ehtesham , Saket Kumar , Tala Talaei Khoei , Athanasios V. Vasilakos

The use of large language models (LLMs) is becoming increasingly widespread among software developers. However, privacy and computational requirements are problematic with commercial solutions and the use of LLMs. In this work, we focus on…

Software Engineering · Computer Science 2025-06-17 Marko Hostnik , Marko Robnik-Šikonja

Despite their remarkable capabilities, large language models (LLMs) often produce responses containing factual inaccuracies due to their sole reliance on the parametric knowledge they encapsulate. Retrieval-Augmented Generation (RAG), an ad…

Computation and Language · Computer Science 2023-10-19 Akari Asai , Zeqiu Wu , Yizhong Wang , Avirup Sil , Hannaneh Hajishirzi

Long-context language models (LCLMs) have the potential to revolutionize our approach to tasks traditionally reliant on external tools like retrieval systems or databases. Leveraging LCLMs' ability to natively ingest and process entire…

This paper presents an analysis of open-source large language models (LLMs) and their application in Retrieval-Augmented Generation (RAG) tasks, specific for enterprise-specific data sets scraped from their websites. With the increasing…

Information Retrieval · Computer Science 2024-06-18 Gautam B , Anupam Purwar

Generating high-quality answers consistently by providing contextual information embedded in the prompt passed to the Large Language Model (LLM) is dependent on the quality of information retrieval. As the corpus of contextual information…

Information Retrieval · Computer Science 2024-08-01 Sai Ganesh , Anupam Purwar , Gautam B

Retrieval-augmented generation (RAG) enhances large language models (LLMs) by integrating external knowledge retrieved at inference time. While RAG demonstrates strong performance on benchmarks largely derived from general-domain corpora…

Computation and Language · Computer Science 2025-07-29 Ran Xu , Yuchen Zhuang , Yue Yu , Haoyu Wang , Wenqi Shi , Carl Yang

Retrieval-augmented generation (RAG) systems rely on retrieval models for identifying relevant contexts and answer generation models for utilizing those contexts. However, retrievers exhibit imperfect recall and precision, limiting…

Computation and Language · Computer Science 2026-04-29 Jerry Huang , Siddarth Madala , Risham Sidhu , Cheng Niu , Hao Peng , Julia Hockenmaier , Tong Zhang

Large Language Models (LLMs) encounter challenges in efficiently processing long-text queries, as seen in applications like enterprise document analysis and financial report comprehension. While conventional solutions employ long-context…

Computation and Language · Computer Science 2025-03-06 Yulong Hui , Yihao Liu , Yao Lu , Huanchen Zhang

The advent of Large Language Models has revolutionized information retrieval, ushering in a new era of expansive knowledge accessibility. While these models excel in providing open-world knowledge, effectively extracting answers in diverse…

Information Retrieval · Computer Science 2024-01-04 Syed Rameel Ahmad

Retrieval-augmented generation (RAG) enhances large language models (LLMs) by incorporating external knowledge to generate a response within a context with improved accuracy and reduced hallucinations. However, multi-modal RAG systems face…

Machine Learning · Computer Science 2025-01-09 Matin Mortaheb , Mohammad A. Amir Khojastepour , Srimat T. Chakradhar , Sennur Ulukus

Retrieval-Augmented Generation (RAG) offers a promising solution to address various limitations of Large Language Models (LLMs), such as hallucination and difficulties in keeping up with real-time updates. This approach is particularly…

Computation and Language · Computer Science 2024-06-18 Shuting Wang , Jiongnan Liu , Shiren Song , Jiehan Cheng , Yuqi Fu , Peidong Guo , Kun Fang , Yutao Zhu , Zhicheng Dou

Although large language models (LLMs) demonstrate strong text generation capabilities, they struggle in scenarios requiring access to structured knowledge bases or specific documents, limiting their effectiveness in knowledge-intensive…

Computation and Language · Computer Science 2025-01-24 Gustavo Kuratomi , Paulo Pirozelli , Fabio G. Cozman , Sarajane M. Peres

Document understanding is critical for applications from financial analysis to scientific discovery. Current approaches, whether OCR-based pipelines feeding Large Language Models (LLMs) or native Multimodal LLMs (MLLMs), face key…

Computation and Language · Computer Science 2026-04-21 Sensen Gao , Shanshan Zhao , Xu Jiang , Lunhao Duan , Yong Xien Chng , Qing-Guo Chen , Weihua Luo , Kaifu Zhang , Jia-Wang Bian , Mingming Gong

Retrieval-Augmented Generation (RAG) compensates for the static knowledge limitations of Large Language Models (LLMs) by integrating external knowledge, producing responses with enhanced factual correctness and query-specific…

Computation and Language · Computer Science 2025-05-21 Ruobing Yao , Yifei Zhang , Shuang Song , Neng Gao , Chenyang Tu

Large Language Models (LLMs) have demonstrated significant performance improvements across various cognitive tasks. An emerging application is using LLMs to enhance retrieval-augmented generation (RAG) capabilities. These systems require…

Computation and Language · Computer Science 2025-01-28 Satyapriya Krishna , Kalpesh Krishna , Anhad Mohananey , Steven Schwarcz , Adam Stambler , Shyam Upadhyay , Manaal Faruqui
‹ Prev 1 4 5 6 7 8 10 Next ›