English
Related papers

Related papers: Long Context RAG Performance of Large Language Mod…

200 papers

Retrieval-Augmented Generation (RAG) improves Large Language Models (LLMs) by retrieving supporting documents into the prompt, but existing methods do not explicitly target queries that require fetching multiple documents with substantially…

Retrieval-augmented generation (RAG) has revitalized Large Language Models (LLMs) by injecting non-parametric factual knowledge. Compared with long-context LLMs, RAG is considered an effective summarization tool in a more concise and…

Computation and Language · Computer Science 2025-05-30 Haozhen Zhang , Tao Feng , Jiaxuan You

Large language models (LLMs) have transformed natural language processing (NLP), enabling diverse applications by integrating large-scale pre-trained knowledge. However, their static knowledge limits dynamic reasoning over external…

Computation and Language · Computer Science 2025-09-26 Harshad Khadilkar , Abhay Gupta

Recent advancements in Large language models (LLMs) have demonstrated remarkable capabilities across diverse domains. While they exhibit strong zero-shot performance on various tasks, LLMs' effectiveness in music-related applications…

Computation and Language · Computer Science 2025-12-09 Daeyong Kwon , SeungHeon Doh , Juhan Nam

Multimodal Retrieval-Augmented Generation (MRAG) enhances large language models (LLMs) by integrating multimodal data (text, images, videos) into retrieval and generation processes, overcoming the limitations of text-only…

Information Retrieval · Computer Science 2025-04-15 Lang Mei , Siyu Mo , Zhihan Yang , Chong Chen

Large Language Models (LLMs) perform well in short contexts but degrade on long legal documents, often producing hallucinations such as incorrect clauses or precedents. In the legal domain, where precision is critical, such errors undermine…

Computation and Language · Computer Science 2026-03-23 Suyash Maniyar , Deepali Singh , Rohith Reddy

Large language models (LLMs) often generate outdated or inaccurate information based on static training datasets. Retrieval-augmented generation (RAG) mitigates this by integrating outside data sources. While previous RAG systems used…

Retrieval-Augmented Generation (RAG) systems have shown promise in enhancing the performance of Large Language Models (LLMs). However, these systems face challenges in effectively integrating external knowledge with the LLM's internal…

Large-scale language models (LLMs) have achieved remarkable success across various language tasks but suffer from hallucinations and temporal misalignment. To mitigate these shortcomings, Retrieval-augmented generation (RAG) has been…

Computation and Language · Computer Science 2024-04-30 Zhongzhen Huang , Kui Xue , Yongqi Fan , Linjie Mu , Ruoyu Liu , Tong Ruan , Shaoting Zhang , Xiaofan Zhang

Retrieval-augmented generation (RAG) has emerged as a promising approach to enhance the performance of large language models (LLMs) in knowledge-intensive tasks such as those from medical domain. However, the sensitive nature of the medical…

Computation and Language · Computer Science 2024-11-15 Nghia Trung Ngo , Chien Van Nguyen , Franck Dernoncourt , Thien Huu Nguyen

Large language models (LLMs) have emerged as powerful tools for knowledge-intensive tasks across domains. In materials science, to find novel materials for various energy efficient devices for various real-world applications, requires…

Materials Science · Physics 2025-08-12 Agada Joseph Oche , Arpan Biswas

Long-context large language models (LC LLMs) combined with retrieval-augmented generation (RAG) hold strong potential for complex multi-hop and large-document tasks. However, existing RAG systems often suffer from imprecise retrieval,…

Computation and Language · Computer Science 2025-05-22 Woosang Lim , Zekun Li , Gyuwan Kim , Sungyoung Ji , HyeonJung Kim , Kyuri Choi , Jin Hyuk Lim , Kyungpyo Park , William Yang Wang

Retrieval-augmented generation (RAG) and long-context language models (LCLMs) both address context limitations of LLMs in open-domain question answering (QA). However, optimal external context to retrieve remains an open problem: fixing the…

Computation and Language · Computer Science 2025-10-01 Chihiro Taguchi , Seiji Maekawa , Nikita Bhutani

Despite the successes of large language models (LLMs), they exhibit significant drawbacks, particularly when processing long contexts. Their inference cost scales quadratically with respect to sequence length, making it expensive for…

Computation and Language · Computer Science 2024-07-22 Thomas Merth , Qichen Fu , Mohammad Rastegari , Mahyar Najibi

Retrieval-augmented Generation (RAG) extends large language models (LLMs) with external knowledge but faces key challenges: restricted effective context length and redundancy in retrieved documents. Pure compression-based approaches reduce…

Computation and Language · Computer Science 2025-07-09 Yiqiao Jin , Kartik Sharma , Vineeth Rakesh , Yingtong Dou , Menghai Pan , Mahashweta Das , Srijan Kumar

Retrieval Augmented Generation (RAG) is a promising technique for mitigating two key limitations of large language models (LLMs): outdated information and hallucinations. RAG system stores documents as embedding vectors in a database. Given…

Information Retrieval · Computer Science 2026-02-10 Taehee Jeong , Xingzhe Zhao , Peizu Li , Markus Valvur , Weihua Zhao

Causality detection and mining are important tasks in information retrieval due to their enormous use in information extraction, and knowledge graph construction. To solve these tasks, in existing literature there exist several solutions --…

Computation and Language · Computer Science 2025-06-02 Thushara Manjari Naduvilakandy , Hyeju Jang , Mohammad Al Hasan

Understanding and reasoning over long videos pose significant challenges for large video language models (LVLMs) due to the difficulty in processing intensive video tokens beyond context window and retaining long-term sequential…

Computer Vision and Pattern Recognition · Computer Science 2025-10-17 Xiaoqian Shen , Wenxuan Zhang , Jun Chen , Mohamed Elhoseiny

Retrieval-Augmented Generation (RAG) has gained significant attention in recent years for its potential to enhance natural language understanding and generation by combining large-scale retrieval systems with generative models. RAG…

Computation and Language · Computer Science 2025-03-18 Mingyue Cheng , Yucong Luo , Jie Ouyang , Qi Liu , Huijie Liu , Li Li , Shuo Yu , Bohou Zhang , Jiawei Cao , Jie Ma , Daoyu Wang , Enhong Chen

Retrieval-Augmented Generation (RAG) has become a widely adopted approach to enhance Large Language Models (LLMs) by incorporating external knowledge and reducing hallucinations. However, noisy or irrelevant documents are often introduced…

Computation and Language · Computer Science 2026-01-07 Jingyu Liu , Jiaen Lin , Yong Liu