English
Related papers

Related papers: Type-Aware Retrieval-Augmented Generation with Dep…

200 papers

The lack of domain-specific data in the pre-training of Large Language Models (LLMs) severely limits LLM-based decision systems in specialized applications, while post-training a model in the scenarios requires significant computational…

Artificial Intelligence · Computer Science 2025-05-05 Zongyuan Li , Pengfei Li , Runnan Qi , Yanan Ni , Lumin Jiang , Hui Wu , Xuebo Zhang , Kuihua Huang , Xian Guo

The proliferation of fine-tuned language model experts for specific tasks and domains signals the need for efficient selection and combination methods. We propose LoRA-Augmented Generation (LAG) for leveraging large libraries of knowledge…

Computation and Language · Computer Science 2025-08-19 William Fleshman , Benjamin Van Durme

Retrieval-augmented generation (RAG) is a powerful technique that enhances downstream task execution by retrieving additional information, such as knowledge, skills, and tools from external sources. Graph, by its intrinsic "nodes connected…

Retrieval-Augmented Generation (RAG) significantly mitigates the hallucinations and domain knowledge deficiency in large language models by incorporating external knowledge bases. However, the multi-module architecture of RAG introduces…

Cryptography and Security · Computer Science 2026-03-24 Yanming Mu , Hao Hu , Feiyang Li , Qiao Yuan , Jiang Wu , Zichuan Liu , Pengcheng Liu , Mei Wang , Hongwei Zhou , Yuling Liu

Retrieval-augmented generation (RAG) is critical for reducing hallucinations and incorporating external knowledge into Large Language Models (LLMs). However, advanced RAG systems face a trade-off between performance and efficiency.…

Information Retrieval · Computer Science 2025-08-05 Shengbo Gong , Xianfeng Tang , Carl Yang , Wei jin

Retrieval-Augmented Generation (RAG) systems often face limitations in specialized domains such as fintech, where domain-specific ontologies, dense terminology, and acronyms complicate effective retrieval and synthesis. This paper…

Artificial Intelligence · Computer Science 2025-10-30 Thomas Cook , Richard Osuagwu , Liman Tsatiashvili , Vrynsia Vrynsia , Koustav Ghosal , Maraim Masoud , Riccardo Mattivi

The scaling of large language models to encode all the world's knowledge in model parameters is unsustainable and has exacerbated resource barriers. Retrieval-Augmented Generation (RAG) presents a potential solution, yet its application to…

Computer Vision and Pattern Recognition · Computer Science 2024-06-28 Varun Nagaraj Rao , Siddharth Choudhary , Aditya Deshpande , Ravi Kumar Satzoda , Srikar Appalaraju

Retrieval-Augmented Generation (RAG) is a crucial method for mitigating hallucinations in Large Language Models (LLMs) and integrating external knowledge into their responses. Existing RAG methods typically employ query rewriting to clarify…

Computation and Language · Computer Science 2025-02-26 Zhuocheng Zhang , Yang Feng , Min Zhang

Text-to-image generation increasingly demands access to domain-specific, fine-grained, and rapidly evolving knowledge that pretrained models cannot fully capture, necessitating the integration of retrieval methods. Existing…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Mengdan Zhu , Senhao Cheng , Guangji Bai , Yifei Zhang , Liang Zhao

Industrial standards and normative documents exhibit intricate hierarchical structures, domain-specific lexicons, and extensive cross-referential dependencies, which making it challenging to process them directly by Large Language Models…

Information Retrieval · Computer Science 2026-04-14 Aiman Al Masoud , Marco Arazzi , Simone Germani , Antonino Nocera

Retrieval-augmented generation (RAG) improves large language model reliability by grounding generated responses in external evidence. However, RAG performance depends on the relevance of retrieved passages, the quality of evidence ranking,…

Information Retrieval · Computer Science 2026-05-05 Fariba Afrin Irany , Sampson Akwafuo

Retrieval-Augmented Generation (RAG) grounds large language models with external evidence, but many implementations rely on pre-built indices that remain static after construction. Related queries therefore repeat similar multi-hop…

Artificial Intelligence · Computer Science 2026-03-03 Yifan Wang , Mingxuan Jiang , Zhihao Sun , Yixin Cao , Yicun Liu , Keyang Chen , Guangnan Ye , Hongfeng Chai

With the rapid development of large-scale language models, Retrieval-Augmented Generation (RAG) has been widely adopted. However, existing RAG paradigms are inevitably influenced by erroneous retrieval information, thereby reducing the…

Information Retrieval · Computer Science 2024-05-30 Ridong Wu , Shuhong Chen , Xiangbiao Su , Yuankai Zhu , Yifei Liao , Jianming Wu

Retrieval-Augmented Generation (RAG) improves reliability of large language models by incorporating external knowledge, but the retrieval process can introduce bias that propagates to generated outputs. This issue is particularly…

Databases · Computer Science 2026-05-18 Yingqi Zhao , Vasilis Efthymiou , Jyrki Nummenmaa , Kostas Stefanidis

In the rapidly changing world of smart technology, searching for documents has become more challenging due to the rise of advanced language models. These models sometimes face difficulties, like providing inaccurate information, commonly…

Information Retrieval · Computer Science 2025-03-20 Julien Pierre Edmond Ghali , Kosuke Shima , Koichi Moriyama , Atsuko Mutoh , Nobuhiro Inuzuka

The increasing complexity of modern software systems has made understanding their behavior increasingly challenging, driving the need for explainability to improve transparency and user trust. Traditional documentation is often outdated or…

Software Engineering · Computer Science 2026-01-12 Daniel Pöttgen , Mersedeh Sadeghi , Max Unterbusch , Andreas Vogelsang

Retrieval-Augmented Generation (RAG) mitigates hallucinations in Multimodal Large Language Models (MLLMs), yet existing systems struggle with complex cross-modal reasoning. Flat vector retrieval often ignores structural dependencies, while…

Information Retrieval · Computer Science 2026-04-08 Sijun Dai , Qiang Huang , Xiaoxing You , Jun Yu

Retrieval-Augmented Generation (RAG) has emerged as a powerful approach for enhancing large language models' question-answering capabilities through the integration of external knowledge. However, when adapting RAG systems to specialized…

Computation and Language · Computer Science 2026-01-19 Xin Sun , Zhongqi Chen , Qiang Liu , Shu Wu , Bowen Song , Weiqiang Wang , Zilei Wang , Liang Wang

Retrieval-augmented generation (RAG) is a promising way to improve large language models (LLMs) for generating more factual, accurate, and up-to-date content. Existing methods either optimize prompts to guide LLMs in leveraging retrieved…

Computation and Language · Computer Science 2024-12-12 Yutao Zhu , Zhaoheng Huang , Zhicheng Dou , Ji-Rong Wen

Retrieval-Augmented Generation (RAG) architectures have recently garnered significant attention for their ability to improve truth grounding and coherence in natural language processing tasks. However, the reliability of RAG systems in…

Computation and Language · Computer Science 2024-12-04 Joel Suro