English
Related papers

Related papers: Embedding Domain Knowledge for Large Language Mode…

200 papers

The emergence of Large Language Models (LLMs) has significantly advanced natural language processing, but these models often generate factually incorrect information, known as "hallucination". Initial retrieval-augmented generation (RAG)…

Computation and Language · Computer Science 2024-11-12 Yujia Zhou , Zheng Liu , Zhicheng Dou

Retrieval-Augmented Generation (RAG) enhances Large Language Model (LLM) output by providing prior knowledge as context to input. This is beneficial for knowledge-intensive and expert reliant tasks, including legal question-answering, which…

Retrieval-augmented generation (RAG) systems rely on accurate document retrieval to ground large language models (LLMs) in external knowledge, yet retrieval quality often degrades in corpora where topics overlap and thematic variation is…

Information Retrieval · Computer Science 2026-01-06 Rodrigo Kataishi

This study analyzes the performance of domain-specific Large Language Models (LLMs) for the medical field by integrating Retrieval-Augmented Generation (RAG) systems within a federated learning framework. Leveraging the inherent advantages…

Computation and Language · Computer Science 2025-01-09 Jincheol Jung , Hongju Jeong , Eui-Nam Huh

Retrieval-Augmented Generation (RAG) enhances Large Language Models (LLMs) by retrieving relevant memories from an external database. However, existing RAG methods typically organize all memories in a whole database, potentially limiting…

Computation and Language · Computer Science 2024-05-28 Zheng Wang , Shu Xian Teo , Jieer Ouyang , Yongjun Xu , Wei Shi

Large Language Models (LLMs) demonstrate human-level capabilities in dialogue, reasoning, and knowledge retention. However, even the most advanced LLMs face challenges such as hallucinations and real-time updating of their knowledge.…

Computation and Language · Computer Science 2024-09-10 Xuanwang Zhang , Yunze Song , Yidong Wang , Shuyun Tang , Xinfeng Li , Zhengran Zeng , Zhen Wu , Wei Ye , Wenyuan Xu , Yue Zhang , Xinyu Dai , Shikun Zhang , Qingsong Wen

Memory, additional information beyond the training of large language models (LLMs), is crucial to various real-world applications, such as personal assistant. The two mainstream solutions to incorporate memory into the generation process…

Computation and Language · Computer Science 2025-03-21 Jiale Wei , Shuchi Wu , Ruochen Liu , Xiang Ying , Jingbo Shang , Fangbo Tao

Retrieval-Augmented Generation (RAG) offers an effective solution to the issues faced by Large Language Models (LLMs) in hallucination generation and knowledge obsolescence by incorporating externally retrieved knowledge. However, existing…

Computation and Language · Computer Science 2025-07-01 Yongxin Xu , Ruizhe Zhang , Xinke Jiang , Yujie Feng , Yuzhen Xiao , Xinyu Ma , Runchuan Zhu , Xu Chu , Junfeng Zhao , Yasha Wang

Retrieval-Augmented Generation (RAG) enhances large language models (LLMs) by integrating up-to-date external knowledge, yet real-world web environments present unique challenges. These limitations manifest as two key challenges: pervasive…

Information Retrieval · Computer Science 2026-03-24 Yuqin Dai , Shuo Yang , Guoqing Wang , Yong Deng , Zhanwei Zhang , Jun Yin , Pengyu Zeng , Zhenzhe Ying , Changhua Meng , Can Yi , Yuchen Zhou , Weiqiang Wang , Shuai Lu

Large pretrained models are showing increasingly better performance in reasoning and planning tasks across different modalities, opening the possibility to leverage them for complex sequential decision making problems. In this paper, we…

Artificial Intelligence · Computer Science 2024-10-10 Martin Klissarov , Devon Hjelm , Alexander Toshev , Bogdan Mazoure

Retrieval-Augmented Generation (RAG), which integrates external knowledge into Large Language Models (LLMs), has proven effective in enabling LLMs to produce more accurate and reliable responses. However, it remains a significant challenge…

Computation and Language · Computer Science 2025-02-11 Yan Weng , Fengbin Zhu , Tong Ye , Haoyan Liu , Fuli Feng , Tat-Seng Chua

Large Language Models (LLMs) have shown remarkable reasoning capabilities, while their practical applications are limited by severe factual hallucinations due to limitations in the timeliness, accuracy, and comprehensiveness of their…

Artificial Intelligence · Computer Science 2025-06-10 Xinyan Guan , Jiali Zeng , Fandong Meng , Chunlei Xin , Yaojie Lu , Hongyu Lin , Xianpei Han , Le Sun , Jie Zhou

Retrieval-Augmented Generation (RAG) is an effective method to enhance the capabilities of large language models (LLMs). Existing methods typically optimize the retriever or the generator in a RAG system by directly using the top-k…

Computation and Language · Computer Science 2025-10-07 Shaohan Wang , Licheng Zhang , Zheren Fu , Zhendong Mao , Yongdong Zhang

Retrieval-augmented generation (RAG) is a promising way to improve large language models (LLMs) for generating more factual, accurate, and up-to-date content. Existing methods either optimize prompts to guide LLMs in leveraging retrieved…

Computation and Language · Computer Science 2024-12-12 Yutao Zhu , Zhaoheng Huang , Zhicheng Dou , Ji-Rong Wen

Given the growing trend of many organizations integrating Retrieval Augmented Generation (RAG) into their operations, we assess RAG on domain-specific data and test state-of-the-art models across various optimization techniques. We…

Artificial Intelligence · Computer Science 2024-11-14 Anum Afzal , Juraj Vladika , Gentrit Fazlija , Andrei Staradubets , Florian Matthes

Problem-solving has been a fundamental driver of human progress in numerous domains. With advancements in artificial intelligence, Large Language Models (LLMs) have emerged as powerful tools capable of tackling complex problems across…

Machine Learning · Computer Science 2025-05-07 Da Zheng , Lun Du , Junwei Su , Yuchen Tian , Yuqi Zhu , Jintian Zhang , Lanning Wei , Ningyu Zhang , Huajun Chen

Retrieval-Augmented Generation (RAG) offers a cost-effective approach to injecting real-time knowledge into large language models (LLMs). Nevertheless, constructing and validating high-quality knowledge repositories require considerable…

Computation and Language · Computer Science 2024-05-28 Xun Liang , Simin Niu , Zhiyu li , Sensen Zhang , Shichao Song , Hanyu Wang , Jiawei Yang , Feiyu Xiong , Bo Tang , Chenyang Xi

In-context learning (ICL) and Retrieval-Augmented Generation (RAG) have gained attention for their ability to enhance LLMs' reasoning by incorporating external knowledge but suffer from limited contextual window size, leading to…

Feature generation can significantly enhance learning outcomes, particularly for tasks with limited data. An effective way to improve feature generation is to expand the current feature space using existing features and enriching the…

Computation and Language · Computer Science 2025-11-11 Xinhao Zhang , Jinghan Zhang , Fengran Mo , Dakshak Keerthi Chandra , Yu-Zhong Chen , Fei Xie , Kunpeng Liu

The integration of retrieval-augmented techniques with LLMs has shown promise in improving performance across various domains. However, their utility in tasks requiring advanced reasoning, such as generating and evaluating mathematical…

Artificial Intelligence · Computer Science 2024-12-24 Majd Zayyad , Yossi Adi
‹ Prev 1 4 5 6 7 8 10 Next ›