English
Related papers

Related papers: Integrating Domain Knowledge for Financial QA: A M…

200 papers

Retrieval-Augmented Generation (RAG) integrates external knowledge with Large Language Models (LLMs) to enhance factual correctness and mitigate hallucination. However, dense retrievers often become the bottleneck of RAG systems due to…

Computation and Language · Computer Science 2025-10-27 Yuan Li , Qi Luo , Xiaonan Li , Bufan Li , Qinyuan Cheng , Bo Wang , Yining Zheng , Yuxin Wang , Zhangyue Yin , Xipeng Qiu

The ability to form, retrieve, and reason about memories in response to stimuli serves as the cornerstone for general intelligence - shaping entities capable of learning, adaptation, and intuitive insight. Large Language Models (LLMs) have…

Computation and Language · Computer Science 2024-09-25 Brendan Hogan Rappazzo , Yingheng Wang , Aaron Ferber , Carla Gomes

Large Language Models (LLMs) demonstrate human-level capabilities in dialogue, reasoning, and knowledge retention. However, even the most advanced LLMs face challenges such as hallucinations and real-time updating of their knowledge.…

Computation and Language · Computer Science 2024-09-10 Xuanwang Zhang , Yunze Song , Yidong Wang , Shuyun Tang , Xinfeng Li , Zhengran Zeng , Zhen Wu , Wei Ye , Wenyuan Xu , Yue Zhang , Xinyu Dai , Shikun Zhang , Qingsong Wen

Large language models (LLM) hold significant potential for applications in biomedicine, but they struggle with hallucinations and outdated knowledge. While retrieval-augmented generation (RAG) is generally employed to address these issues,…

Computation and Language · Computer Science 2025-09-23 Jiwoong Sohn , Yein Park , Chanwoong Yoon , Sihyeon Park , Hyeon Hwang , Mujeen Sung , Hyunjae Kim , Jaewoo Kang

Retrieval Augmented Generation (RAG) frameworks have shown significant promise in leveraging external knowledge to enhance the performance of large language models (LLMs). However, conventional RAG methods often retrieve documents based…

Computation and Language · Computer Science 2025-04-02 Pouya Pezeshkpour , Estevam Hruschka

Considering the limited internal parametric knowledge, retrieval-augmented generation (RAG) has been widely used to extend the knowledge scope of large language models (LLMs). Despite the extensive efforts on RAG research, in existing…

Computation and Language · Computer Science 2024-11-22 Yuhao Wang , Ruiyang Ren , Junyi Li , Wayne Xin Zhao , Jing Liu , Ji-Rong Wen

Retrieval-augmented generation (RAG) is a key means to effectively enhance large language models (LLMs) in many knowledge-based tasks. However, existing RAG methods struggle with knowledge-intensive reasoning tasks, because useful…

Computation and Language · Computer Science 2024-10-28 Zhuoqun Li , Xuanang Chen , Haiyang Yu , Hongyu Lin , Yaojie Lu , Qiaoyu Tang , Fei Huang , Xianpei Han , Le Sun , Yongbin Li

Large pre-trained language models have been shown to store factual knowledge in their parameters, and achieve state-of-the-art results when fine-tuned on downstream NLP tasks. However, their ability to access and precisely manipulate…

Although people are impressed by the content generation skills of large language models, the use of LLMs, such as ChatGPT, is limited by the domain grounding of the content. The correctness and groundedness of the generated content need to…

Computation and Language · Computer Science 2024-12-23 Xiaofeng Zhu , Jaya Krishna Mandivarapu

Retrieval-augmented generation (RAG) is usually integrated into large language models (LLMs) to mitigate hallucinations and knowledge obsolescence. Whereas,conventional one-step retrieve-and-read methods are insufficient for multi-hop…

Information Retrieval · Computer Science 2025-06-03 Linhao Ye , Lang Yu , Zhikai Lei , Qin Chen , Jie Zhou , Liang He

Retrieval-augmented generation (RAG) is considered to be a promising approach to alleviate the hallucination issue of large language models (LLMs), and it has received widespread attention from researchers recently. Due to the limitation in…

Information Retrieval · Computer Science 2024-06-11 Hengran Zhang , Ruqing Zhang , Jiafeng Guo , Maarten de Rijke , Yixing Fan , Xueqi Cheng

The emergence of Large Language Models (LLMs) has significantly advanced natural language processing, but these models often generate factually incorrect information, known as "hallucination". Initial retrieval-augmented generation (RAG)…

Computation and Language · Computer Science 2024-11-12 Yujia Zhou , Zheng Liu , Zhicheng Dou

Retrieval-Augmented Language Models (RALMs) have significantly improved performance in open-domain question answering (QA) by leveraging external knowledge. However, RALMs still struggle with unanswerable queries, where the retrieved…

Computation and Language · Computer Science 2024-08-09 Seong-Il Park , Seung-Woo Choi , Na-Hyun Kim , Jay-Yoon Lee

Retrieval-augmented generation (RAG) systems offer a promising approach to reduce hallucinations and improve answer accuracy in large language models (LLMs), a requirement for reliable, financial analysis where answers must be grounded in…

Machine Learning · Computer Science 2026-05-26 Magnus Samuelsen , Wilmer Nyström , Somnath Mazumdar , Mansoor Hussain , Mikkel Strange

Retrieval-Augmented Generation (RAG) has emerged as a critical technique for enhancing large language model (LLM) capabilities. However, practitioners face significant challenges when making RAG deployment decisions. While existing research…

Software Engineering · Computer Science 2025-07-22 Shengming Zhao , Yuchen Shao , Yuheng Huang , Jiayang Song , Zhijie Wang , Chengcheng Wan , Lei Ma

Retrieval Augmented Generation (RAG) is widely used to enable Large Language Models (LLMs) perform Question Answering (QA) tasks in various domains. However, RAG based on open-source LLM for specialized domains has challenges of evaluating…

Computation and Language · Computer Science 2024-07-23 Sujoy Roychowdhury , Sumit Soman , H G Ranjani , Neeraj Gunda , Vansh Chhabra , Sai Krishna Bala

Retrieval-augmented generation (RAG) frameworks enable large language models (LLMs) to retrieve relevant information from a knowledge base and incorporate it into the context for generating responses. This mitigates hallucinations and…

Computation and Language · Computer Science 2024-04-09 Pouria Rouzrokh , Shahriar Faghani , Cooper U. Gamble , Moein Shariatnia , Bradley J. Erickson

As one of the most advanced techniques in AI, Retrieval-Augmented Generation (RAG) can offer reliable and up-to-date external knowledge, providing huge convenience for numerous tasks. Particularly in the era of AI-Generated Content (AIGC),…

Computation and Language · Computer Science 2024-06-18 Wenqi Fan , Yujuan Ding , Liangbo Ning , Shijie Wang , Hengyun Li , Dawei Yin , Tat-Seng Chua , Qing Li

Retrieval-augmented generation (RAG) aims to mitigate the hallucination of Large Language Models (LLMs) by retrieving and incorporating relevant external knowledge into the generation process. However, the external knowledge may contain…

Computation and Language · Computer Science 2026-01-12 Yi Sui , Chaozhuo Li , Chen Zhang , Dawei song , Qiuchi Li

Retrieval-augmented generation (RAG) has emerged as a promising approach to enhance the performance of large language models (LLMs) in knowledge-intensive tasks such as those from medical domain. However, the sensitive nature of the medical…

Computation and Language · Computer Science 2024-11-15 Nghia Trung Ngo , Chien Van Nguyen , Franck Dernoncourt , Thien Huu Nguyen