English
Related papers

Related papers: Open-RAG: Enhanced Retrieval-Augmented Reasoning w…

200 papers

Retrieval Augmented Generation (RAG) has emerged as a crucial technique for enhancing the accuracy of Large Language Models (LLMs) by incorporating external information. With the advent of LLMs that support increasingly longer context…

Machine Learning · Computer Science 2024-11-07 Quinn Leng , Jacob Portes , Sam Havens , Matei Zaharia , Michael Carbin

This study develops a question-answering system based on Retrieval-Augmented Generation (RAG) using Chinese Wikipedia and Lawbank as retrieval sources. Using TTQA and TMMLU+ as evaluation datasets, the system employs BGE-M3 for dense vector…

Information Retrieval · Computer Science 2025-01-17 Te-Lun Yang , Jyi-Shane Liu , Yuen-Hsien Tseng , Jyh-Shing Roger Jang

In this technical report, we introduce OpenR, an open-source framework designed to integrate key components for enhancing the reasoning capabilities of large language models (LLMs). OpenR unifies data acquisition, reinforcement learning…

Artificial Intelligence · Computer Science 2024-10-15 Jun Wang , Meng Fang , Ziyu Wan , Muning Wen , Jiachen Zhu , Anjie Liu , Ziqin Gong , Yan Song , Lei Chen , Lionel M. Ni , Linyi Yang , Ying Wen , Weinan Zhang

Retrieval-Augmented Generation (RAG) improves Large Language Models (LLMs) by retrieving supporting documents into the prompt, but existing methods do not explicitly target queries that require fetching multiple documents with substantially…

Large Language Models (LLMs), although powerful in general domains, often perform poorly on domain-specific tasks such as medical question answering (QA). In addition, LLMs tend to function as "black-boxes", making it challenging to modify…

Computation and Language · Computer Science 2024-08-19 Yucheng Shi , Shaochen Xu , Tianze Yang , Zhengliang Liu , Tianming Liu , Quanzheng Li , Xiang Li , Ninghao Liu

Large Language Models (LLMs) deployed on edge devices learn through fine-tuning and updating a certain portion of their parameters. Although such learning methods can be optimized to reduce resource utilization, the overall required…

Machine Learning · Computer Science 2024-05-09 Ruiyang Qin , Zheyu Yan , Dewen Zeng , Zhenge Jia , Dancheng Liu , Jianbo Liu , Zhi Zheng , Ningyuan Cao , Kai Ni , Jinjun Xiong , Yiyu Shi

Retrieval Augmented Generation (RAG), a paradigm that integrates external contextual information with large language models (LLMs) to enhance factual accuracy and relevance, has emerged as a pivotal area in generative AI. The LLMs used in…

Computation and Language · Computer Science 2024-09-17 Xuan-Phi Nguyen , Shrey Pandit , Senthil Purushwalkam , Austin Xu , Hailin Chen , Yifei Ming , Zixuan Ke , Silvio Savarese , Caiming Xong , Shafiq Joty

Despite the recent advancement in Retrieval-Augmented Generation (RAG) systems, most retrieval methodologies are often developed for factual retrieval, which assumes query and positive documents are semantically similar. In this paper, we…

Information Retrieval · Computer Science 2025-04-10 Luo Ji , Feixiang Guo , Teng Chen , Qingqing Gu , Xiaoyu Wang , Ningyuan Xi , Yihong Wang , Peng Yu , Yue Zhao , Hongyang Lei , Zhonglin Jiang , Yong Chen

Retrieval-Augmented Generation (RAG) improves Large Language Models (LLMs) by using external knowledge, but it struggles with precise entity information retrieval. In this paper, we proposed MES-RAG framework, which enhances entity-specific…

Computation and Language · Computer Science 2025-03-19 Pingyu Wu , Daiheng Gao , Jing Tang , Huimin Chen , Wenbo Zhou , Weiming Zhang , Nenghai Yu

Large Language Models (LLMs) and Knowledge Graphs (KGs) offer a promising approach to robust and explainable Question Answering (QA). While LLMs excel at natural language understanding, they suffer from knowledge gaps and hallucinations.…

Machine Learning · Computer Science 2025-04-15 Jasper Linders , Jakub M. Tomczak

Large language models (LLMs) have achieved impressive performance but face high computational costs and latency, limiting their deployment in resource-constrained settings. In contrast, small-scale LLMs (SLMs) are more efficient yet…

Computation and Language · Computer Science 2025-02-18 Tianci Liu , Haoxiang Jiang , Tianze Wang , Ran Xu , Yue Yu , Linjun Zhang , Tuo Zhao , Haoyu Wang

Large language models (LLMs) have demonstrated remarkable advances in reasoning capabilities. However, their performance remains constrained by limited access to explicit and structured domain knowledge. Retrieval-Augmented Generation (RAG)…

Computation and Language · Computer Science 2025-10-20 Junlin Wu , Xianrui Zhong , Jiashuo Sun , Bolian Li , Bowen Jin , Jiawei Han , Qingkai Zeng

In this study, we explore the fine-tuning of Large Language Models (LLMs) to better support policymakers in their crucial work of understanding, analyzing, and crafting legal regulations. To equip the model with a deep understanding of…

Computation and Language · Computer Science 2025-11-06 One Octadion , Bondan Sapta Prakoso , Nanang Yudi Setiawan , Novanto Yudistira

Retrieval-Augmented Generation (RAG) is a prevalent approach to infuse a private knowledge base of documents with Large Language Models (LLM) to build Generative Q\&A (Question-Answering) systems. However, RAG accuracy becomes increasingly…

Information Retrieval · Computer Science 2025-03-10 Kunal Sawarkar , Abhilasha Mangal , Shivam Raj Solanki

Retrieval-augmented generation (RAG) has become a widely adopted paradigm for enabling knowledge-grounded large language models (LLMs). However, standard RAG pipelines often fail to ensure that model reasoning remains consistent with the…

Artificial Intelligence · Computer Science 2025-10-14 Jiaqi Wei , Hao Zhou , Xiang Zhang , Di Zhang , Zijie Qiu , Wei Wei , Jinzhe Li , Wanli Ouyang , Siqi Sun

Retrieval-Augmented Generation (RAG) is essential for integrating external knowledge into Large Language Model (LLM) outputs. While the literature on RAG is growing, it primarily focuses on systematic reviews and comparisons of new…

Computation and Language · Computer Science 2024-04-02 Matouš Eibich , Shivay Nagpal , Alexander Fred-Ojala

Large Language Models (LLMs) have shown remarkable performance on general Question Answering (QA), yet they often struggle in domain-specific scenarios where accurate and up-to-date information is required. Retrieval-Augmented Generation…

Computation and Language · Computer Science 2026-02-13 Haoyue Bai , Haoyu Wang , Shengyu Chen , Zhengzhang Chen , Lu-An Tang , Wei Cheng , Haifeng Chen , Yanjie Fu

Large language models (LLMs) exhibit remarkable generative capabilities but often suffer from hallucinations. Retrieval-augmented generation (RAG) offers an effective solution by incorporating external knowledge, but existing methods still…

Computation and Language · Computer Science 2024-12-17 Xiaoxi Li , Jiajie Jin , Yujia Zhou , Yongkang Wu , Zhonghua Li , Qi Ye , Zhicheng Dou

Large language models (LLMs) have shown promise in medical question answering but often struggle with hallucinations and shallow reasoning, particularly in tasks requiring nuanced clinical understanding. Retrieval-augmented generation (RAG)…

Computation and Language · Computer Science 2025-08-25 Ziyu Wang , Elahe Khatibi , Amir M. Rahmani

Retrieval-augmented generation (RAG) is a paradigm that augments large language models (LLMs) with external knowledge to tackle knowledge-intensive question answering. While several benchmarks evaluate Multimodal LLMs (MLLMs) under…

Computation and Language · Computer Science 2025-08-18 Yin Wu , Quanyu Long , Jing Li , Jianfei Yu , Wenya Wang