English
Related papers

Related papers: Mix-of-Granularity: Optimize the Chunking Granular…

200 papers

Retrieval-augmented generation (RAG) has shown impressive capability in providing reliable answer predictions and addressing hallucination problems. A typical RAG implementation uses powerful retrieval models to extract external information…

Information Retrieval · Computer Science 2024-11-19 Ziwei Liu , Liang Zhang , Qian Li , Jianghua Wu , Guangxu Zhu

In recent years, large language models (LLMs) have made remarkable achievements in various domains. However, the untimeliness and cost of knowledge updates coupled with hallucination issues of LLMs have curtailed their applications in…

Machine Learning · Computer Science 2024-05-31 Chunjing Gan , Dan Yang , Binbin Hu , Hanxiao Zhang , Siyuan Li , Ziqi Liu , Yue Shen , Lin Ju , Zhiqiang Zhang , Jinjie Gu , Lei Liang , Jun Zhou

Current general-purpose large language models (LLMs) commonly exhibit knowledge hallucination and insufficient domain-specific adaptability in domain-specific tasks, limiting their effectiveness in specialized question answering scenarios.…

Information Retrieval · Computer Science 2025-09-16 Mengzheng Yang , Yanfei Ren , David Osei Opoku , Ruochang Li , Peng Ren , Chunxiao Xing

Retrieval-augmented generation (RAG) is a key means to effectively enhance large language models (LLMs) in many knowledge-based tasks. However, existing RAG methods struggle with knowledge-intensive reasoning tasks, because useful…

Computation and Language · Computer Science 2024-10-28 Zhuoqun Li , Xuanang Chen , Haiyang Yu , Hongyu Lin , Yaojie Lu , Qiaoyu Tang , Fei Huang , Xianpei Han , Le Sun , Yongbin Li

Efficient online learning requires seamless access to diverse resources such as videos, code repositories, documentation, and general web content. This poster paper introduces early-stage work on a Multi-Agent Retrieval-Augmented Generation…

Artificial Intelligence · Computer Science 2025-02-07 Devansh Srivastav , Hasan Md Tusfiqur Alam , Afsaneh Asaei , Mahmoud Fazeli , Tanisha Sharma , Daniel Sonntag

Climate decision making is constrained by the complexity and inaccessibility of key information within lengthy, technical, and multi-lingual documents. Generative AI technologies offer a promising route for improving the accessibility of…

Computation and Language · Computer Science 2024-11-01 Matyas Juhasz , Kalyan Dutia , Henry Franks , Conor Delahunty , Patrick Fawbert Mills , Harrison Pim

In the rapidly evolving field of data science, efficiently navigating the expansive body of academic literature is crucial for informed decision-making and innovation. This paper presents an enhanced Retrieval-Augmented Generation (RAG)…

Information Retrieval · Computer Science 2025-05-15 Ahmet Yasin Aytar , Kemal Kilic , Kamer Kaya

Retrieval-augmented generation (RAG) has improved large language models (LLMs) by using knowledge retrieval to overcome knowledge deficiencies. However, current RAG methods often fall short of ensuring the depth and completeness of…

Computation and Language · Computer Science 2025-02-11 Shengjie Ma , Chengjin Xu , Xuhui Jiang , Muzhi Li , Huaren Qu , Cehao Yang , Jiaxin Mao , Jian Guo

Retrieval-augmented Generation (RAG) is powerful, but its effectiveness hinges on which retrievers we use and how. Different retrievers offer distinct, often complementary signals: BM25 captures lexical matches; dense retrievers, semantic…

Information Retrieval · Computer Science 2025-06-23 Jushaan Singh Kalra , Xinran Zhao , To Eun Kim , Fengyu Cai , Fernando Diaz , Tongshuang Wu

Retrieval-Augmented Generation (RAG), by integrating non-parametric knowledge from external knowledge bases into models, has emerged as a promising approach to enhancing response accuracy while mitigating factual errors and hallucinations.…

Information Retrieval · Computer Science 2025-09-12 Qitao Qin , Yucong Luo , Yihang Lu , Zhibo Chu , Xiaoman Liu , Xianwei Meng

Chunking information is a key step in Retrieval Augmented Generation (RAG). Current research primarily centers on paragraph-level chunking. This approach treats all texts as equal and neglects the information contained in the structure of…

Computation and Language · Computer Science 2024-03-19 Antonio Jimeno Yepes , Yao You , Jan Milczek , Sebastian Laverde , Renyu Li

Retrieval-Augmented Generation (RAG) has become a foundational paradigm for equipping large language models (LLMs) with external knowledge, playing a critical role in information retrieval and knowledge-intensive applications. However,…

Computation and Language · Computer Science 2025-06-10 Weihang Su , Qingyao Ai , Jingtao Zhan , Qian Dong , Yiqun Liu

The traditional RAG paradigm, which typically engages in the comprehension of relevant text chunks in response to received queries, inherently restricts both the depth of knowledge internalization and reasoning capabilities. To address this…

Computation and Language · Computer Science 2025-10-17 Jihao Zhao , Zhiyuan Ji , Simin Niu , Hanyu Wang , Feiyu Xiong , Zhiyu Li

Large language models (LLMs) achieve remarkable performance across domains but remain prone to hallucinations and inconsistencies. Retrieval-augmented generation (RAG) mitigates these issues by augmenting model inputs with relevant…

Machine Learning · Computer Science 2026-04-10 Akash Dhasade , Rachid Guerraoui , Anne-Marie Kermarrec , Diana Petrescu , Rafael Pires , Mathis Randl , Martijn de Vos

The integration of external knowledge through Retrieval-Augmented Generation (RAG) has become foundational in enhancing large language models (LLMs) for knowledge-intensive tasks. However, existing RAG paradigms often overlook the cognitive…

Artificial Intelligence · Computer Science 2025-09-24 Yu Wang , Shiwan Zhao , Zhihu Wang , Ming Fan , Xicheng Zhang , Yubo Zhang , Zhengfan Wang , Heyuan Huang , Ting Liu

Research question answering requires accurate retrieval and contextual understanding of scientific literature. However, current Retrieval-Augmented Generation (RAG) methods often struggle to balance complex document relationships with…

Information Retrieval · Computer Science 2025-01-28 Yuntong Hu , Zhihan Lei , Zhongjie Dai , Allen Zhang , Abhinav Angirekula , Zheng Zhang , Liang Zhao

Retrieval-augmented generation (RAG) has emerged as a popular approach to steering the output of a large language model (LLM) by incorporating retrieved contexts as inputs. However, existing work observed the generator bias, such that…

Computation and Language · Computer Science 2024-12-17 Youngwon Lee , Seung-won Hwang , Daniel Campos , Filip Graliński , Zhewei Yao , Yuxiong He

Large Language Models (LLMs) are adept at generating responses based on information within their context. While this ability is useful for interacting with structured data like code files, another popular method, Retrieval-Augmented…

Computation and Language · Computer Science 2025-10-22 Mihir Gupte , Paolo Giusto , Ramesh S

Retrieval-augmented generation (RAG) has become a cornerstone of contemporary NLP, enhancing large language models (LLMs) by allowing them to access richer factual contexts through in-context retrieval. While effective in monolingual…

Computation and Language · Computer Science 2026-03-31 Leonardo Ranaldi , Barry Haddow , Alexandra Birch

We present a systematic investigation of Multi-modal Retrieval Augmented Multi-modal Generation (M$^2$RAG), a novel task that enables foundation models to process multi-modal web content and generate multi-modal responses, which exhibits…

Computation and Language · Computer Science 2025-05-26 Zi-Ao Ma , Tian Lan , Rong-Cheng Tu , Yong Hu , Yu-Shi Zhu , Tong Zhang , Heyan Huang , Zhijing Wu , Xian-Ling Mao