English
Related papers

Related papers: Hierarchical Retrieval-Augmented Generation Model …

200 papers

Retrieval-augmented generation (RAG) is a promising method for addressing some of the memory-related challenges associated with Large Language Models (LLMs). Two separate systems form the RAG pipeline, the retriever and the reader, and the…

Computation and Language · Computer Science 2024-11-13 Alexandria Leto , Cecilia Aguerrebere , Ishwar Bhati , Ted Willke , Mariano Tepper , Vy Ai Vo

Retrieval-augmented generation (RAG) has shown promising results in enhancing Q&A by incorporating information from the web and other external sources. However, the supporting documents retrieved from the heterogeneous web often originate…

Computation and Language · Computer Science 2026-03-26 Kaize Shi , Xueyao Sun , Qika Lin , Firoj Alam , Qing Li , Xiaohui Tao , Guandong Xu

Community Question Answering (CQA) platforms can be deemed as important knowledge bases in community, but effectively leveraging historical interactions and domain knowledge in real-time remains a challenge. Existing methods often…

Computation and Language · Computer Science 2025-07-02 Qinwen Chen , Wenbiao Tao , Zhiwei Zhu , Mingfan Xi , Liangzhong Guo , Yuan Wang , Wei Wang , Yunshi Lan

Retrieval-Augmented Generation (RAG) over Knowledge Graphs (KGs) suffers from the fact that indexing approaches may lose important contextual nuance when text is reduced to triples, thereby degrading performance in downstream…

Computation and Language · Computer Science 2026-03-13 Riccardo Campi , Nicolò Oreste Pinciroli Vago , Mathyas Giudici , Marco Brambilla , Piero Fraternali

We revisit retrieval-augmented generation (RAG) by embedding retrieval control directly into generation. Instead of treating retrieval as an external intervention, we express retrieval decisions within token-level decoding, enabling…

Computation and Language · Computer Science 2026-04-21 Bo Li , Mingda Wang , Gexiang Fang , Shikun Zhang , Wei Ye

Multi-hop Question Answering (MHQA) aims to answer questions that require multi-step reasoning. It presents two key challenges: generating correct reasoning paths in response to the complex user queries, and accurately retrieving essential…

Computation and Language · Computer Science 2026-04-28 Yuqing Fu , Yimin Deng , Wanyu Wang , Yuhao Wang , Yejing Wang , Hongshi Liu , Yiqi Wang , Xiao Han , Maolin Wang , Guoshuai Zhao , Yi Chang , Xiangyu Zhao

Retrieval-augmented generation (RAG) for language models significantly improves language understanding systems. The basic retrieval-then-read pipeline of response generation has evolved into a more extended process due to the integration of…

Computation and Language · Computer Science 2025-04-22 Yunxiao Shi , Xing Zi , Zijing Shi , Haimin Zhang , Qiang Wu , Min Xu

In recent years, large language models (LLMs) have made remarkable achievements in various domains. However, the untimeliness and cost of knowledge updates coupled with hallucination issues of LLMs have curtailed their applications in…

Machine Learning · Computer Science 2024-05-31 Chunjing Gan , Dan Yang , Binbin Hu , Hanxiao Zhang , Siyuan Li , Ziqi Liu , Yue Shen , Lin Ju , Zhiqiang Zhang , Jinjie Gu , Lei Liang , Jun Zhou

Proprietary corporate documents contain rich domain-specific knowledge, but their overwhelming volume and disorganized structure make it difficult even for employees to access the right information when needed. For example, in the…

Artificial Intelligence · Computer Science 2025-08-28 Nayoung Choi , Grace Byun , Andrew Chung , Ellie S. Paek , Shinsun Lee , Jinho D. Choi

Retrieval-based multimodal document QA aims to identify and integrate relevant information from visually rich documents with complex multimodal structures. While retrieval-augmented generation (RAG) has shown strong performance in…

Information Retrieval · Computer Science 2026-04-21 Hui Wu , Haoquan Zhai , Yuchen Li , Hengyi Cai , Peirong Zhang , Yidan Zhang , Lei Wang , Chunle Wang , Yingyan Hou , Shuaiqiang Wang , Dawei Yin

Recent advancements in Large Language Models have transformed ML/AI development, necessitating a reevaluation of AutoML principles for the Retrieval-Augmented Generation (RAG) systems. To address the challenges of hyper-parameter…

Computation and Language · Computer Science 2024-06-28 Jia Fu , Xiaoting Qin , Fangkai Yang , Lu Wang , Jue Zhang , Qingwei Lin , Yubo Chen , Dongmei Zhang , Saravan Rajmohan , Qi Zhang

We present TopClustRAG, a retrieval-augmented generation (RAG) system developed for the LiveRAG Challenge, which evaluates end-to-end question answering over large-scale web corpora. Our system employs a hybrid retrieval strategy combining…

Computation and Language · Computer Science 2025-06-19 Juli Bakagianni , John Pavlopoulos , Aristidis Likas

Multimodal Large Language Models (MLLMs) have shown impressive capabilities in jointly understanding text, images, and videos, often evaluated via Visual Question Answering (VQA). However, even state-of-the-art MLLMs struggle with…

Computer Vision and Pattern Recognition · Computer Science 2026-04-01 Alberto Compagnoni , Marco Morini , Sara Sarto , Federico Cocchi , Davide Caffagni , Marcella Cornia , Lorenzo Baraldi , Rita Cucchiara

Retrieval-augmented generation (RAG) systems offer a promising approach to reduce hallucinations and improve answer accuracy in large language models (LLMs), a requirement for reliable, financial analysis where answers must be grounded in…

Machine Learning · Computer Science 2026-05-26 Magnus Samuelsen , Wilmer Nyström , Somnath Mazumdar , Mansoor Hussain , Mikkel Strange

The growing demand for efficient and lightweight Retrieval-Augmented Generation (RAG) systems has highlighted significant challenges when deploying Small Language Models (SLMs) in existing RAG frameworks. Current approaches face severe…

Artificial Intelligence · Computer Science 2025-01-28 Tianyu Fan , Jingyuan Wang , Xubin Ren , Chao Huang

Advanced Multimodal Large Language Models (MLLMs) struggle with recent Knowledge-based VQA tasks, such as INFOSEEK and Encyclopedic-VQA, due to their limited and frozen knowledge scope, often leading to ambiguous and inaccurate responses.…

Artificial Intelligence · Computer Science 2024-11-25 Tao Zhang , Ziqi Zhang , Zongyang Ma , Yuxin Chen , Zhongang Qi , Chunfeng Yuan , Bing Li , Junfu Pu , Yuxuan Zhao , Zehua Xie , Jin Ma , Ying Shan , Weiming Hu

Existing studies have optimized retrieval-augmented generation (RAG) across various sub-tasks, such as query understanding and retrieval refinement, but integrating these optimizations into a unified framework remains challenging. To tackle…

Computation and Language · Computer Science 2025-05-22 Yutao Zhu , Jiajie Jin , Hongjin Qian , Zheng Liu , Zhicheng Dou , Ji-Rong Wen

Retrieval-Augmented Generation (RAG) has emerged as a powerful approach for grounding Large Language Model (LLM)-based chatbot responses on external knowledge. However, existing RAG studies typically assume well-structured textual sources…

Computation and Language · Computer Science 2026-02-13 Sungmoon Kim , Hyuna Jeon , Dahye Kim , Mingyu Kim , Dong-Kyu Chae , Jiwoong Kim

Large Language Models (LLMs) exhibit remarkable capabilities but are prone to generating inaccurate or hallucinatory responses. This limitation stems from their reliance on vast pretraining datasets, making them susceptible to errors in…

Computation and Language · Computer Science 2024-04-02 Chi-Min Chan , Chunpu Xu , Ruibin Yuan , Hongyin Luo , Wei Xue , Yike Guo , Jie Fu

Multimodal Retrieval-Augmented Generation (MRAG) enhances large language models (LLMs) by integrating multimodal data (text, images, videos) into retrieval and generation processes, overcoming the limitations of text-only…

Information Retrieval · Computer Science 2025-04-15 Lang Mei , Siyu Mo , Zhihan Yang , Chong Chen