中文
相关论文

相关论文: Towards Mixed-Modal Retrieval for Universal Retrie…

200 篇论文

Retrieval-Augmented Generation (RAG) is a prevalent approach to infuse a private knowledge base of documents with Large Language Models (LLM) to build Generative Q\&A (Question-Answering) systems. However, RAG accuracy becomes increasingly…

信息检索 · 计算机科学 2025-03-10 Kunal Sawarkar , Abhilasha Mangal , Shivam Raj Solanki

The advent of Large Language Models has revolutionized information retrieval, ushering in a new era of expansive knowledge accessibility. While these models excel in providing open-world knowledge, effectively extracting answers in diverse…

信息检索 · 计算机科学 2024-01-04 Syed Rameel Ahmad

Financial documents--such as 10-Ks, 10-Qs, and investor presentations--span hundreds of pages and combine diverse modalities, including dense narrative text, structured tables, and complex figures. Answering questions over such content…

计算与语言 · 计算机科学 2026-04-13 Chinmay Gondhalekar , Urjitkumar Patel , Fang-Chun Yeh

The scaling of large language models to encode all the world's knowledge in model parameters is unsustainable and has exacerbated resource barriers. Retrieval-Augmented Generation (RAG) presents a potential solution, yet its application to…

计算机视觉与模式识别 · 计算机科学 2024-06-28 Varun Nagaraj Rao , Siddharth Choudhary , Aditya Deshpande , Ravi Kumar Satzoda , Srikar Appalaraju

Understanding information from a collection of multiple documents, particularly those with visually rich elements, is important for document-grounded question answering. This paper introduces VisDoMBench, the first comprehensive benchmark…

计算与语言 · 计算机科学 2025-02-12 Manan Suri , Puneet Mathur , Franck Dernoncourt , Kanika Goswami , Ryan A. Rossi , Dinesh Manocha

Retrieval-Augmented Generation (RAG) has recently demonstrated the performance of Large Language Models (LLMs) in the knowledge-intensive tasks such as Question-Answering (QA). RAG expands the query context by incorporating external…

机器学习 · 计算机科学 2024-06-18 Zijian Hei , Weiling Liu , Wenjie Ou , Juyi Qiao , Junming Jiao , Guowen Song , Ting Tian , Yi Lin

While language Models store a massive amount of world knowledge implicitly in their parameters, even very large models often fail to encode information about rare entities and events, while incurring huge computational costs. Recently,…

计算与语言 · 计算机科学 2022-10-21 Wenhu Chen , Hexiang Hu , Xi Chen , Pat Verga , William W. Cohen

Retrieval-Augmented Generation (RAG) enables Large Language Models (LLMs) to extend their existing knowledge by dynamically incorporating external information. However, practical deployment is fundamentally constrained by the LLM's finite…

信息检索 · 计算机科学 2026-03-24 Jiarui Guo , Yuemeng Xu , Zongwei Lv , Yangyujia Wang , Xiaolin Wang , Kan Liu , Tao Lan , Lin Qu , Tong Yang

Naive Retrieval-Augmented Generation (RAG) focuses on individual documents during retrieval and, as a result, falls short in handling networked documents which are very popular in many applications such as citation graphs, social media, and…

机器学习 · 计算机科学 2025-07-15 Yuntong Hu , Zhihan Lei , Zheng Zhang , Bo Pan , Chen Ling , Liang Zhao

Retrieval-Augmented Generation (RAG) has emerged as a powerful paradigm to enhance large language models (LLMs) by conditioning generation on external evidence retrieved at inference time. While RAG addresses critical limitations of…

信息检索 · 计算机科学 2025-06-03 Chaitanya Sharma

The evolution of digital manufacturing requires intelligent Question Answering (QA) systems that can seamlessly integrate and analyze complex multi-modal data, such as text, images, formulas, and tables. Conventional Retrieval Augmented…

计算工程、金融与科学 · 计算机科学 2026-01-27 Yunqing Li , Zihan Dong , Farhad Ameri , Jianbang Zhang

Large language models equipped with retrieval-augmented generation (RAG) represent a burgeoning field aimed at enhancing answering capabilities by leveraging external knowledge bases. Although the application of RAG with language-only…

计算机视觉与模式识别 · 计算机科学 2024-06-03 Cheng Tan , Jingxuan Wei , Linzhuang Sun , Zhangyang Gao , Siyuan Li , Bihui Yu , Ruifeng Guo , Stan Z. Li

Retrieval-Augmented Generation (RAG) systems enhance large language models (LLMs) by integrating external knowledge sources, enabling more accurate and contextually relevant responses tailored to user needs. However, existing RAG systems…

信息检索 · 计算机科学 2025-04-29 Zirui Guo , Lianghao Xia , Yanhua Yu , Tu Ao , Chao Huang

We propose XRAG, a novel benchmark designed to evaluate the generation abilities of LLMs in cross-lingual Retrieval-Augmented Generation (RAG) settings where the user language does not match the retrieval results. XRAG is constructed from…

计算与语言 · 计算机科学 2025-05-16 Wei Liu , Sony Trenous , Leonardo F. R. Ribeiro , Bill Byrne , Felix Hieber

Retrieval-Augmented Generation (RAG) is an effective method to enhance the capabilities of large language models (LLMs). Existing methods typically optimize the retriever or the generator in a RAG system by directly using the top-k…

计算与语言 · 计算机科学 2025-10-07 Shaohan Wang , Licheng Zhang , Zheren Fu , Zhendong Mao , Yongdong Zhang

Retrieval-Augmented Generation (RAG) has become a pivotal paradigm for Large Language Models (LLMs), yet current approaches struggle with visually rich documents by treating text and images as isolated retrieval targets. Existing methods…

计算与语言 · 计算机科学 2026-01-13 Xuan Li , Yining Wang , Haocai Luo , Shengping Liu , Jerry Liang , Ying Fu , Weihuang , Jun Yu , Junnan Zhu

Retrieval-Augmented Generation (RAG) is a technique that enhances the capabilities of large language models (LLMs) by incorporating external knowledge sources. This method addresses common LLM limitations, including outdated information and…

计算与语言 · 计算机科学 2024-07-16 Yuanjie Lyu , Zhiyu Li , Simin Niu , Feiyu Xiong , Bo Tang , Wenjin Wang , Hao Wu , Huanyong Liu , Tong Xu , Enhong Chen

Retrieval-augmented generation (RAG) has emerged as a pivotal method for expanding the knowledge of large language models. To handle complex queries more effectively, researchers developed Adaptive-RAG (A-RAG) to enhance the generated…

人工智能 · 计算机科学 2025-05-27 Jie Ou , Jinyu Guo , Shuaihong Jiang , Zhaokun Wang , Libo Qin , Shunyu Yao , Wenhong Tian

Vision-language models (VLMs) have achieved strong performance in visual question answering (VQA), yet they remain constrained by static training data. Retrieval-Augmented Generation (RAG) mitigates this limitation by enabling access to…

计算与语言 · 计算机科学 2026-03-24 David Anugraha , Patrick Amadeus Irawan , Anshul Singh , En-Shiun Annie Lee , Genta Indra Winata

Document understanding is critical for applications from financial analysis to scientific discovery. Current approaches, whether OCR-based pipelines feeding Large Language Models (LLMs) or native Multimodal LLMs (MLLMs), face key…