中文
相关论文

相关论文: A Graph-based Approach for Multi-Modal Question An…

200 篇论文

Retrieval-augmented generation (RAG) has emerged to address the knowledge-intensive visual question answering (VQA) task. Current methods mainly employ separate retrieval and generation modules to acquire external knowledge and generate…

计算机视觉与模式识别 · 计算机科学 2025-02-25 Xinwei Long , Zhiyuan Ma , Ermo Hua , Kaiyan Zhang , Biqing Qi , Bowen Zhou

Answering questions that require reasoning and aggregation across both structured (tables) and unstructured (raw text) data sources presents significant challenges. Current methods rely on fine-tuning and high-quality, human-curated data,…

计算与语言 · 计算机科学 2025-01-30 Ankush Agarwal , Ganesh S , Chaitanya Devaguptapu

Despite the impressive advancements of Large Language Models (LLMs) in generating text, they are often limited by the knowledge contained in the input and prone to producing inaccurate or hallucinated content. To tackle these issues,…

信息检索 · 计算机科学 2024-05-29 Yu Wang , Nedim Lipka , Ruiyi Zhang , Alexa Siu , Yuying Zhao , Bo Ni , Xin Wang , Ryan Rossi , Tyler Derr

Retrieval-Augmented Generation (RAG) improves Large Language Models (LLMs) by retrieving supporting documents into the prompt, but existing methods do not explicitly target queries that require fetching multiple documents with substantially…

Retrieval-Augmented Generation (RAG) is a powerful strategy for improving the factual accuracy of models by retrieving external knowledge relevant to queries and incorporating it into the generation process. However, existing approaches…

计算机视觉与模式识别 · 计算机科学 2025-05-30 Soyeong Jeong , Kangsan Kim , Jinheon Baek , Sung Ju Hwang

Open Domain Question Answering (QA) is evolving from complex pipelined systems to end-to-end deep neural networks. Specialized neural models have been developed for extracting answers from either text alone or Knowledge Bases (KBs) alone.…

计算与语言 · 计算机科学 2018-09-05 Haitian Sun , Bhuwan Dhingra , Manzil Zaheer , Kathryn Mazaitis , Ruslan Salakhutdinov , William W. Cohen

Naive Retrieval-Augmented Generation (RAG) focuses on individual documents during retrieval and, as a result, falls short in handling networked documents which are very popular in many applications such as citation graphs, social media, and…

机器学习 · 计算机科学 2025-07-15 Yuntong Hu , Zhihan Lei , Zheng Zhang , Bo Pan , Chen Ling , Liang Zhao

Text-based Question Answering (QA) is a challenging task which aims at finding short concrete answers for users' questions. This line of research has been widely studied with information retrieval techniques and has received increasing…

信息检索 · 计算机科学 2020-05-28 Zahra Abbasiantaeb , Saeedeh Momtazi

Retrieval-Augmented Generation (RAG) has emerged as a promising technique to enhance the quality and relevance of responses generated by large language models. While recent advancements have mainly focused on improving RAG for text-based…

计算与语言 · 计算机科学 2025-09-30 Ainulla Khan , Yamada Moyuru , Srinidhi Akella

Reliably determining the performance of Retrieval-Augmented Generation (RAG) systems depends on comprehensive test questions. While a proliferation of evaluation frameworks for LLM-powered applications exists, current practices lack a…

机器学习 · 计算机科学 2025-10-02 Noah Broestl , Adel Nasser Abdalla , Rajprakash Bale , Hersh Gupta , Max Struever

This study introduces a system leveraging Large Language Models (LLMs) to extract text and enhance user interaction with PDF documents via a conversational interface. Utilizing Retrieval-Augmented Generation (RAG), the system provides…

信息检索 · 计算机科学 2025-02-20 Soham Roy , Mitul Goswami , Nisharg Nargund , Suneeta Mohanty , Prasant Kumar Pattnaik

Graph-based Retrieval-Augmented Generation (GraphRAG) extends traditional RAG by using knowledge graphs (KGs) to give large language models (LLMs) a structured, semantically coherent context, yielding more grounded answers. However,…

人工智能 · 计算机科学 2026-04-28 Zhuoling Li , Ha Linh Hong Tran Nguyen , Valeria Bladinieres , Maxim Romanovsky

Retrieval-Augmented Generation (RAG) has recently demonstrated the performance of Large Language Models (LLMs) in the knowledge-intensive tasks such as Question-Answering (QA). RAG expands the query context by incorporating external…

机器学习 · 计算机科学 2024-06-18 Zijian Hei , Weiling Liu , Wenjie Ou , Juyi Qiao , Junming Jiao , Guowen Song , Ting Tian , Yi Lin

Multimodal large language models (MLLMs), such as GPT-4o, Gemini, LLaVA, and Flamingo, have made significant progress in integrating visual and textual modalities, excelling in tasks like visual question answering (VQA), image captioning,…

计算机视觉与模式识别 · 计算机科学 2024-12-31 Junxiao Xue , Quan Deng , Fei Yu , Yanhao Wang , Jun Wang , Yuehua Li

Visual Question answering is a challenging problem requiring a combination of concepts from Computer Vision and Natural Language Processing. Most existing approaches use a two streams strategy, computing image and question features that are…

计算机视觉与模式识别 · 计算机科学 2018-11-02 Will Norcliffe-Brown , Efstathios Vafeias , Sarah Parisot

Retrieval-augmented Large Language Models (LLMs) have reshaped traditional query-answering systems, offering unparalleled user experiences. However, existing retrieval techniques often struggle to handle multi-modal query contexts. In this…

数据库 · 计算机科学 2024-07-08 Mengzhao Wang , Haotian Wu , Xiangyu Ke , Yunjun Gao , Xiaoliang Xu , Lu Chen

Graph-based Retrieval-augmented generation (RAG) has become a widely studied approach for improving the reasoning, accuracy, and factuality of Large Language Models (LLMs). However, many existing graph-based RAG systems overlook the high…

人工智能 · 计算机科学 2025-11-11 Qiao Xiao , Hong Ting Tsang , Jiaxin Bai

Building codes contain critical information for ensuring safety, regulatory compliance, and informed decision-making in construction and engineering. Automated question answering systems over such codes enable quick and accurate access to…

计算与语言 · 计算机科学 2025-11-25 Mohammad Aqib , Mohd Hamza , Ying Hei Chui , Qipei Mei

This study aims to optimize the existing retrieval-augmented generation model (RAG) by introducing a graph structure to improve the performance of the model in dealing with complex knowledge reasoning tasks. The traditional RAG model has…

信息检索 · 计算机科学 2024-11-07 Yuxin Dong , Shuo Wang , Hongye Zheng , Jiajing Chen , Zhenhong Zhang , Chihang Wang

Retrieval-Augmented Generation (RAG) enhances the factual grounding of Large Language Models by conditioning their outputs on external documents. However, standard embedding-based retrievers treat naturally structured corpora, such as…