中文
相关论文

相关论文: A Graph-based Approach for Multi-Modal Question An…

200 篇论文

Retrieval Augmented Generation (RAG) is widely used to enable Large Language Models (LLMs) perform Question Answering (QA) tasks in various domains. However, RAG based on open-source LLM for specialized domains has challenges of evaluating…

计算与语言 · 计算机科学 2024-07-23 Sujoy Roychowdhury , Sumit Soman , H G Ranjani , Neeraj Gunda , Vansh Chhabra , Sai Krishna Bala

We introduce a novel retrieval-augmented generation (RAG) framework tailored for multihop question answering. First, our system uses large language model (LLM) to decompose complex multihop questions into a sequence of single-hop…

计算与语言 · 计算机科学 2025-08-14 Seokgi Lee

Recent literature highlights the potential of graph-based approaches within large language model (LLM) retrieval-augmented generation (RAG) pipelines for answering queries of varying complexity, particularly those that fall outside the…

信息检索 · 计算机科学 2026-04-24 Isabela Iacob , Melisa Marian , Gheorghe Cosmin Silaghi

Visual Question Answering (VQA) focuses on providing answers to natural language questions by utilizing information from images. Although cutting-edge multimodal large language models (MLLMs) such as GPT-4o achieve strong performance on VQA…

计算机视觉与模式识别 · 计算机科学 2025-07-09 Zhengxuan Zhang , Yin Wu , Yuyu Luo , Nan Tang

Large Language Models (LLMs) have immense potential to transform the telecommunications industry. They could help professionals understand complex standards, generate code, and accelerate development. However, traditional LLMs struggle with…

网络与互联网体系结构 · 计算机科学 2024-06-12 Girma M. Yilma , Jose A. Ayala-Romero , Andres Garcia-Saavedra , Xavier Costa-Perez

Incorporating external knowledge bases in traditional retrieval-augmented generation (RAG) relies on parsing the document, followed by querying a language model with the parsed information via in-context learning. While effective for…

计算与语言 · 计算机科学 2026-02-03 Jacob Si , Mike Qu , Michelle Lee , Marek Rei , Yingzhen Li

Large language models have shown remarkable language processing and reasoning ability but are prone to hallucinate when asked about private data. Retrieval-augmented generation (RAG) retrieves relevant data that fit into an LLM's context…

机器学习 · 计算机科学 2025-11-13 Alfred Clemedtson , Borun Shi

Vision-Language Models (VLMs) have emerged as versatile solutions for zero-shot question answering (QA) across various domains. However, enabling VLMs to effectively comprehend structured graphs and perform accurate, efficient QA remains…

计算机视觉与模式识别 · 计算机科学 2026-02-26 Yanbin Wei , Jiangyue Yan , Chun Kang , Yang Chen , Hua Liu , James Kwok , Yu Zhang

Graph-based retrieval-augmented generation (RAG) enriches large language models (LLMs) with external knowledge for long-context understanding and multi-hop reasoning, but existing methods face a granularity dilemma: fine-grained…

计算与语言 · 计算机科学 2025-09-26 Yaxiong Wu , Jianyuan Bo , Yongyue Zhang , Sheng Liang , Yong Liu

We introduce a novel graph-based Retrieval-Augmented Generation (RAG) framework specifically designed for the medical domain, called \textbf{MedGraphRAG}, aimed at enhancing Large Language Model (LLM) capabilities for generating…

计算机视觉与模式识别 · 计算机科学 2024-10-17 Junde Wu , Jiayuan Zhu , Yunli Qi , Jingkun Chen , Min Xu , Filippo Menolascina , Vicente Grau

Document Question Answering (QA) presents a challenge in understanding visually-rich documents (VRD), particularly those dominated by lengthy textual content like research journal articles. Existing studies primarily focus on real-world…

计算机视觉与模式识别 · 计算机科学 2024-04-22 Yihao Ding , Kaixuan Ren , Jiabin Huang , Siwen Luo , Soyeon Caren Han

Question-answering (QA) is an important application of Information Retrieval (IR) and language models, and the latest trend is toward pre-trained large neural networks with embedding parameters. Augmenting QA performances with these LLMs…

信息检索 · 计算机科学 2024-11-05 Lixiao Yang , Mengyang Xu , Weimao Ke

Retrieval-Augmented Generation (RAG) has proven effective in integrating external knowledge into large language models (LLMs) for solving question-answer (QA) tasks. The state-of-the-art RAG approaches often use the graph data as the…

信息检索 · 计算机科学 2026-05-12 Shu Wang , Yixiang Fang , Yingli Zhou , Xilin Liu , Yuchi Ma

This work presents a novel architecture for building Retrieval-Augmented Generation (RAG) systems to improve Question Answering (QA) tasks from a target corpus. Large Language Models (LLMs) have revolutionized the analyzing and generation…

计算与语言 · 计算机科学 2025-01-09 Binita Saha , Utsha Saha , Muhammad Zubair Malik

Visual Query Answering (VQA) is of great significance in offering people convenience: one can raise a question for details of objects, or high-level understanding about the scene, over an image. This paper proposes a novel method to address…

计算机视觉与模式识别 · 计算机科学 2019-03-19 Peixi Xiong , Huayi Zhan , Xin Wang , Baivab Sinha , Ying Wu

Retrieval-Augmented Generation (RAG) improves large language models (LLMs) by retrieving relevant information from external sources and has been widely adopted for text-based tasks. For structured data, such as knowledge graphs, Graph…

信息检索 · 计算机科学 2026-03-05 Haoyu Han , Li Ma , Yu Wang , Harry Shomer , Yongjia Lei , Zhisheng Qi , Kai Guo , Zhigang Hua , Bo Long , Hui Liu , Charu C. Aggarwal , Jiliang Tang

Large language models (LLMs) are transforming the way information is retrieved with vast amounts of knowledge being summarized and presented via natural language conversations. Yet, LLMs are prone to highlight the most frequently seen…

计算与语言 · 计算机科学 2024-02-20 Julien Delile , Srayanta Mukherjee , Anton Van Pamel , Leonid Zhukov

Retrieval Augmented Generation (RAG) provides the necessary informational grounding to LLMs in the form of chunks retrieved from a vector database or through web search. RAG could also use knowledge graph triples as a means of providing…

信息检索 · 计算机科学 2026-03-31 Shalin Shah , Srikanth Ryali , Ramasubbu Venkatesh

This paper presents a question answering system that operates exclusively on a knowledge graph retrieval without relying on retrieval augmented generation (RAG) with large language models (LLMs). Instead, a small paraphraser model is used…

计算与语言 · 计算机科学 2025-10-23 Kartikeya Aneja , Manasvi Srivastava , Subhayan Das , Nagender Aneja

Fact-based Visual Question Answering (FVQA), a challenging variant of VQA, requires a QA-system to include facts from a diverse knowledge graph (KG) in its reasoning process to produce an answer. Large KGs, especially common-sense KGs, are…

计算与语言 · 计算机科学 2021-06-22 Kiran Ramnath , Mark Hasegawa-Johnson