English
Related papers

Related papers: Enhancing Multi-modal and Multi-hop Question Answe…

200 papers

Multi-Hop Question Answering (MHQA) tasks permeate real-world applications, posing challenges in orchestrating multi-step reasoning across diverse knowledge domains. While existing approaches have been improved with iterative retrieval,…

Machine Learning · Computer Science 2025-10-06 Rong Cheng , Jinyi Liu , Yan Zheng , Fei Ni , Jiazhen Du , Hangyu Mao , Fuzheng Zhang , Bo Wang , Jianye Hao

Retrieval-Augmented Generation (RAG) has been used in question answering (QA) systems to improve performance when relevant information is in one (single-hop) or multiple (multi-hop) passages. However, many real life scenarios (e.g. dealing…

Computation and Language · Computer Science 2026-04-02 Mykolas Sveistrys , Richard Kunert

Given a semi-structured knowledge base (SKB), where text documents are interconnected by relations, how can we effectively retrieve relevant information to answer user questions? Retrieval-Augmented Generation (RAG) retrieves documents to…

Multi-hop question answering is widely used to evaluate the reasoning capabilities of large language models (LLMs), as it requires integrating multiple pieces of supporting knowledge to arrive at a correct answer. While prior work has…

Computation and Language · Computer Science 2026-01-13 Zhuoyi Yang , Yurun Song , Iftekhar Ahmed , Ian Harris

Financial documents--such as 10-Ks, 10-Qs, and investor presentations--span hundreds of pages and combine diverse modalities, including dense narrative text, structured tables, and complex figures. Answering questions over such content…

Computation and Language · Computer Science 2026-04-13 Chinmay Gondhalekar , Urjitkumar Patel , Fang-Chun Yeh

Vision-language retrieval-augmented generation (RAG) has become an effective approach for tackling Knowledge-Based Visual Question Answering (KB-VQA), which requires external knowledge beyond the visual content presented in images. The…

Information Retrieval · Computer Science 2025-09-15 Wei Yang , Jingjing Fu , Rui Wang , Jinyu Wang , Lei Song , Jiang Bian

With the rise of generative paradigms, generative recommendation has garnered increasing attention. The core component is the item code, generally derived by quantizing collaborative or semantic representations to serve as candidate items…

Information Retrieval · Computer Science 2025-12-16 Longtao Xiao , Haozhao Wang , Cheng Wang , Linfei Ji , Yifan Wang , Jieming Zhu , Zhenhua Dong , Rui Zhang , Ruixuan Li

Retrieval-Augmented Generation (RAG) has become a standard approach for knowledge-intensive question answering, but existing systems remain brittle on multi-hop questions, where solving the task requires chaining multiple retrieval and…

In many real-world settings, machine learning models and interactive systems have access to both structured knowledge, e.g., knowledge graphs or tables, and unstructured content, e.g., natural language documents. Yet, most rely on either.…

Information Retrieval · Computer Science 2026-05-15 Derian Boer , Stephen Roth , Stefan Kramer

Intelligent personal assistant systems that are able to have multi-turn conversations with human users are becoming increasingly popular. Most previous research has been focused on using either retrieval-based or generation-based methods to…

Information Retrieval · Computer Science 2019-08-27 Liu Yang , Junjie Hu , Minghui Qiu , Chen Qu , Jianfeng Gao , W. Bruce Croft , Xiaodong Liu , Yelong Shen , Jingjing Liu

Retrieval-augmented generation (RAG) methods encounter difficulties when addressing complex questions like multi-hop queries. While iterative retrieval methods improve performance by gathering additional information, current approaches…

Computation and Language · Computer Science 2024-09-27 Ziyuan Zhuang , Zhiyang Zhang , Sitao Cheng , Fangkai Yang , Jia Liu , Shujian Huang , Qingwei Lin , Saravan Rajmohan , Dongmei Zhang , Qi Zhang

Natural language question answering (QA) over structured data sources such as tables and knowledge graphs have been widely investigated, especially with Large Language Models (LLMs) in recent years. The main solutions include question to…

Computation and Language · Computer Science 2024-12-16 Wen Zhang , Long Jin , Yushan Zhu , Jiaoyan Chen , Zhiwei Huang , Junjie Wang , Yin Hua , Lei Liang , Huajun Chen

Fusion-in-decoder (Fid) (Izacard and Grave, 2020) is a generative question answering (QA) model that leverages passage retrieval with a pre-trained transformer and pushed the state of the art on single-hop QA. However, the complexity of…

Computation and Language · Computer Science 2022-05-20 Semih Yavuz , Kazuma Hashimoto , Yingbo Zhou , Nitish Shirish Keskar , Caiming Xiong

Multi-hop query answering over a Knowledge Graph (KG) involves traversing one or more hops from the start node to answer a query. Path-based and logic-based methods are state-of-the-art for multi-hop question answering. The former is used…

Artificial Intelligence · Computer Science 2025-06-12 Mayank Kharbanda , Rajiv Ratn Shah , Raghava Mutharaju

Open-domain Question Answering (QA) has garnered substantial interest by combining the advantages of faithfully retrieved passages and relevant passages generated through Large Language Models (LLMs). However, there is a lack of definitive…

Computation and Language · Computer Science 2024-12-30 Xinkai Du , Quanjie Han , Chao Lv , Yan Liu , Yalin Sun , Hao Shu , Hongbo Shan , Maosong Sun

Multi-modal knowledge graphs (MKGs) include not only the relation triplets, but also related multi-modal auxiliary data (i.e., texts and images), which enhance the diversity of knowledge. However, the natural incompleteness has…

Artificial Intelligence · Computer Science 2022-09-07 Shangfei Zheng , Weiqing Wang , Jianfeng Qu , Hongzhi Yin , Wei Chen , Lei Zhao

Retrieval-Augmented Generation (RAG) over Knowledge Graphs (KGs) suffers from the fact that indexing approaches may lose important contextual nuance when text is reduced to triples, thereby degrading performance in downstream…

Computation and Language · Computer Science 2026-03-13 Riccardo Campi , Nicolò Oreste Pinciroli Vago , Mathyas Giudici , Marco Brambilla , Piero Fraternali

Recent advancements in retrieval-augmented generation (RAG) have demonstrated impressive performance in the question-answering (QA) task. However, most previous works predominantly focus on text-based answers. While some studies address…

Information Retrieval · Computer Science 2025-02-10 Zhengyuan Zhu , Daniel Lee , Hong Zhang , Sai Sree Harsha , Loic Feujio , Akash Maharaj , Yunyao Li

Retrieval-Augmented Generation (RAG) has become the dominant approach for answering questions over large corpora. However, current datasets and methods are highly focused on cases where only a small part of the corpus (usually a few…

Computation and Language · Computer Science 2025-11-12 Omri Koshorek , Niv Granot , Aviv Alloni , Shahar Admati , Roee Hendel , Ido Weiss , Alan Arazi , Shay-Nitzan Cohen , Yonatan Belinkov

Retrieval-augmented generation has gained significant attention due to its ability to integrate relevant external knowledge, enhancing the accuracy and reliability of the LLMs' responses. Most of the existing methods apply a dynamic…

Computation and Language · Computer Science 2025-01-13 Liang Xiao , Wen Dai , Shuai Chen , Bin Qin , Chongyang Shi , Haopeng Jing , Tianyu Guo