English
Related papers

Related papers: Enhancing Multi-modal and Multi-hop Question Answe…

200 papers

This work deals with the challenge of learning and reasoning over multi-modal multi-hop question answering (QA). We propose a graph reasoning network based on the semantic structure of the sentences to learn multi-source reasoning paths and…

Computation and Language · Computer Science 2025-01-09 Navya Yarrabelly , Saloni Mittal

Retrieval Augmented Generation (RAG) has gradually emerged as a promising paradigm for enhancing the accuracy and factual consistency of content generated by large language models (LLMs). However, existing RAG studies primarily focus on…

Information Retrieval · Computer Science 2025-07-24 Qikai Wei , Huansheng Ning , Chunlong Han , Jianguo Ding

Building training-ready multi-hop question answering (QA) datasets that truly stress a model's retrieval and reasoning abilities remains highly challenging recently. While there have been a few recent evaluation datasets that capture the…

Artificial Intelligence · Computer Science 2025-11-26 Bingsen Qiu , Zijian Liu , Xiao Liu , Bingjie Wang , Feier Zhang , Yixuan Qin , Chunyan Li , Haoshen Yang , Zeren Gao

Retrieval-Augmented Generation (RAG) grounds language models in external evidence, but multi-hop question answering remains difficult because iterative pipelines must control what to retrieve next and when the available evidence is…

Information Retrieval · Computer Science 2026-04-28 Minghan Li , Junjie Zou , Xinxuan Lv , Chao Zhang , Guodong Zhou

Large-scale digitization initiatives have unlocked massive collections of historical newspapers, yet effective computational access remains hindered by OCR corruption, multilingual orthographic variation, and temporal language drift. We…

Digital Libraries · Computer Science 2025-12-16 Anthony Mudet , Souhail Bakkali

Recent advances in Large Language Models (LLMs) have significantly improved complex reasoning capabilities. Retrieval-Augmented Generation (RAG) has further extended these capabilities by grounding generation in dynamically retrieved…

Computation and Language · Computer Science 2026-02-23 Jash Rajesh Parekh , Pengcheng Jiang , Jiawei Han

Large language models augmented with task-relevant documents have demonstrated impressive performance on knowledge-intensive tasks. However, regarding how to obtain effective documents, the existing methods are mainly divided into two…

Computation and Language · Computer Science 2023-10-10 Zhangyin Feng , Xiaocheng Feng , Dezhi Zhao , Maojin Yang , Bing Qin

Retrieval-augmented generation (RAG) systems face significant challenges in multi-hop question answering (MHQA), where complex queries require synthesizing information across multiple document chunks. Existing approaches typically rely on…

Information Retrieval · Computer Science 2025-05-01 Zhonghao Li , Kunpeng Zhang , Jinghuai Ou , Shuliang Liu , Xuming Hu

Retrieval-augmented generation (RAG) has become a key paradigm for knowledge-intensive question answering. However, existing multi-hop RAG systems remain inefficient, as they alternate between retrieval and reasoning at each step, resulting…

Computation and Language · Computer Science 2026-02-06 Hao Yang , Zhiyu Yang , Xupeng Zhang , Wei Wei , Yunjie Zhang , Lin Yang

Question answering (QA) over tables and text has gained much popularity over the years. Multi-hop table-text QA requires multiple hops between the table and text, making it a challenging QA task. Although several works have attempted to…

Computation and Language · Computer Science 2024-10-02 Jayetri Bardhan , Bushi Xiao , Daisy Zhe Wang

Retrieval-augmented generation (RAG) is a key means to effectively enhance large language models (LLMs) in many knowledge-based tasks. However, existing RAG methods struggle with knowledge-intensive reasoning tasks, because useful…

Computation and Language · Computer Science 2024-10-28 Zhuoqun Li , Xuanang Chen , Haiyang Yu , Hongyu Lin , Yaojie Lu , Qiaoyu Tang , Fei Huang , Xianpei Han , Le Sun , Yongbin Li

Obtaining training data for multi-hop question answering (QA) is time-consuming and resource-intensive. We explore the possibility to train a well-performed multi-hop QA model without referencing any human-labeled multi-hop question-answer…

Computation and Language · Computer Science 2021-04-13 Liangming Pan , Wenhu Chen , Wenhan Xiong , Min-Yen Kan , William Yang Wang

Retrieval-Augmented Generation (RAG) has recently been extended to multimodal settings, connecting multimodal large language models (MLLMs) with vast corpora of external knowledge such as multimodal knowledge graphs (MMKGs). Despite their…

Computation and Language · Computer Science 2026-04-14 Hyeongcheol Park , Jiyoung Seo , Jaewon Mun , Hogun Park , Wonmin Byeon , Sung June Kim , Hyeonsoo Im , JeungSub Lee , Sangpil Kim

Large Language Models (LLMs) and Knowledge Graphs (KGs) offer a promising approach to robust and explainable Question Answering (QA). While LLMs excel at natural language understanding, they suffer from knowledge gaps and hallucinations.…

Machine Learning · Computer Science 2025-04-15 Jasper Linders , Jakub M. Tomczak

Multimodal Retrieval Augmented Generation (MMRAG) is a powerful approach to question-answering over multimodal documents. A key challenge with evaluating MMRAG is the paucity of high-quality datasets matching the question styles and…

Computation and Language · Computer Science 2024-10-07 Ian Wu , Sravan Jayanthi , Vijay Viswanathan , Simon Rosenberg , Sina Pakazad , Tongshuang Wu , Graham Neubig

Multimodal Multi-hop question answering requires integrating information from diverse sources, such as images and texts, to derive answers. Existing methods typically rely on sequential retrieval and reasoning, where each step builds on the…

Artificial Intelligence · Computer Science 2025-09-22 Yiheng Hu , Xiaoyang Wang , Qing Liu , Xiwei Xu , Qian Fu , Wenjie Zhang , Liming Zhu

Retrieval-augmented generation (RAG) augments large language models (LLM) by retrieving relevant knowledge, showing promising potential in mitigating LLM hallucinations and enhancing response quality, thereby facilitating the great adoption…

Computation and Language · Computer Science 2024-01-30 Yixuan Tang , Yi Yang

Retrieval-Augmented Generation (RAG) systems are increasingly diverse, yet many suffer from monolithic designs that tightly couple core functions like query reformulation, retrieval, reasoning, and verification. This limits their…

Computation and Language · Computer Science 2025-06-03 Ruofan Wu , Youngwon Lee , Fan Shu , Danmei Xu , Seung-won Hwang , Zhewei Yao , Yuxiong He , Feng Yan

State-of-the-art summarization systems can generate highly fluent summaries. These summaries, however, may contain factual inconsistencies and/or information not present in the source. Hence, an important component of assessing the quality…

Computation and Language · Computer Science 2023-09-11 Potsawee Manakul , Adian Liusie , Mark J. F. Gales

Knowledge retrieval with multi-modal queries plays a crucial role in supporting knowledge-intensive multi-modal applications. However, existing methods face challenges in terms of their effectiveness and training efficiency, especially when…

Information Retrieval · Computer Science 2024-01-17 Xinwei Long , Jiali Zeng , Fandong Meng , Zhiyuan Ma , Kaiyan Zhang , Bowen Zhou , Jie Zhou