中文
相关论文

相关论文: BRIDGE: Benchmark for multi-hop Reasoning In long …

200 篇论文

We introduce a novel retrieval-augmented generation (RAG) framework tailored for multihop question answering. First, our system uses large language model (LLM) to decompose complex multihop questions into a sequence of single-hop…

计算与语言 · 计算机科学 2025-08-14 Seokgi Lee

Existing RAG benchmarks often overlook query difficulty, leading to inflated performance on simpler questions and unreliable evaluations. A robust benchmark dataset must satisfy three key criteria: quality, diversity, and difficulty, which…

信息检索 · 计算机科学 2025-06-02 Jeongsoo Lee , Daeyong Kwon , Kyohoon Jin , Junnyeong Jeong , Minwoo Sim , Minwoo Kim

Multi-hop reasoning (i.e., reasoning across two or more documents) is a key ingredient for NLP models that leverage large corpora to exhibit broad knowledge. To retrieve evidence passages, multi-hop models must contend with a fast-growing…

计算与语言 · 计算机科学 2022-07-12 Omar Khattab , Christopher Potts , Matei Zaharia

With the increasing demand for step-wise, cross-modal, and knowledge-grounded reasoning, multimodal large language models (MLLMs) are evolving beyond the traditional fixed retrieve-then-generate paradigm toward more sophisticated agentic…

人工智能 · 计算机科学 2026-03-03 Xuying Ning , Dongqi Fu , Tianxin Wei , Mengting Ai , Jiaru Zou , Ting-Wei Li , Hanghang Tong , Yada Zhu , Hendrik Hamann , Jingrui He

Recent advancements in table-based reasoning have expanded beyond factoid-level QA to address insight-level tasks, where systems should synthesize implicit knowledge in the table to provide explainable analyses. Although effective, existing…

计算与语言 · 计算机科学 2025-06-03 Kwangwook Seo , Donguk Kwon , Dongha Lee

Multimodal large language models (MLLMs) are increasingly used for real-world tasks involving multi-step reasoning and long-form generation, where reliability requires grounding model outputs in heterogeneous input sources and verifying…

计算与语言 · 计算机科学 2026-05-08 David Wan , Han Wang , Ziyang Wang , Elias Stengel-Eskin , Hyunji Lee , Mohit Bansal

Large language models (LLMs) are increasingly envisioned as decision-support tools in clinical practice, yet safe clinical reasoning demands integrating heterogeneous knowledge bases -- trials, primary studies, regulatory documents, and…

Multi-hop reasoning (MHR) is a process in artificial intelligence and natural language processing where a system needs to make multiple inferential steps to arrive at a conclusion or answer. In the context of knowledge graphs or databases,…

人工智能 · 计算机科学 2024-06-13 Jesmin Jahan Tithi , Fabio Checconi , Fabrizio Petrini

Multi-entity question answering (MEQA) represents significant challenges for large language models (LLM) and retrieval-augmented generation (RAG) systems, which frequently struggle to consolidate scattered information across diverse…

计算与语言 · 计算机科学 2025-09-25 Teng Lin , Yuyu Luo , Honglin Zhang , Jicheng Zhang , Chunlin Liu , Kaishun Wu , Nan Tang

Large language models (LLMs) achieve optimal utility when their responses are grounded in external knowledge sources. However, real-world documents, such as annual reports, scientific papers, and clinical guidelines, frequently combine…

信息检索 · 计算机科学 2025-12-17 Chi Zhang , Qiyang Chen , Mengqi Zhang

Retrieval-Augmented Generation (RAG) has demonstrated significant effectiveness in enhancing large language models (LLMs) for complex multi-hop question answering (QA). For multi-hop QA tasks, current iterative approaches predominantly rely…

计算与语言 · 计算机科学 2026-01-19 Yuling Shi , Maolin Sun , Zijun Liu , Mo Yang , Yixiong Fang , Tianran Sun , Xiaodong Gu

Scaling Visual Question Answering (VQA) to the open-domain and multi-hop nature of web searches, requires fundamental advances in visual representation learning, knowledge aggregation, and language generation. In this work, we introduce…

计算与语言 · 计算机科学 2022-03-29 Yingshan Chang , Mridu Narang , Hisami Suzuki , Guihong Cao , Jianfeng Gao , Yonatan Bisk

Retrieval-augmented generation (RAG) offers an effective approach for addressing question answering (QA) tasks. However, the imperfections of the retrievers in RAG models often result in the retrieval of irrelevant information, which could…

计算与语言 · 计算机科学 2024-06-18 Jinyuan Fang , Zaiqiao Meng , Craig Macdonald

Retrieval-augmented generation (RAG) systems have made significant progress in solving complex multi-hop question answering (QA) tasks in the English scenario. However, RAG systems inevitably face the application scenario of retrieving…

计算与语言 · 计算机科学 2026-03-20 Yilin Wang , Yuchun Fan , Jiaoyang Li , Ziming Zhu , Yongyu Mu , Qiaozhi He , Tong Xiao , Jingbo Zhu

Question answering (QA) using textual sources for purposes such as reading comprehension (RC) has attracted much attention. This study focuses on the task of explainable multi-hop QA, which requires the system to return the answer with…

计算与语言 · 计算机科学 2019-05-30 Kosuke Nishida , Kyosuke Nishida , Masaaki Nagata , Atsushi Otsuka , Itsumi Saito , Hisako Asano , Junji Tomita

Knowledge graphs are essential for numerous downstream natural language processing applications, but are typically incomplete with many facts missing. This results in research efforts on multi-hop reasoning task, which can be formulated as…

人工智能 · 计算机科学 2021-09-03 Yao Zhang , Hongru Liang , Adam Jatowt , Wenqiang Lei , Xin Wei , Ning Jiang , Zhenglu Yang

In this paper, we propose a new dataset, ReasonVQA, for the Visual Question Answering (VQA) task. Our dataset is automatically integrated with structured encyclopedic knowledge and constructed using a low-cost framework, which is capable of…

计算机视觉与模式识别 · 计算机科学 2026-02-03 Duong T. Tran , Trung-Kien Tran , Manfred Hauswirth , Danh Le Phuoc

Constructing scientific multimodal document reasoning datasets for foundation model training involves an inherent trade-off among scale, faithfulness, and realism. To address this challenge, we introduce the synthesize-and-reground…

计算与语言 · 计算机科学 2026-04-30 Ziyu Chen , Yilun Zhao , Chengye Wang , Rilyn Han , Manasi Patwardhan , Arman Cohan

The real-world information sources are inherently multilingual, which naturally raises a question about whether language models can synthesize information across languages. In this paper, we introduce a simple two-hop question answering…

计算与语言 · 计算机科学 2026-01-13 Yan Meng , Wafaa Mohammed , Christof Monz

While recent large language models (LLMs) improve on various question answering (QA) datasets, it remains difficult for a single model to generalize across question types that require distinct reasoning abilities. We provide empirical…

计算与语言 · 计算机科学 2023-10-23 Chenglei Si , Weijia Shi , Chen Zhao , Luke Zettlemoyer , Jordan Boyd-Graber