English
Related papers

Related papers: Research on Multi-hop Inference Optimization of LL…

200 papers

This paper presents a novel Retrieval-Augmented Generation (RAG) framework tailored for complex question answering tasks, addressing challenges in multi-hop reasoning and contextual understanding across lengthy documents. Built upon LLaMA…

Computation and Language · Computer Science 2025-06-23 Xinyue Huang , Ziqi Lin , Fang Sun , Wenchao Zhang , Kejian Tong , Yunbo Liu

Multilingual pre-trained Large Language Models (LLMs) are incredibly effective at Question Answering (QA), a core task in Natural Language Understanding, achieving high accuracies on several multilingual benchmarks. However, little is known…

Computation and Language · Computer Science 2024-04-16 Yahan Yang , Soham Dan , Dan Roth , Insup Lee

Multiple-choice questions (MCQs) are widely used in the evaluation of large language models (LLMs) due to their simplicity and efficiency. However, there are concerns about whether MCQs can truly measure LLM's capabilities, particularly in…

Computation and Language · Computer Science 2024-05-24 Wangyue Li , Liangzhi Li , Tong Xiang , Xiao Liu , Wei Deng , Noa Garcia

We introduce KG-MuLQA (Knowledge-Graph-based Multi-Level Question-Answer Extraction): a framework that (1) extracts QA pairs at multiple complexity levels (2) along three key dimensions -- multi-hop retrieval, set operations, and answer…

Question answering over knowledge bases (KBQA) aims to answer factoid questions with a given knowledge base (KB). Due to the large scale of KB, annotated data is impossible to cover all fact schemas in KB, which poses a challenge to the…

Computation and Language · Computer Science 2023-05-24 Chuanyuan Tan , Yuehe Chen , Wenbiao Shao , Wenliang Chen

Multi-relation Question Answering is a challenging task, due to the requirement of elaborated analysis on questions and reasoning over multiple fact triples in knowledge base. In this paper, we present a novel model called Interpretable…

Computation and Language · Computer Science 2018-06-04 Mantong Zhou , Minlie Huang , Xiaoyan Zhu

Table understanding is key to addressing challenging downstream tasks such as table-based question answering and fact verification. Recent works have focused on leveraging Chain-of-Thought and question decomposition to solve complex…

Computation and Language · Computer Science 2025-08-26 Thi-Nhung Nguyen , Hoang Ngo , Dinh Phung , Thuy-Trang Vu , Dat Quoc Nguyen

Large language models can use chain-of-thought (CoT) to externalize reasoning, potentially enabling oversight of capable LLM agents. Prior work has shown that models struggle at two-hop question-answering without CoT. This capability is so…

Computation and Language · Computer Science 2025-11-25 Mikita Balesni , Tomek Korbak , Owain Evans

Answering complex questions that require making latent decisions is a challenging task, especially when limited supervision is available. Recent works leverage the capabilities of large language models (LMs) to perform complex question…

Computation and Language · Computer Science 2022-12-09 Dheeru Dua , Shivanshu Gupta , Sameer Singh , Matt Gardner

Multi-Hop Question Answering (MHQA) requires integrating dispersed, interdependent evidence through sequential reasoning under noise. This task is challenging for LLMs as they have a finite per-pass output capacity, beyond which the…

Artificial Intelligence · Computer Science 2026-04-28 Kaiyang Wan , Lang Gao , Honglin Mu , Preslav Nakov , Yuxia Wang , Xiuying Chen

Knowledge Graph Question Answering (KGQA) is a crucial task in natural language processing that requires reasoning over knowledge graphs (KGs) to answer natural language questions. Recent methods utilizing large language models (LLMs) have…

Computation and Language · Computer Science 2025-06-12 Xiujun Zhou , Pingjian Zhang , Deyou Tang

Large Language Models (LLMs) are traditionally viewed as black-box algorithms, therefore reducing trustworthiness and obscuring potential approaches to increasing performance on downstream tasks. In this work, we apply an effective LLM…

Computation and Language · Computer Science 2025-07-10 Shun Wang , Tyler Loakman , Youbo Lei , Yi Liu , Bohao Yang , Yuting Zhao , Dong Yang , Chenghua Lin

In response to the increasing use of interactive artificial intelligence, the demand for the capacity to handle complex questions has increased. Multi-hop question generation aims to generate complex questions that requires multi-step…

Computation and Language · Computer Science 2024-04-02 Seonjeong Hwang , Yunsu Kim , Gary Geunbae Lee

Multi-hop question answering is widely used to evaluate the reasoning capabilities of large language models (LLMs), as it requires integrating multiple pieces of supporting knowledge to arrive at a correct answer. While prior work has…

Computation and Language · Computer Science 2026-01-13 Zhuoyi Yang , Yurun Song , Iftekhar Ahmed , Ian Harris

In today's fast-paced industry, professionals face the challenge of summarizing a large number of documents and extracting vital information from them on a daily basis. These metrics are frequently hidden away in tables and/or their nested…

Computation and Language · Computer Science 2024-03-29 Che Guan , Mengyu Huang , Peng Zhang

Multi-hop question answering (MHQA) enables accurate answers to complex queries by retrieving and reasoning over evidence dispersed across multiple documents. Existing MHQA approaches mainly rely on iterative retrieval-augmented generation,…

Artificial Intelligence · Computer Science 2026-04-21 Wei Chen , Lili Zhao , Zhi Zheng , HuiJun Hou , Tong Xu

Understanding culture requires reasoning across context, tradition, and implicit social knowledge, far beyond recalling isolated facts. Yet most culturally focused question answering (QA) benchmarks rely on single-hop questions, which may…

Computation and Language · Computer Science 2026-02-04 Vynska Amalia Permadi , Xingwei Tan , Nafise Sadat Moosavi , Nikos Aletras

Large Language Models (LLMs) often produce incorrect answers on multi-hop question answering even when the reasoning trace already contains a correct intermediate conclusion. We attribute this gap to weak self-regulation rather than…

Artificial Intelligence · Computer Science 2026-05-12 Ik-hwan Kim , Hyeongrok Han , Mingi Jung , Sangwon Yu , Jinseok Hong , Sang Hun Kim , Yoonyoung Choi , Sungroh Yoon

Existing work on augmenting question answering (QA) models with external knowledge (e.g., knowledge graphs) either struggle to model multi-hop relations efficiently, or lack transparency into the model's prediction rationale. In this paper,…

Computation and Language · Computer Science 2020-09-21 Yanlin Feng , Xinyue Chen , Bill Yuchen Lin , Peifeng Wang , Jun Yan , Xiang Ren

This paper introduces ExKLoP, a novel framework designed to evaluate how effectively Large Language Models (LLMs) integrate expert knowledge into logical reasoning systems. This capability is especially valuable in engineering, where expert…

Artificial Intelligence · Computer Science 2025-05-13 Franciszek Górski , Oskar Wysocki , Marco Valentino , Andre Freitas