English
Related papers

Related papers: Improving Multi-hop Logical Reasoning in Knowledge…

200 papers

Large language models (LLMs) perform well on multi-hop reasoning, yet how they internally compose multiple facts remains unclear. Recent work proposes \emph{hop-aligned circuit hypothesis}, suggesting that bridge entities are computed…

Computation and Language · Computer Science 2026-01-08 Xukai Liu , Ye Liu , Jipeng Zhang , Yanghai Zhang , Kai Zhang , Qi Liu

Multi-hop question answering (MHQA) requires integrating knowledge scattered across multiple passages to derive the correct answer. Traditional retrieval-augmented generation (RAG) methods primarily focus on coarse-grained textual semantic…

Computation and Language · Computer Science 2025-08-18 Changjian Wang , Weihong Deng , Weili Guan , Quan Lu , Ning Jiang

Despite recent advances in large language models (LLMs), most QA benchmarks are still confined to single-paragraph or single-document settings, failing to capture the complexity of real-world information-seeking tasks. Practical QA often…

Computation and Language · Computer Science 2025-08-25 Jiwon Park , Seohyun Pyeon , Jinwoo Kim , Rina Carines Cabal , Yihao Ding , Soyeon Caren Han

Multi-hop machine reading comprehension is a challenging task in natural language processing as it requires more reasoning ability across multiple documents. Spectral models based on graph convolutional networks have shown good inferring…

Computation and Language · Computer Science 2023-07-24 Peng Gao , Feng Gao , Peng Wang , Jian-Cheng Ni , Fei Wang , Hamido Fujita

Retrieval-Augmented Generation (RAG) systems often struggle with imperfect retrieval, as traditional retrievers focus on lexical or semantic similarity rather than logical relevance. To address this, we propose \textbf{HopRAG}, a novel RAG…

Information Retrieval · Computer Science 2025-05-27 Hao Liu , Zhengren Wang , Xi Chen , Zhiyu Li , Feiyu Xiong , Qinhan Yu , Wentao Zhang

Graph Retrieval-Augmented Generation (GraphRAG) has become a common approach for multi-hop reasoning by using knowledge graphs (KGs) as structured retrieval indexes. However, most existing GraphRAG methods implicitly assume that…

Information Retrieval · Computer Science 2026-05-20 Yizhuo Ma , Jinchuan Xu , Tao Wen , Qizhi Chen , Jiakai Li , Rongzheng Wang , Muquan Li , Shuang Liang , Ke Qin

Graph-based Retrieval-Augmented Generation (GraphRAG) advances flat document retrieval by structuring knowledge as relational graphs, enabling more coherent and effective reasoning. However, applying it to specific domains like legal…

Computation and Language · Computer Science 2026-05-28 Zerui Chen , Qinggang Zhang , Zhishang Xiang , Zhimin Wei , Linfeng Gao , Xiao Huang , Zhihong Zhang , Jinsong Su

Commonsense question answering has demonstrated considerable potential across various applications like assistants and social robots. Although fully fine-tuned pre-trained Language Models(LM) have achieved remarkable performance in…

Computation and Language · Computer Science 2024-05-10 Ruiting Dai , Yuqiao Tan , Lisi Mo , Shuang Liang , Guohao Huo , Jiayi Luo , Yao Cheng

Multi-hop question answering over hybrid table-text data requires retrieving and reasoning across multiple evidence pieces from large corpora, but standard Retrieval-Augmented Generation (RAG) pipelines process documents as flat ranked…

Computation and Language · Computer Science 2026-01-13 Mohamed Sharafath , Aravindh Annamalai , Ganesh Murugan , Aravindakumar Venugopalan

Integrating large language models (LLMs) with knowledge graphs derived from domain-specific data represents an important advancement towards more powerful and factual reasoning. As these models grow more capable, it is crucial to enable…

Artificial Intelligence · Computer Science 2024-04-19 Stefan Dernbach , Khushbu Agarwal , Alejandro Zuniga , Michael Henry , Sutanay Choudhury

Probabilistic logical rule learning has shown great strength in logical rule mining and knowledge graph completion. It learns logical rules to predict missing edges by reasoning on existing edges in the knowledge graph. However, previous…

Artificial Intelligence · Computer Science 2023-05-23 Chi Han , Qizheng He , Charles Yu , Xinya Du , Hanghang Tong , Heng Ji

We study question answering over a dynamic textual environment. Although neural network models achieve impressive accuracy via learning from input-output examples, they rarely leverage various types of knowledge and are generally not…

Computation and Language · Computer Science 2020-04-28 Wanjun Zhong , Duyu Tang , Nan Duan , Ming Zhou , Jiahai Wang , Jian Yin

There emerges a promising trend of using large language models (LLMs) to generate code-like plans for complex inference tasks such as visual reasoning. This paradigm, known as LLM-based planning, provides flexibility in problem solving and…

Computation and Language · Computer Science 2023-08-22 Pengbo Hu , Ji Qi , Xingyu Li , Hong Li , Xinqi Wang , Bing Quan , Ruiyu Wang , Yi Zhou

Incorporating external graph knowledge into neural chatbot models has been proven effective for enhancing dialogue generation. However, in conventional graph neural networks (GNNs), message passing on a graph is independent from text,…

Computation and Language · Computer Science 2023-06-29 Chen Tang , Hongbo Zhang , Tyler Loakman , Chenghua Lin , Frank Guerin

Large Language Models (LLMs) have achieved impressive results in various tasks but struggle with hallucination problems and lack of relevant knowledge, especially in deep complex reasoning and knowledge-intensive tasks. Knowledge Graphs…

Computation and Language · Computer Science 2025-03-14 Xingyu Tan , Xiaoyang Wang , Qing Liu , Xiwei Xu , Xin Yuan , Wenjie Zhang

Retrieval-augmented generation (RAG) has been extensively employed to mitigate hallucinations in large language models (LLMs). However, existing methods for multi-hop reasoning tasks often lack global planning, increasing the risk of…

Computation and Language · Computer Science 2025-11-14 Yijie Zhu , Haojie Zhou , Wanting Hong , Tailin Liu , Ning Wang

Retrieval-augmented generation (RAG) is a powerful paradigm for improving large language models (LLMs) on knowledge-intensive question answering. Graph-based RAG (GraphRAG) leverages entity-relation graphs to support multi-hop reasoning,…

Artificial Intelligence · Computer Science 2025-10-01 Kai Guo , Xinnan Dai , Shenglai Zeng , Harry Shomer , Haoyu Han , Yu Wang , Jiliang Tang

In the realm of computational knowledge representation, Knowledge Graph Reasoning (KG-R) stands at the forefront of facilitating sophisticated inferential capabilities across multifarious domains. The quintessence of this research…

Artificial Intelligence · Computer Science 2024-03-12 Chen Li , Haotian Zheng , Yiping Sun , Cangqing Wang , Liqiang Yu , Che Chang , Xinyu Tian , Bo Liu

Large language models (LLMs) often suffer from hallucination, generating factually incorrect statements when handling questions beyond their knowledge and perception. Retrieval-augmented generation (RAG) addresses this by retrieving…

Computation and Language · Computer Science 2025-11-18 Shengyuan Chen , Chuang Zhou , Zheng Yuan , Qinggang Zhang , Zeyang Cui , Hao Chen , Yilin Xiao , Jiannong Cao , Xiao Huang

Fact-centric information needs are rarely one-shot; users typically ask follow-up questions to explore a topic. In such a conversational setting, the user's inputs are often incomplete, with entities or predicates left out, and…

Information Retrieval · Computer Science 2019-11-06 Philipp Christmann , Rishiraj Saha Roy , Abdalghani Abujabal , Jyotsna Singh , Gerhard Weikum