English
Related papers

Related papers: Research on Multi-hop Inference Optimization of LL…

200 papers

Multi-hop Reading Comprehension (RC) requires reasoning and aggregation across several paragraphs. We propose a system for multi-hop RC that decomposes a compositional question into simpler sub-questions that can be answered by…

Computation and Language · Computer Science 2019-07-02 Sewon Min , Victor Zhong , Luke Zettlemoyer , Hannaneh Hajishirzi

Despite readily memorizing world knowledge about entities, pre-trained language models (LMs) struggle to compose together two or more facts to perform multi-hop reasoning in question-answering tasks. In this work, we propose techniques that…

Computation and Language · Computer Science 2023-06-08 Kanishka Misra , Cicero Nogueira dos Santos , Siamak Shakeri

Large Language Models (LLMs), acting as a powerful reasoner and generator, exhibit extraordinary performance across various natural language tasks, such as question answering (QA). Among these tasks, Multi-Hop Question Answering (MHQA)…

Computation and Language · Computer Science 2023-09-25 Yin Zhu , Zhiling Luo , Gong Cheng

Large language models (LLMs) demonstrate strong reasoning abilities when prompted to generate chain-of-thought (CoT) explanations alongside answers. However, previous research on evaluating LLMs has solely focused on answer accuracy,…

Computation and Language · Computer Science 2024-06-21 Minh-Vuong Nguyen , Linhao Luo , Fatemeh Shiri , Dinh Phung , Yuan-Fang Li , Thuy-Trang Vu , Gholamreza Haffari

Multi-hop question answering requires models to gather information from different parts of a text to answer a question. Most current approaches learn to address this task in an end-to-end way with neural networks, without maintaining an…

Computation and Language · Computer Science 2021-06-08 Jifan Chen , Shih-ting Lin , Greg Durrett

Generating multiple-choice questions (MCQs) with difficulty estimation remains challenging in automated MCQ-generation systems used in adaptive, AI-assisted education. This study proposes a novel methodology for generating MCQs with…

Computation and Language · Computer Science 2026-04-14 Mehmet Can Şakiroğlu , H. Altay Güvenir , Kamer Kaya

Multi-hop question answering is a challenging task in which language models must reason over multiple steps to reach the correct answer. With the help of Large Language Models and their reasoning capabilities, existing systems are able to…

Machine Learning · Computer Science 2025-12-08 Durga Prasad Maram , Kalpa Gunaratna , Vijay Srinivasan , Haris Jeelani , Srinivas Chappidi

Multi-hop knowledge based question answering (KBQA) is a complex task for natural language understanding. Many KBQA approaches have been proposed in recent years, and most of them are trained based on labeled reasoning path. This hinders…

Machine Learning · Computer Science 2020-05-25 Kechen Qin , Yu Wang , Cheng Li , Kalpa Gunaratna , Hongxia Jin , Virgil Pavlu , Javed A. Aslam

The rapid development of social platforms exacerbates the dissemination of misinformation, which stimulates the research in fact verification. Recent studies tend to leverage semantic features to solve this problem as a single-hop task.…

Computation and Language · Computer Science 2025-03-12 Han Cao , Lingwei Wei , Wei Zhou , Songlin Hu

Answering multi-hop reasoning questions requires retrieving and synthesizing information from diverse sources. Language models (LMs) struggle to perform such reasoning consistently. We propose an approach to pinpoint and rectify multi-hop…

Computation and Language · Computer Science 2024-11-11 Mansi Sakarvadia

Understanding complex biomolecular mechanisms requires multi-step reasoning across molecular interactions, signaling cascades, and metabolic pathways. While large language models(LLMs) show promise in such tasks, their application to…

Artificial Intelligence · Computer Science 2025-11-12 Tianwen Lyu , Xiang Zhuang , Keyan Ding , Xinzhe Cao , Lei Liang , Wei Zhao , Qiang Zhang , Huajun Chen

The proliferation of long-context large language models (LLMs) exposes a key bottleneck: the rapidly expanding key-value cache during decoding, which imposes heavy memory and latency costs. While recent approaches attempt to alleviate this…

Computation and Language · Computer Science 2026-02-05 Gang Lin , Dongfang Li , Zhuoen Chen , Yukun Shi , Xuhui Chen , Baotian Hu , Min Zhang

Grounding large language models (LLMs) in verifiable external sources is a well-established strategy for generating reliable answers. Retrieval-augmented generation (RAG) is one such approach, particularly effective for tasks like question…

Computation and Language · Computer Science 2025-07-02 Paul J. L. Ammann , Jonas Golde , Alan Akbik

Question answering on free-form tables (a.k.a. TableQA) is a challenging task because of the flexible structure and complex schema of tables. Recent studies use Large Language Models (LLMs) for this task, exploiting their capability in…

Computation and Language · Computer Science 2025-06-17 Yuxiang Wang , Jianzhong Qi , Junhao Gan

Multi-hop QA requires the machine to answer complex questions through finding multiple clues and reasoning, and provide explanatory evidence to demonstrate the machine reasoning process. We propose Relation Extractor-Reader and Comparator…

Computation and Language · Computer Science 2021-10-27 Ruiliu Fu , Han Wang , Xuejun Zhang , Jun Zhou , Yonghong Yan

Multiple-choice questions (MCQ) are frequently used to assess large language models (LLMs). Typically, an LLM is given a question and selects the answer deemed most probable after adjustments for factors like length. Unfortunately, LLMs may…

Computation and Language · Computer Science 2024-06-12 Aidar Myrzakhan , Sondos Mahmoud Bsharat , Zhiqiang Shen

Multi-hop logical reasoning on knowledge graphs is a pivotal task in natural language processing, with numerous approaches aiming to answer First-Order Logic (FOL) queries. Recent geometry (e.g., box, cone) and probability (e.g., beta…

Artificial Intelligence · Computer Science 2024-06-12 Jeonghoon Kim , Heesoo Jung , Hyeju Jang , Hogun Park

Few-shot learning for open domain multi-hop question answering typically relies on the incontext learning capability of large language models (LLMs). While powerful, these LLMs usually contain tens or hundreds of billions of parameters,…

Computation and Language · Computer Science 2024-02-14 Mingda Chen , Xilun Chen , Wen-tau Yih

Large Language Models (LLMs) have shown proficiency in question-answering tasks but often struggle to integrate real-time knowledge, leading to potentially outdated or inaccurate responses. This problem becomes even more challenging when…

Computation and Language · Computer Science 2024-08-15 Yucheng Shi , Qiaoyu Tan , Xuansheng Wu , Shaochen Zhong , Kaixiong Zhou , Ninghao Liu

Multiple-choice question answering (MCQA) is often used to evaluate large language models (LLMs). To see if MCQA assesses LLMs as intended, we probe if LLMs can perform MCQA with choices-only prompts, where models must select the correct…

Computation and Language · Computer Science 2024-06-11 Nishant Balepur , Abhilasha Ravichander , Rachel Rudinger