English
Related papers

Related papers: Autoregressive Reasoning over Chains of Facts with…

200 papers

Fact-checking systems have become important tools to verify fake and misguiding news. These systems become more trustworthy when human-readable explanations accompany the veracity labels. However, manual collection of such explanations is…

Computation and Language · Computer Science 2021-12-15 Shailza Jolly , Pepa Atanasova , Isabelle Augenstein

Graph Retrieval-Augmented Generation (Graph-RAG) enhances multihop question answering by organizing corpora into knowledge graphs and routing evidence through relational structure. However, practical deployments face two persistent…

Information Retrieval · Computer Science 2026-01-30 Jiate Liu , Zebin Chen , Shaobo Qiao , Mingchen Ju , Danting Zhang , Bocheng Han , Shuyue Yu , Xin Shu , Jingling Wu , Dong Wen , Xin Cao , Guanfeng Liu , Zhengyi Yang

Stepwise inference protocols, such as scratchpads and chain-of-thought, help language models solve complex problems by decomposing them into a sequence of simpler subproblems. Despite the significant gain in performance achieved via these…

Machine Learning · Computer Science 2024-02-13 Mikail Khona , Maya Okawa , Jan Hula , Rahul Ramesh , Kento Nishi , Robert Dick , Ekdeep Singh Lubana , Hidenori Tanaka

Asking questions from natural language text has attracted increasing attention recently, and several schemes have been proposed with promising results by asking the right question words and copy relevant words from the input to the…

Computation and Language · Computer Science 2020-09-17 Xiyao Ma , Qile Zhu , Yanlin Zhou , Xiaolin Li , Dapeng Wu

Visual Language Models (VLMs) are powerful generative tools but often produce factually inaccurate outputs due to a lack of robust reasoning capabilities. While extensive research has been conducted on integrating external knowledge for…

Artificial Intelligence · Computer Science 2025-11-26 Shamima Hossain

Multi-hop Reading Comprehension (RC) requires reasoning and aggregation across several paragraphs. We propose a system for multi-hop RC that decomposes a compositional question into simpler sub-questions that can be answered by…

Computation and Language · Computer Science 2019-07-02 Sewon Min , Victor Zhong , Luke Zettlemoyer , Hannaneh Hajishirzi

Recent advances in large language models (LLMs) have significantly improved multi-hop question answering (QA) through direct Chain-of-Thought (CoT) reasoning. However, the irreversible nature of CoT leads to error accumulation, making it…

Artificial Intelligence · Computer Science 2025-05-30 Xinjie Zhao , Fan Gao , Xingyu Song , Yingjian Chen , Rui Yang , Yanran Fu , Yuyang Wang , Yusuke Iwasawa , Yutaka Matsuo , Irene Li

Multi-hop QA requires reasoning over multiple supporting facts to answer the question. However, the existing QA models always rely on shortcuts, e.g., providing the true answer by only one fact, rather than multi-hop reasoning, which is…

Artificial Intelligence · Computer Science 2022-10-14 Wangzhen Guo , Qinkang Gong , Hanjiang Lai

Multi-hop reasoning (MHR) is a process in artificial intelligence and natural language processing where a system needs to make multiple inferential steps to arrive at a conclusion or answer. In the context of knowledge graphs or databases,…

Artificial Intelligence · Computer Science 2024-06-13 Jesmin Jahan Tithi , Fabio Checconi , Fabrizio Petrini

Machine learning plays a role in many deployed decision systems, often in ways that are difficult or impossible to understand by human stakeholders. Explaining, in a human-understandable way, the relationship between the input and output of…

Machine Learning · Computer Science 2022-11-17 Sahil Verma , Varich Boonsanong , Minh Hoang , Keegan E. Hines , John P. Dickerson , Chirag Shah

Recent progress in retrieval-augmented generation (RAG) has led to more accurate and interpretable multi-hop question answering (QA). Yet, challenges persist in integrating iterative reasoning steps with external knowledge retrieval. To…

Computation and Language · Computer Science 2025-10-06 Tengjun Ni , Xin Yuan , Shenghong Li , Kai Wu , Ren Ping Liu , Wei Ni , Wenjie Zhang

Despite the success of generative pre-trained language models on a series of text generation tasks, they still suffer in cases where reasoning over underlying commonsense knowledge is required during generation. Existing approaches that…

Computation and Language · Computer Science 2020-09-25 Haozhe Ji , Pei Ke , Shaohan Huang , Furu Wei , Xiaoyan Zhu , Minlie Huang

Retrieval-augmented generation have become central in natural language processing due to their efficacy in generating factual content. While traditional methods employ single-time retrieval, more recent approaches have shifted towards…

Computation and Language · Computer Science 2024-02-20 Yujia Zhou , Zheng Liu , Jiajie Jin , Jian-Yun Nie , Zhicheng Dou

Despite the widespread adoption of autoregressive language models, explainability evaluation research has predominantly focused on span infilling and masked language models. Evaluating the faithfulness of an explanation method -- how…

Computation and Language · Computer Science 2025-03-11 Sepehr Kamahi , Yadollah Yaghoobzadeh

Reasoning is a crucial part of natural language argumentation. To comprehend an argument, one must analyze its warrant, which explains why its claim follows from its premises. As arguments are highly contextualized, warrants are usually…

Computation and Language · Computer Science 2022-03-07 Ivan Habernal , Henning Wachsmuth , Iryna Gurevych , Benno Stein

Large Language Models (LLMs) are proficient at retrieving single facts from extended contexts, yet they struggle with tasks requiring the simultaneous retrieval of multiple facts, especially during generation. This paper identifies a novel…

Computation and Language · Computer Science 2024-10-29 Jinlin Wang , Suyuchen Wang , Ziwen Xia , Sirui Hong , Yun Zhu , Bang Liu , Chenglin Wu

Multi-hop question answering is a challenging task in which language models must reason over multiple steps to reach the correct answer. With the help of Large Language Models and their reasoning capabilities, existing systems are able to…

Machine Learning · Computer Science 2025-12-08 Durga Prasad Maram , Kalpa Gunaratna , Vijay Srinivasan , Haris Jeelani , Srinivas Chappidi

Automated fact-checking aims to assess the truthfulness of textual claims based on relevant evidence. However, verifying complex claims that require multi-hop reasoning remains a significant challenge. We propose GraphCheck, a novel…

Computation and Language · Computer Science 2025-11-10 Hyewon Jeon , Jay-Yoon Lee

The growing integration of machine learning (ML) and artificial intelligence (AI) models into high-stakes domains such as healthcare and scientific research calls for models that are not only accurate but also interpretable. Among the…

Machine Learning · Computer Science 2025-10-23 Zhuo Cao , Xuan Zhao , Lena Krieger , Hanno Scharr , Ira Assent

A multi-hop question answering (QA) dataset aims to test reasoning and inference skills by requiring a model to read multiple paragraphs to answer a given question. However, current datasets do not provide a complete explanation for the…

Computation and Language · Computer Science 2020-11-13 Xanh Ho , Anh-Khoa Duong Nguyen , Saku Sugawara , Akiko Aizawa