English
Related papers

Related papers: Robustifying Multi-hop QA through Pseudo-Evidentia…

200 papers

Real-life tasks such as giving legal or technical advice often lack complete context at the outset and can have disparate answers depending thereon. The ability to derive missing factual information by asking clarifying questions (ACQ) is…

Computation and Language · Computer Science 2024-10-15 Matthew Toles , Yukun Huang , Zhou Yu , Luis Gravano

Entity typing aims at predicting one or more words that describe the type(s) of a specific mention in a sentence. Due to shortcuts from surface patterns to annotated entity labels and biased training, existing entity typing models are…

Computation and Language · Computer Science 2022-10-27 Nan Xu , Fei Wang , Bangzheng Li , Mingtao Dong , Muhao Chen

Coupled with the availability of large scale datasets, deep learning architectures have enabled rapid progress on the Question Answering task. However, most of those datasets are in English, and the performances of state-of-the-art…

Computation and Language · Computer Science 2021-10-15 Arij Riabi , Thomas Scialom , Rachel Keraron , Benoît Sagot , Djamé Seddah , Jacopo Staiano

Multi-hop textual question answering requires combining information from multiple sentences. We focus on a natural setting where, unlike typical reading comprehension, only partial information is provided with each question. The model must…

Computation and Language · Computer Science 2019-09-23 Tushar Khot , Ashish Sabharwal , Peter Clark

Deep neural network based question answering (QA) models are neither robust nor explainable in many cases. For example, a multiple-choice QA model, tested without any input of question, is surprisingly "capable" to predict the most of…

Computation and Language · Computer Science 2020-10-13 Sicheng Yu , Yulei Niu , Shuohang Wang , Jing Jiang , Qianru Sun

Building training-ready multi-hop question answering (QA) datasets that truly stress a model's retrieval and reasoning abilities remains highly challenging recently. While there have been a few recent evaluation datasets that capture the…

Artificial Intelligence · Computer Science 2025-11-26 Bingsen Qiu , Zijian Liu , Xiao Liu , Bingjie Wang , Feier Zhang , Yixuan Qin , Chunyan Li , Haoshen Yang , Zeren Gao

We study the problem of learning to generate an answer (or completion) to a question (or prompt), where there could be multiple correct answers, any one of which is acceptable at test time. Learning is based on demonstrations of some…

Machine Learning · Computer Science 2026-02-27 Nirmit Joshi , Gene Li , Siddharth Bhandari , Shiva Prasad Kasiviswanathan , Cong Ma , Nathan Srebro

Multi-hop question answering (MHQA) enables accurate answers to complex queries by retrieving and reasoning over evidence dispersed across multiple documents. Existing MHQA approaches mainly rely on iterative retrieval-augmented generation,…

Artificial Intelligence · Computer Science 2026-04-21 Wei Chen , Lili Zhao , Zhi Zheng , HuiJun Hou , Tong Xu

Deep models are the defacto standard in visual decision problems due to their impressive performance on a wide array of visual tasks. On the other hand, their opaqueness has led to a surge of interest in explainable systems. In this work,…

Computer Vision and Pattern Recognition · Computer Science 2017-11-21 Dong Huk Park , Lisa Anne Hendricks , Zeynep Akata , Anna Rohrbach , Bernt Schiele , Trevor Darrell , Marcus Rohrbach

Accurately answering complex questions has consistently been a significant challenge for Large Language Models (LLMs). To address this, this paper proposes a multi-hop question decomposition method for complex questions, building upon…

Computation and Language · Computer Science 2025-09-08 Zucheng Liang , Wenxin Wei , Kaijie Zhang , Hongyi Chen

Knowledge transfer from a complex high performing model to a simpler and potentially low performing one in order to enhance its performance has been of great interest over the last few years as it finds applications in important problems…

Machine Learning · Computer Science 2022-09-09 Amit Dhurandhar , Tejaswini Pedapati

There is a broad consensus on the importance of deep learning models in tasks involving complex data. Often, an adequate understanding of these models is required when focusing on the transparency of decisions in human-critical…

Question-answering datasets require a broad set of reasoning skills. We show how to use question decompositions to teach language models these broad reasoning skills in a robust fashion. Specifically, we use widely available QDMR…

Computation and Language · Computer Science 2022-11-07 Harsh Trivedi , Niranjan Balasubramanian , Tushar Khot , Ashish Sabharwal

Modern systems for multi-hop question answering (QA) typically break questions into a sequence of reasoning steps, termed chain-of-thought (CoT), before arriving at a final answer. Often, multiple chains are sampled and aggregated through a…

Computation and Language · Computer Science 2024-08-05 Ori Yoran , Tomer Wolfson , Ben Bogin , Uri Katz , Daniel Deutch , Jonathan Berant

As Large Language Models are increasingly deployed in high-stakes domains, their ability to detect false assumptions and reason critically is crucial for ensuring reliable outputs. False-premise questions (FPQs) serve as an important…

Computation and Language · Computer Science 2025-06-05 Mohammadamin Shafiei , Hamidreza Saffari , Nafise Sadat Moosavi

Large Language Models (LLMs) often produce incorrect answers on multi-hop question answering even when the reasoning trace already contains a correct intermediate conclusion. We attribute this gap to weak self-regulation rather than…

Artificial Intelligence · Computer Science 2026-05-12 Ik-hwan Kim , Hyeongrok Han , Mingi Jung , Sangwon Yu , Jinseok Hong , Sang Hun Kim , Yoonyoung Choi , Sungroh Yoon

Recent work has showcased the powerful capability of large language models (LLMs) in recalling knowledge and reasoning. However, the reliability of LLMs in combining these two capabilities into reasoning through multi-hop facts has not been…

Computation and Language · Computer Science 2024-06-04 Tianjie Ju , Yijin Chen , Xinwei Yuan , Zhuosheng Zhang , Wei Du , Yubin Zheng , Gongshen Liu

Rationalization is fundamental to human reasoning and learning. NLP models trained to produce rationales along with predictions, called self-rationalization models, have been investigated for their interpretability and utility to end-users.…

Computation and Language · Computer Science 2022-10-26 Alexis Ross , Matthew E. Peters , Ana Marasović

Multi-hop Knowledge Base Question Answering(KBQA) aims to find the answer entity in a knowledge base which is several hops from the topic entity mentioned in the question. Existing Retrieval-based approaches first generate instructions from…

Computation and Language · Computer Science 2022-09-08 Haowei Du , Quzhe Huang , Chen Zhang , Dongyan Zhao

Many natural language questions require qualitative, quantitative or logical comparisons between two entities or events. This paper addresses the problem of improving the accuracy and consistency of responses to comparison questions by…

Computation and Language · Computer Science 2020-05-26 Akari Asai , Hannaneh Hajishirzi