English
Related papers

Related papers: Reasoning Circuits: Few-shot Multihop Question Gen…

200 papers

Multi-hop reasoning requires aggregating multiple documents to answer a complex question. Existing methods usually decompose the multi-hop question into simpler single-hop questions to solve the problem for illustrating the explainable…

Computation and Language · Computer Science 2022-08-23 Siyuan Wang , Zhongyu Wei , Zhihao Fan , Qi Zhang , Xuanjing Huang

Reading comprehension QA tasks have seen a recent surge in popularity, yet most works have focused on fact-finding extractive QA. We instead focus on a more challenging multi-hop generative task (NarrativeQA), which requires the model to…

Computation and Language · Computer Science 2019-06-04 Lisa Bauer , Yicheng Wang , Mohit Bansal

Neural models, including large language models (LLMs), achieve superior performance on multi-hop question-answering. To elicit reasoning capabilities from LLMs, recent works propose using the chain-of-thought (CoT) mechanism to generate…

Computation and Language · Computer Science 2023-11-08 Ruosen Li , Xinya Du

Multi-hop question answering requires a model to connect multiple pieces of evidence scattered in a long context to answer the question. In this paper, we show that in the multi-hop HotpotQA (Yang et al., 2018) dataset, the examples often…

Computation and Language · Computer Science 2019-06-18 Yichen Jiang , Mohit Bansal

A multi-hop question answering (QA) dataset aims to test reasoning and inference skills by requiring a model to read multiple paragraphs to answer a given question. However, current datasets do not provide a complete explanation for the…

Computation and Language · Computer Science 2020-11-13 Xanh Ho , Anh-Khoa Duong Nguyen , Saku Sugawara , Akiko Aizawa

Reasoning models enhance performance by tackling problems in a step-by-step manner, decomposing them into sub-problems and exploring long chains of thought before producing an answer. However, applying extended reasoning to every step…

Artificial Intelligence · Computer Science 2025-10-08 Haiquan Lu , Gongfan Fang , Xinyin Ma , Qi Li , Xinchao Wang

Despite the success of generative pre-trained language models on a series of text generation tasks, they still suffer in cases where reasoning over underlying commonsense knowledge is required during generation. Existing approaches that…

Computation and Language · Computer Science 2020-09-25 Haozhe Ji , Pei Ke , Shaohan Huang , Furu Wei , Xiaoyan Zhu , Minlie Huang

Large language models can perform various reasoning tasks by using chain-of-thought prompting, which guides them to find answers through step-by-step demonstrations. However, the quality of the prompts depends on the demonstrations given to…

Computation and Language · Computer Science 2023-02-02 Zhihong Shao , Yeyun Gong , Yelong Shen , Minlie Huang , Nan Duan , Weizhu Chen

Compositional reasoning tasks like multi-hop question answering, require making latent decisions to get the final answer, given a question. However, crowdsourced datasets often capture only a slice of the underlying task distribution, which…

Computation and Language · Computer Science 2021-04-20 Dheeru Dua , Cicero Nogueira dos Santos , Patrick Ng , Ben Athiwaratkun , Bing Xiang , Matt Gardner , Sameer Singh

Large language models have been shown to struggle with multi-step reasoning, and do not retain previous reasoning steps for future use. We propose a simple method for solving both of these problems by allowing the model to take Self-Notes.…

Machine Learning · Computer Science 2023-11-01 Jack Lanchantin , Shubham Toshniwal , Jason Weston , Arthur Szlam , Sainbayar Sukhbaatar

Humans have a powerful and mysterious capacity to reason. Working through a set of mental steps enables us to make inferences we would not be capable of making directly even though we get no additional data from the world. Similarly, when…

Artificial Intelligence · Computer Science 2023-11-06 Ben Prystawski , Michael Y. Li , Noah D. Goodman

When answering a question, humans utilize the information available across different modalities to synthesize a consistent and complete chain of thought (CoT). This process is normally a black box in the case of deep learning models like…

Computation and Language · Computer Science 2022-10-18 Pan Lu , Swaroop Mishra , Tony Xia , Liang Qiu , Kai-Wei Chang , Song-Chun Zhu , Oyvind Tafjord , Peter Clark , Ashwin Kalyan

Multi-hop Question Generation (QG) aims to generate answer-related questions by aggregating and reasoning over multiple scattered evidence from different paragraphs. It is a more challenging yet under-explored task compared to conventional…

Computation and Language · Computer Science 2021-02-10 Dan Su , Yan Xu , Wenliang Dai , Ziwei Ji , Tiezheng Yu , Pascale Fung

When provided with sufficient explanatory context, smaller Language Models have been shown to exhibit strong reasoning ability on challenging short-answer question-answering tasks where the questions are unseen in training. We evaluate two…

Computation and Language · Computer Science 2023-10-16 Tim Hartill , Diana Benavides-Prado , Michael Witbrock , Patricia J. Riddle

Multi-hop question answering (QA) necessitates multi-step reasoning and retrieval across interconnected subjects, attributes, and relations. Existing retrieval-augmented generation (RAG) methods struggle to capture these structural…

Computation and Language · Computer Science 2026-02-19 Jimeng Shi , Wei Hu , Runchu Tian , Bowen Jin , Wonbin Kweon , SeongKu Kang , Yunfan Kang , Dingqi Ye , Sizhe Zhou , Shaowen Wang , Jiawei Han

Long text generation is an important but challenging task.The main problem lies in learning sentence-level semantic dependencies which traditional generative models often suffer from. To address this problem, we propose a Multi-hop…

Computation and Language · Computer Science 2020-09-29 Liang Zhao , Jingjing Xu , Junyang Lin , Yichang Zhang , Hongxia Yang , Xu Sun

Multi-hop Reading Comprehension (RC) requires reasoning and aggregation across several paragraphs. We propose a system for multi-hop RC that decomposes a compositional question into simpler sub-questions that can be answered by…

Computation and Language · Computer Science 2019-07-02 Sewon Min , Victor Zhong , Luke Zettlemoyer , Hannaneh Hajishirzi

Question generation (QG) attempts to solve the inverse of question answering (QA) problem by generating a natural language question given a document and an answer. While sequence to sequence neural models surpass rule-based systems for QG,…

Computation and Language · Computer Science 2020-11-03 Deepak Gupta , Hardik Chauhan , Akella Ravi Tej , Asif Ekbal , Pushpak Bhattacharyya

Multiple-choice questions (MCQs) are widely used across diverse educational fields and levels. Well-designed MCQs should evaluate knowledge application in real-world situations. However, writing such test items in sufficient numbers is…

Human-Computer Interaction · Computer Science 2026-02-10 Tetiana Krushynska , Jani Ursin , Ville Heilala

Language-Image Pre-training has demonstrated promising results on zero-shot and few-shot downstream tasks by prompting visual models with natural language prompts. However, most recent studies only use a single prompt for tuning, neglecting…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Jiaxin Ge , Hongyin Luo , Siyuan Qian , Yulu Gan , Jie Fu , Shanghang Zhang