English
Related papers

Related papers: Multi-Step Reasoning Over Unstructured Text with B…

200 papers

In simple open-domain question answering (QA), dense retrieval has become one of the standard approaches for retrieving the relevant passages to infer an answer. Recently, dense retrieval also achieved state-of-the-art results in multi-hop…

Information Retrieval · Computer Science 2021-09-23 Georgios Sidiropoulos , Nikos Voskarides , Svitlana Vakulenko , Evangelos Kanoulas

Dialogue systems can benefit from being able to search through a corpus of text to find information relevant to user requests, especially when encountering a request for which no manually curated response is available. The state-of-the-art…

Information Retrieval · Computer Science 2022-06-02 Hui Wan , Siva Sankalp Patel , J. William Murdock , Saloni Potdar , Sachindra Joshi

The rise in loosely-structured data available through text, images, and other modalities has called for new ways of querying them. Multimedia Information Retrieval has filled this gap and has witnessed exciting progress in recent years.…

Multimedia · Computer Science 2024-01-31 Giovanni Trappolini , Andrea Santilli , Emanuele Rodolà , Alon Halevy , Fabrizio Silvestri

Reading Comprehension has received significant attention in recent years as high quality Question Answering (QA) datasets have become available. Despite state-of-the-art methods achieving strong overall accuracy, Multi-Hop (MH) reasoning…

Computation and Language · Computer Science 2019-05-24 Alex Long , Joel Mason , Alan Blair , Wei Wang

The ability of reasoning over evidence has received increasing attention in question answering (QA). Recently, natural language database (NLDB) conducts complex QA in knowledge base with textual evidences rather than structured…

Computation and Language · Computer Science 2022-10-18 Minjun Zhu , Yixuan Weng , Shizhu He , Kang Liu , Jun Zhao

When provided with sufficient explanatory context, smaller Language Models have been shown to exhibit strong reasoning ability on challenging short-answer question-answering tasks where the questions are unseen in training. We evaluate two…

Computation and Language · Computer Science 2023-10-16 Tim Hartill , Diana Benavides-Prado , Michael Witbrock , Patricia J. Riddle

We propose a simple and efficient multi-hop dense retrieval approach for answering complex open-domain questions, which achieves state-of-the-art performance on two multi-hop datasets, HotpotQA and multi-evidence FEVER. Contrary to previous…

We propose RaDeR, a set of reasoning-based dense retrieval models trained with data derived from mathematical problem solving using large language models (LLMs). Our method leverages retrieval-augmented reasoning trajectories of an LLM and…

Computation and Language · Computer Science 2025-05-28 Debrup Das , Sam O' Nuallain , Razieh Rahimi

Traditional Retrieval-Augmented Generation (RAG) effectively supports single-hop question answering with large language models but faces significant limitations in multi-hop question answering tasks, which require combining evidence from…

Computation and Language · Computer Science 2026-05-26 Junli Liang , Pengfei Zhou , Wangqiu Zhou , Wenjie Qing , Qi Zhao , Ziwen Wang , Qi Song , Xiangyang Li

Recent deep research systems have improved the ability of large language models to produce long, grounded reports through iterative retrieval and reasoning. However, most text-centered systems rely mainly on textual evidence, while…

Computer Vision and Pattern Recognition · Computer Science 2026-05-14 Zhuofan Shi , Peilun Jia , Baoqin Sun , Haiyang Shen , Sixiong Xie , Yun Ma , Xiang Jing

Recently, the retrieval models based on dense representations have been gradually applied in the first stage of the document retrieval tasks, showing better performance than traditional sparse vector space models. To obtain high efficiency,…

Information Retrieval · Computer Science 2021-08-20 Hongyin Tang , Xingwu Sun , Beihong Jin , Jingang Wang , Fuzheng Zhang , Wei Wu

Recent advances in large Vision-Language Models (VLMs) have exhibited strong reasoning capabilities on complex visual tasks by thinking with images in their Chain-of-Thought (CoT), which is achieved by actively invoking tools to analyze…

Computer Vision and Pattern Recognition · Computer Science 2026-01-08 Wenhao Yang , Yu Xia , Jinlong Huang , Shiyin Lu , Qing-Guo Chen , Zhao Xu , Weihua Luo , Kaifu Zhang , Yuanyu Wan , Lijun Zhang

Document-level relation extraction requires integrating information within and across multiple sentences of a document and capturing complex interactions between inter-sentence entities. However, effective aggregation of relevant…

Computation and Language · Computer Science 2020-07-29 Guoshun Nan , Zhijiang Guo , Ivan Sekulić , Wei Lu

Modern systems for multi-hop question answering (QA) typically break questions into a sequence of reasoning steps, termed chain-of-thought (CoT), before arriving at a final answer. Often, multiple chains are sampled and aggregated through a…

Computation and Language · Computer Science 2024-08-05 Ori Yoran , Tomer Wolfson , Ben Bogin , Uri Katz , Daniel Deutch , Jonathan Berant

Large language models (LLMs) demonstrate strong chain-of-thought (CoT) reasoning abilities, while smaller models (<= 3B parameters) significantly underperform on multi-step reasoning tasks. Based on empirical analyses of the Qwen-2.5 model…

Artificial Intelligence · Computer Science 2026-05-29 Yang Ouyang , Shuhang Lin , Jung-Eun Kim

Visual Dialog is a vision-language task that requires an AI agent to engage in a conversation with humans grounded in an image. It remains a challenging task since it requires the agent to fully understand a given question before making an…

Computation and Language · Computer Science 2019-12-19 Feilong Chen , Fandong Meng , Jiaming Xu , Peng Li , Bo Xu , Jie Zhou

Breaking down a problem into intermediate steps has demonstrated impressive performance in Large Language Model (LLM) reasoning. However, the growth of the reasoning chain introduces uncertainty and error accumulation, making it challenging…

Computation and Language · Computer Science 2023-10-27 Yuxi Xie , Kenji Kawaguchi , Yiran Zhao , Xu Zhao , Min-Yen Kan , Junxian He , Qizhe Xie

Retrieval-augmented generation (RAG) offers an effective approach for addressing question answering (QA) tasks. However, the imperfections of the retrievers in RAG models often result in the retrieval of irrelevant information, which could…

Computation and Language · Computer Science 2024-06-18 Jinyuan Fang , Zaiqiao Meng , Craig Macdonald

Dense retrieval (DR) has the potential to resolve the query understanding challenge in conversational search by matching in the learned embedding space. However, this adaptation is challenging due to DR models' extra needs for supervision…

Information Retrieval · Computer Science 2021-05-20 Shi Yu , Zhenghao Liu , Chenyan Xiong , Tao Feng , Zhiyuan Liu

Recent progress in retrieval-augmented generation (RAG) has led to more accurate and interpretable multi-hop question answering (QA). Yet, challenges persist in integrating iterative reasoning steps with external knowledge retrieval. To…

Computation and Language · Computer Science 2025-10-06 Tengjun Ni , Xin Yuan , Shenghong Li , Kai Wu , Ren Ping Liu , Wei Ni , Wenjie Zhang