English
Related papers

Related papers: A Simple Yet Strong Pipeline for HotpotQA

200 papers

Reasoning quality in large language models depends not only on producing correct answers but also on generating valid intermediate steps. We study this through multiple-choice question answering (MCQA), which provides a controlled setting…

Artificial Intelligence · Computer Science 2025-10-01 Raphael Schumann , Stefan Riezler

Retrieval-Augmented Generation (RAG) has been used in question answering (QA) systems to improve performance when relevant information is in one (single-hop) or multiple (multi-hop) passages. However, many real life scenarios (e.g. dealing…

Computation and Language · Computer Science 2026-04-02 Mykolas Sveistrys , Richard Kunert

We present a highly parameter efficient approach for Question Answering that significantly reduces the need for extended BERT fine-tuning. Our method uses information from the hidden state activations of each BERT transformer layer, which…

Computation and Language · Computer Science 2022-02-25 Siduo Jiang , Cristopher Benge , William Casey King

We study the problem of Query Performance Prediction (QPP) for open-domain multi-hop Question Answering (QA), where the task is to estimate the difficulty of evaluating a multi-hop question over a corpus. Despite the extensive research on…

Computation and Language · Computer Science 2023-08-15 Mohammadreza Samadi , Davood Rafiei

When answering complex questions, people can seamlessly combine information from visual, textual and tabular sources. While interest in models that reason over multiple pieces of evidence has surged in recent years, there has been…

Computation and Language · Computer Science 2021-04-14 Alon Talmor , Ori Yoran , Amnon Catav , Dan Lahav , Yizhong Wang , Akari Asai , Gabriel Ilharco , Hannaneh Hajishirzi , Jonathan Berant

Research on open-domain question answering (QA) has a long tradition. A challenge in this domain is answering complex questions (CQA) that require complex inference methods and large amounts of knowledge. In low resource languages, such as…

Computation and Language · Computer Science 2021-07-06 Romina Etezadi , Mehrnoush Shamsfard

Healthcare question answering assistance aims to provide customer healthcare information, which widely appears in both Web and mobile Internet. The questions usually require the assistance to have proficient healthcare background knowledge…

Artificial Intelligence · Computer Science 2020-09-29 Ye Liu , Shaika Chowdhury , Chenwei Zhang , Cornelia Caragea , Philip S. Yu

Multi-hop question answering (QA) is widely used to evaluate the reasoning capabilities of large language models, yet most benchmarks focus on final answer correctness and overlook intermediate reasoning, especially in long multimodal…

Computation and Language · Computer Science 2026-03-10 Biao Xiang , Soyeon Caren Han , Yihao Ding

While large language models exhibit remarkable performance in the Question Answering task, they are susceptible to hallucinations. Challenges arise when these models grapple with understanding multi-hop relations in complex questions or…

Computation and Language · Computer Science 2023-11-14 Hejing Cao , Zhenwei An , Jiazhan Feng , Kun Xu , Liwei Chen , Dongyan Zhao

Retrieval-augmented generation (RAG) remains brittle on multi-step questions and heterogeneous evidence sources, trading accuracy against latency and token/tool budgets. This paper introduces RELOOP, a structure aware framework using…

Computation and Language · Computer Science 2026-04-24 Ruiyi Yang , Hao Xue , Imran Razzak , Hakim Hacid , Flora D. Salim

Retrieving information from correlative paragraphs or documents to answer open-domain multi-hop questions is very challenging. To deal with this challenge, most of the existing works consider paragraphs as nodes in a graph and propose…

Computation and Language · Computer Science 2021-02-09 Nan Shao , Yiming Cui , Ting Liu , Shijin Wang , Guoping Hu

Question answering (QA) models often rely on large-scale training datasets, which necessitates the development of a data generation framework to reduce the cost of manual annotations. Although several recent studies have aimed to generate…

Computation and Language · Computer Science 2023-02-07 Seongyun Lee , Hyunjae Kim , Jaewoo Kang

Large language models (LLMs) have demonstrated strong reasoning capabilities. Nevertheless, they still suffer from factual errors when tackling knowledge-intensive tasks. Retrieval-augmented reasoning represents a promising approach.…

Computation and Language · Computer Science 2024-07-01 Zheng Chu , Jingchang Chen , Qianglong Chen , Haotian Wang , Kun Zhu , Xiyuan Du , Weijiang Yu , Ming Liu , Bing Qin

NER has been traditionally formulated as a sequence labeling task. However, there has been recent trend in posing NER as a machine reading comprehension task (Wang et al., 2020; Mengge et al., 2020), where entity name (or other information)…

Machine Learning · Computer Science 2022-05-13 Anubhav Shrimal , Avi Jain , Kartik Mehta , Promod Yenigalla

Large language models are increasingly deployed in settings where relevant information is embedded within long and noisy contexts. Despite this, robustness to growing context length remains poorly understood across different question…

Artificial Intelligence · Computer Science 2026-03-18 Trishita Dhara , Siddhesh Sheth

In the question answering(QA) task, multi-hop reasoning framework has been extensively studied in recent years to perform more efficient and interpretable answer reasoning on the Knowledge Graph(KG). However, multi-hop reasoning is…

Artificial Intelligence · Computer Science 2022-03-15 Yao Zhang , Peiyao Li , Hongru Liang , Adam Jatowt , Zhenglu Yang

Materials language processing (MLP) is one of the key facilitators of materials science research, as it enables the extraction of structured information from massive materials science literature. Prior works suggested high-performance MLP…

Computation and Language · Computer Science 2023-08-21 Jaewoong Choi , Byungju Lee

Understanding covert narratives and implicit messaging is essential for analyzing bias and sentiment. Traditional NLP methods struggle with detecting subtle phrasing and hidden agendas. This study tackles two key challenges: (1) multi-label…

Computation and Language · Computer Science 2025-09-05 Rishit Tyagi , Rahul Bouri , Mohit Gupta

The rise of big data analytics on top of NLP increases the computational burden for text processing at scale. The problems faced in NLP are very high dimensional text, so it takes a high computation resource. The MapReduce allows…

Computation and Language · Computer Science 2021-11-05 Kuncahyo Setyo Nugroho , Anantha Yullian Sukmadewa , Novanto Yudistira

BERT, which stands for Bidirectional Encoder Representations from Transformers, is a recently introduced language representation model based upon the transfer learning paradigm. We extend its fine-tuning procedure to address one of its…

Computation and Language · Computer Science 2019-10-25 Raghavendra Pappagari , Piotr Żelasko , Jesús Villalba , Yishay Carmiel , Najim Dehak