English
Related papers

Related papers: Long Context Question Answering via Supervised Con…

200 papers

Large language models are increasingly deployed in settings where relevant information is embedded within long and noisy contexts. Despite this, robustness to growing context length remains poorly understood across different question…

Artificial Intelligence · Computer Science 2026-03-18 Trishita Dhara , Siddhesh Sheth

Long-form question answering (LFQA) aims at generating in-depth answers to end-user questions, providing relevant information beyond the direct answer. However, existing retrievers are typically optimized towards information that directly…

Computation and Language · Computer Science 2024-10-14 Philipp Christmann , Svitlana Vakulenko , Ionut Teodor Sorodoc , Bill Byrne , Adrià de Gispert

Spoken question answering (SQA) requires fine-grained understanding of both spoken documents and questions for the optimal answer prediction. In this paper, we propose novel training schemes for spoken question answering with a…

Computation and Language · Computer Science 2021-09-09 Chenyu You , Nuo Chen , Yuexian Zou

Long-context modeling capabilities have garnered widespread attention, leading to the emergence of Large Language Models (LLMs) with ultra-context windows. Meanwhile, benchmarks for evaluating long-context LLMs are gradually catching up.…

Computation and Language · Computer Science 2024-10-04 Minzheng Wang , Longze Chen , Cheng Fu , Shengyi Liao , Xinghua Zhang , Bingli Wu , Haiyang Yu , Nan Xu , Lei Zhang , Run Luo , Yunshui Li , Min Yang , Fei Huang , Yongbin Li

Video Question Answering (Video QA) requires fine-grained understanding of both video and language modalities to answer the given questions. In this paper, we propose novel training schemes for multiple-choice video question answering with…

Computation and Language · Computer Science 2020-12-15 Seonhoon Kim , Seohyeong Jeong , Eunbyul Kim , Inho Kang , Nojun Kwak

Recent studies on Question Answering (QA) and Conversational QA (ConvQA) emphasize the role of retrieval: a system first retrieves evidence from a large collection and then extracts answers. This open-retrieval ConvQA setting typically…

Information Retrieval · Computer Science 2021-03-04 Chen Qu , Liu Yang , Cen Chen , W. Bruce Croft , Kalpesh Krishna , Mohit Iyyer

Recent advancements in Large Language Models (LLMs) have significantly enhanced their capacity to process long contexts. However, effectively utilizing this long context remains a challenge due to the issue of distraction, where irrelevant…

Computation and Language · Computer Science 2024-11-12 Zijun Wu , Bingyuan Liu , Ran Yan , Lei Chen , Thomas Delteil

This paper proposes a new problem of complementary evidence identification for open-domain question answering (QA). The problem aims to efficiently find a small set of passages that covers full evidence from multiple aspects as to answer a…

Computation and Language · Computer Science 2021-04-06 Xiangyang Mou , Mo Yu , Shiyu Chang , Yufei Feng , Li Zhang , Hui Su

Multi-hop question answering requires a model to connect multiple pieces of evidence scattered in a long context to answer the question. In this paper, we show that in the multi-hop HotpotQA (Yang et al., 2018) dataset, the examples often…

Computation and Language · Computer Science 2019-06-18 Yichen Jiang , Mohit Bansal

Multiple-Choice Question Answering (MCQA) is a challenging task in machine reading comprehension. The main challenge in MCQA is to extract "evidence" from the given context that supports the correct answer. In the OpenbookQA dataset, the…

Computation and Language · Computer Science 2020-10-07 Sicheng Yu , Hao Zhang , Wei Jing , Jing Jiang

Neural models for question answering (QA) over documents have achieved significant performance improvements. Although effective, these models do not scale to large corpora due to their complex modeling of interactions between the document…

Computation and Language · Computer Science 2018-05-22 Sewon Min , Victor Zhong , Richard Socher , Caiming Xiong

We describe a Question Answering (QA) dataset that contains complex questions with conditional answers, i.e. the answers are only applicable when certain conditions apply. We call this dataset ConditionalQA. In addition to conditional…

Computation and Language · Computer Science 2021-10-14 Haitian Sun , William W. Cohen , Ruslan Salakhutdinov

Question answering (QA) using textual sources for purposes such as reading comprehension (RC) has attracted much attention. This study focuses on the task of explainable multi-hop QA, which requires the system to return the answer with…

Computation and Language · Computer Science 2019-05-30 Kosuke Nishida , Kyosuke Nishida , Masaaki Nagata , Atsushi Otsuka , Itsumi Saito , Hisako Asano , Junji Tomita

When training most modern reading comprehension models, all the questions associated with a context are treated as being independent from each other. However, closely related questions and their corresponding answers are not independent,…

Computation and Language · Computer Science 2021-04-20 Dheeru Dua , Pradeep Dasigi , Sameer Singh , Matt Gardner

Existing question answering (QA) datasets fail to train QA systems to perform complex reasoning and provide explanations for answers. We introduce HotpotQA, a new dataset with 113k Wikipedia-based question-answer pairs with four key…

Computation and Language · Computer Science 2018-09-26 Zhilin Yang , Peng Qi , Saizheng Zhang , Yoshua Bengio , William W. Cohen , Ruslan Salakhutdinov , Christopher D. Manning

Recent advances in Large Language Models (LLMs) have highlighted the challenge of handling long-context tasks, where models need to reason over extensive input contexts to aggregate target information. While Chain-of-Thought (CoT) prompting…

Computation and Language · Computer Science 2025-03-03 Dawei Zhu , Xiyu Wei , Guangxiang Zhao , Wenhao Wu , Haosheng Zou , Junfeng Ran , Xun Wang , Lin Sun , Xiangzheng Zhang , Sujian Li

Current QA systems can generate reasonable-sounding yet false answers without explanation or evidence for the generated answer, which is especially problematic when humans cannot readily check the model's answers. This presents a challenge…

Computation and Language · Computer Science 2022-04-14 Alicia Parrish , Harsh Trivedi , Ethan Perez , Angelica Chen , Nikita Nangia , Jason Phang , Samuel R. Bowman

Question answering (QA) has recently shown impressive results for answering questions from customized domains. Yet, a common challenge is to adapt QA models to an unseen target domain. In this paper, we propose a novel self-supervised…

Computation and Language · Computer Science 2022-10-21 Zhenrui Yue , Huimin Zeng , Bernhard Kratzwald , Stefan Feuerriegel , Dong Wang

Recently, significant efforts have been devoted to enhancing the long-context capabilities of Large Language Models (LLMs), particularly in long-context reasoning. To facilitate this research, we propose \textbf{DetectiveQA}, a dataset…

Computation and Language · Computer Science 2025-03-17 Zhe Xu , Jiasheng Ye , Xiaoran Liu , Xiangyang Liu , Tianxiang Sun , Zhigeng Liu , Qipeng Guo , Linlin Li , Qun Liu , Xuanjing Huang , Xipeng Qiu

Long-context modeling is one of the critical capabilities of language AI for digesting and reasoning over complex information pieces. In practice, long-context capabilities are typically built into a pre-trained language model~(LM) through…

Computation and Language · Computer Science 2024-10-15 Luyu Gao , Yunyi Zhang , Jamie Callan
‹ Prev 1 2 3 10 Next ›