English
Related papers

Related papers: Towards Better Generalization in Open-Domain Quest…

200 papers

Visual Question Answering (VQA) has attracted much attention since it offers insight into the relationships between the multi-modal analysis of images and natural language. Most of the current algorithms are incapable of answering…

Computer Vision and Pattern Recognition · Computer Science 2017-12-05 Guohao Li , Hang Su , Wenwu Zhu

Adapting models to new domain without finetuning is a challenging problem in deep learning. In this paper, we utilize an adversarial training framework for domain generalization in Question Answering (QA) task. Our model consists of a…

Computation and Language · Computer Science 2019-10-23 Seanie Lee , Donggyu Kim , Jangwon Park

Question answering (QA) has become an important application in the advanced development of large language models. General pre-trained large language models for question-answering are not trained to properly understand the knowledge or…

Computation and Language · Computer Science 2024-05-30 Sanat Sharma , David Seunghyun Yoon , Franck Dernoncourt , Dewang Sultania , Karishma Bagga , Mengjiao Zhang , Trung Bui , Varun Kotte

Question generation has recently shown impressive results in customizing question answering (QA) systems to new domains. These approaches circumvent the need for manually annotated training data from the new domain and, instead, generate…

Computation and Language · Computer Science 2021-09-01 Zhenrui Yue , Bernhard Kratzwald , Stefan Feuerriegel

Prior work in standardized science exams requires support from large text corpus, such as targeted science corpus fromWikipedia or SimpleWikipedia. However, retrieving knowledge from the large corpus is time-consuming and questions embedded…

Artificial Intelligence · Computer Science 2020-04-28 Xinyue Zheng , Peng Wang , Qigang Wang , Zhongchao Shi

We consider the problem of pretraining a two-stage open-domain question answering (QA) system (retriever + reader) with strong transfer capabilities. The key challenge is how to construct a large amount of high-quality…

Computation and Language · Computer Science 2022-03-23 Xiang Yue , Xiaoman Pan , Wenlin Yao , Dian Yu , Dong Yu , Jianshu Chen

Considerable progress has been made recently in open-domain question answering (QA) problems, which require Information Retrieval (IR) and Reading Comprehension (RC). A popular approach to improve the system's performance is to improve the…

Computation and Language · Computer Science 2022-05-10 Zhengzhong Liang , Tushar Khot , Steven Bethard , Mihai Surdeanu , Ashish Sabharwal

Open-domain question answering (QA) is the tasl of identifying answers to natural questions from a large corpus of documents. The typical open-domain QA system starts with information retrieval to select a subset of documents from the…

Computation and Language · Computer Science 2020-09-03 Sina J. Semnani , Manish Pandey

In this paper, we investigate Extractive Question Answering (EQA) with Large Language Models (LLMs) under domain drift, i.e., can LLMs generalize to domains that require specific knowledge such as medicine and law in a zero-shot fashion…

Computation and Language · Computer Science 2024-12-13 Saptarshi Sengupta , Wenpeng Yin , Preslav Nakov , Shreya Ghosh , Suhang Wang

We propose a novel open-domain question answering (ODQA) framework for answering single/multi-hop questions across heterogeneous knowledge sources. The key novelty of our method is the introduction of the intermediary modules into the…

Computation and Language · Computer Science 2022-10-25 Kaixin Ma , Hao Cheng , Xiaodong Liu , Eric Nyberg , Jianfeng Gao

The retriever-reader framework is popular for open-domain question answering (ODQA) due to its ability to use explicit knowledge. Although prior work has sought to increase the knowledge coverage by incorporating structured knowledge beyond…

Computation and Language · Computer Science 2022-03-22 Kaixin Ma , Hao Cheng , Xiaodong Liu , Eric Nyberg , Jianfeng Gao

Open-domain question answering (QA) is known to involve several underlying knowledge and reasoning challenges, but are models actually learning such knowledge when trained on benchmark tasks? To investigate this, we introduce several new…

Computation and Language · Computer Science 2020-09-03 Kyle Richardson , Ashish Sabharwal

While progress has been made on the visual question answering leaderboards, models often utilize spurious correlations and priors in datasets under the i.i.d. setting. As such, evaluation on out-of-distribution (OOD) test samples has…

Computer Vision and Pattern Recognition · Computer Science 2020-10-19 Tejas Gokhale , Pratyay Banerjee , Chitta Baral , Yezhou Yang

This paper explores domain adaptation for enabling question answering (QA) systems to answer questions posed against documents in new specialized domains. Current QA systems using deep neural network (DNN) technology have proven effective…

Computation and Language · Computer Science 2019-11-11 Timothy J. Hazen , Shehzaad Dhuliawala , Daniel Boies

With the rise of large-scale pre-trained language models, open-domain question-answering (ODQA) has become an important research topic in NLP. Based on the popular pre-training fine-tuning approach, we posit that an additional in-domain…

Computation and Language · Computer Science 2022-05-03 Patrick Huber , Armen Aghajanyan , Barlas Oğuz , Dmytro Okhonko , Wen-tau Yih , Sonal Gupta , Xilun Chen

Continual Test-Time Adaptation (CTTA) aims to adapt a source pre-trained model to continually changing target domains during inference. As a fundamental principle, an ideal CTTA method should rapidly adapt to new domains (exploration) while…

Computer Vision and Pattern Recognition · Computer Science 2025-08-19 Pinci Yang , Peisong Wen , Ke Ma , Qianqian Xu

We introduce REALTIME QA, a dynamic question answering (QA) platform that announces questions and evaluates systems on a regular basis (weekly in this version). REALTIME QA inquires about the current world, and QA systems need to answer…

Computation and Language · Computer Science 2024-02-29 Jungo Kasai , Keisuke Sakaguchi , Yoichi Takahashi , Ronan Le Bras , Akari Asai , Xinyan Yu , Dragomir Radev , Noah A. Smith , Yejin Choi , Kentaro Inui

In conversational QA, models have to leverage information in previous turns to answer upcoming questions. Current approaches, such as Question Rewriting, struggle to extract relevant information as the conversation unwinds. We introduce the…

Computation and Language · Computer Science 2022-04-11 Marco Del Tredici , Xiaoyu Shen , Gianni Barlacchi , Bill Byrne , Adrià de Gispert

Open-domain conversational question answering can be viewed as two tasks: passage retrieval and conversational question answering, where the former relies on selecting candidate passages from a large corpus and the latter requires better…

Computation and Language · Computer Science 2022-11-18 Hung-Chieh Fang , Kuo-Han Hung , Chao-Wei Huang , Yun-Nung Chen

Retrieval based open-domain QA systems use retrieved documents and answer-span selection over retrieved documents to find best-answer candidates. We hypothesize that multilingual Question Answering (QA) systems are prone to information…

Computation and Language · Computer Science 2022-05-26 Shramay Palta , Haozhe An , Yifan Yang , Shuaiyi Huang , Maharshi Gor