English
Related papers

Related papers: Zero-shot Commonsense Question Answering with Cloz…

200 papers

Commonsense question answering (QA) requires background knowledge which is not explicitly stated in a given context. Prior works use commonsense knowledge graphs (KGs) to obtain this knowledge for reasoning. However, relying entirely on…

Computation and Language · Computer Science 2020-09-22 Peifeng Wang , Nanyun Peng , Filip Ilievski , Pedro Szekely , Xiang Ren

Smooth and effective communication requires the ability to perform latent or explicit commonsense inference. Prior commonsense reasoning benchmarks (such as SocialIQA and CommonsenseQA) mainly focus on the discriminative task of choosing…

Computation and Language · Computer Science 2021-09-23 Pei Zhou , Karthik Gopalakrishnan , Behnam Hedayatnia , Seokhwan Kim , Jay Pujara , Xiang Ren , Yang Liu , Dilek Hakkani-Tur

Prior work on multilingual question answering has mostly focused on using large multilingual pre-trained language models (LM) to perform zero-shot language-wise learning: train a QA model on English and test on other languages. In this…

Computation and Language · Computer Science 2020-12-14 Mihaela Bornea , Lin Pan , Sara Rosenthal , Radu Florian , Avirup Sil

Existing pre-training methods for extractive Question Answering (QA) generate cloze-like queries different from natural questions in syntax structure, which could overfit pre-trained models to simple keyword matching. In order to address…

Computation and Language · Computer Science 2023-10-17 Minda Hu , Muzhi Li , Yasheng Wang , Irwin King

Commonsense reasoning (CSR) requires the model to be equipped with general world knowledge. While CSR is a language-agnostic process, most comprehensive knowledge sources are in few popular languages, especially English. Thus, it remains…

Computation and Language · Computer Science 2021-10-19 Yuwei Fang , Shuohang Wang , Yichong Xu , Ruochen Xu , Siqi Sun , Chenguang Zhu , Michael Zeng

In this paper, we aim to extract commonsense knowledge to improve machine reading comprehension. We propose to represent relations implicitly by situating structured knowledge in a context instead of relying on a pre-defined set of…

Computation and Language · Computer Science 2020-10-20 Kai Sun , Dian Yu , Jianshu Chen , Dong Yu , Claire Cardie

Zero shot learning -- the problem of training and testing on a completely disjoint set of classes -- relies greatly on its ability to transfer knowledge from train classes to test classes. Traditionally semantic embeddings consisting of…

Computation and Language · Computer Science 2020-12-14 Abhinaba Roy , Deepanway Ghosal , Erik Cambria , Navonil Majumder , Rada Mihalcea , Soujanya Poria

It remains an open question whether incorporating external knowledge benefits commonsense reasoning while maintaining the flexibility of pretrained sequence models. To investigate this question, we develop generated knowledge prompting,…

Computation and Language · Computer Science 2022-09-30 Jiacheng Liu , Alisa Liu , Ximing Lu , Sean Welleck , Peter West , Ronan Le Bras , Yejin Choi , Hannaneh Hajishirzi

Open-domain question answering (QA) is known to involve several underlying knowledge and reasoning challenges, but are models actually learning such knowledge when trained on benchmark tasks? To investigate this, we introduce several new…

Computation and Language · Computer Science 2020-09-03 Kyle Richardson , Ashish Sabharwal

Large pre-trained language models (PLMs) have led to great success on various commonsense question answering (QA) tasks in an end-to-end fashion. However, little attention has been paid to what commonsense knowledge is needed to deeply…

Computation and Language · Computer Science 2021-09-14 Gengyu Wang , Xiaochen Hou , Diyi Yang , Kathleen McKeown , Jing Huang

Commonsense reasoning benchmarks have been largely solved by fine-tuning language models. The downside is that fine-tuning may cause models to overfit to task-specific data and thereby forget their knowledge gained during pre-training.…

Computation and Language · Computer Science 2021-09-08 Kaixin Ma , Filip Ilievski , Jonathan Francis , Satoru Ozaki , Eric Nyberg , Alessandro Oltramari

Community Question-Answering (CQA) portals serve as a valuable tool for helping users within an organization. However, making them accessible to non-English-speaking users continues to be a challenge. Translating questions can broaden the…

Computation and Language · Computer Science 2023-10-25 Baban Gain , Ramakrishna Appicharla , Soumya Chennabasavaraj , Nikesh Garera , Asif Ekbal , Muthusamy Chelliah

With the rise of large-scale pre-trained language models, open-domain question-answering (ODQA) has become an important research topic in NLP. Based on the popular pre-training fine-tuning approach, we posit that an additional in-domain…

Computation and Language · Computer Science 2022-05-03 Patrick Huber , Armen Aghajanyan , Barlas Oğuz , Dmytro Okhonko , Wen-tau Yih , Sonal Gupta , Xilun Chen

Causal Video Question Answering (CVidQA) queries not only association or temporal relations but also causal relations in a video. Existing question synthesis methods pre-trained question generation (QG) systems on reading comprehension…

Computation and Language · Computer Science 2023-04-10 Hung-Ting Su , Yulei Niu , Xudong Lin , Winston H. Hsu , Shih-Fu Chang

Chart question answering (CQA) is a task used for assessing chart comprehension, which is fundamentally different from understanding natural images. CQA requires analyzing the relationships between the textual and the visual components of a…

Computer Vision and Pattern Recognition · Computer Science 2022-07-12 Matan Levy , Rami Ben-Ari , Dani Lischinski

We propose a simple method to generate multilingual question and answer pairs on a large scale through the use of a single generative model. These synthetic samples can be used to improve the zero-shot performance of multilingual QA models…

Computation and Language · Computer Science 2021-06-01 Siamak Shakeri , Noah Constant , Mihir Sanjay Kale , Linting Xue

Large-scale commonsense knowledge bases empower a broad range of AI applications, where the automatic extraction of commonsense knowledge (CKE) is a fundamental and challenging problem. CKE from text is known for suffering from the inherent…

Computer Vision and Pattern Recognition · Computer Science 2023-03-28 Yuan Yao , Tianyu Yu , Ao Zhang , Mengdi Li , Ruobing Xie , Cornelius Weber , Zhiyuan Liu , Hai-Tao Zheng , Stefan Wermter , Tat-Seng Chua , Maosong Sun

Question Answering (QA) is the task of automatically answering questions posed by humans in natural languages. There are different settings to answer a question, such as abstractive, extractive, boolean, and multiple-choice QA. As a popular…

Computation and Language · Computer Science 2023-04-07 Zhichao Duan , Xiuxing Li , Zhengyan Zhang , Zhenyu Li , Ning Liu , Jianyong Wang

Question answering over knowledge bases (KBQA) has become a popular approach to help users extract information from knowledge bases. Although several systems exist, choosing one suitable for a particular application scenario is difficult.…

Computation and Language · Computer Science 2022-11-16 Khiem Vinh Tran , Hao Phu Phan , Khang Nguyen Duc Quach , Ngan Luu-Thuy Nguyen , Jun Jo , Thanh Tam Nguyen

Although transfer learning has been shown to be successful for tasks like object and speech recognition, its applicability to question answering (QA) has yet to be well-studied. In this paper, we conduct extensive experiments to investigate…

Computation and Language · Computer Science 2018-04-24 Yu-An Chung , Hung-Yi Lee , James Glass