English
Related papers

Related papers: CommonsenseQA: A Question Answering Challenge Targ…

200 papers

Commonsense knowledge has proven to be beneficial to a variety of application areas, including question answering and natural language understanding. Previous work explored collecting commonsense knowledge triples automatically from text to…

Computation and Language · Computer Science 2021-02-02 Zhicheng Liang , Deborah L. McGuinness

Questions involving commonsense reasoning about everyday situations often admit many $\textit{possible}$ or $\textit{plausible}$ answers. In contrast, multiple-choice question (MCQ) benchmarks for commonsense reasoning require a hard…

Computation and Language · Computer Science 2024-10-16 Shramay Palta , Nishant Balepur , Peter Rankel , Sarah Wiegreffe , Marine Carpuat , Rachel Rudinger

While commonsense knowledge acquisition and reasoning has traditionally been a core research topic in the knowledge representation and reasoning community, recent years have seen a surge of interest in the natural language processing…

Computation and Language · Computer Science 2022-02-01 Prajjwal Bhargava , Vincent Ng

Commonsense fact verification, as a challenging branch of commonsense question-answering (QA), aims to verify through facts whether a given commonsense claim is correct or not. Answering commonsense questions necessitates a combination of…

Computation and Language · Computer Science 2023-05-30 Anni Zou , Zhuosheng Zhang , Hai Zhao

We describe a detailed analysis of a sample of large benchmark of commonsense reasoning problems that has been automatically obtained from WordNet, SUMO and their mapping. The objective is to provide a better assessment of the quality of…

Artificial Intelligence · Computer Science 2019-09-09 Javier Álvez , Itziar Gonzalez-Dios , German Rigau

Starting from the COMET methodology by Bosselut et al. (2019), generating commonsense knowledge directly from pre-trained language models has recently received significant attention. Surprisingly, up to now no materialized resource of…

Computation and Language · Computer Science 2022-09-13 Tuan-Phong Nguyen , Simon Razniewski

While there has been substantial progress in text comprehension through simple factoid question answering, more holistic comprehension of a discourse still presents a major challenge (Dunietz et al., 2020). Someone critically reflecting on…

Computation and Language · Computer Science 2022-10-18 Wei-Jen Ko , Cutter Dalton , Mark Simmons , Eliza Fisher , Greg Durrett , Junyi Jessy Li

Knowledge graph question answering (KGQA) is a well-established field that seeks to provide factual answers to natural language (NL) questions by leveraging knowledge graphs (KGs). However, existing KGQA datasets suffer from two significant…

Computation and Language · Computer Science 2024-03-05 Willis Guo , Armin Toroghi , Scott Sanner

Commonsense reasoning aims to empower machines with the human ability to make presumptions about ordinary situations in our daily life. In this paper, we propose a textual inference framework for answering commonsense questions, which…

Computation and Language · Computer Science 2019-09-06 Bill Yuchen Lin , Xinyue Chen , Jamin Chen , Xiang Ren

Current commonsense reasoning research focuses on developing models that use commonsense knowledge to answer multiple-choice questions. However, systems designed to answer multiple-choice questions may not be useful in applications that do…

Computation and Language · Computer Science 2021-06-08 Bill Yuchen Lin , Haitian Sun , Bhuwan Dhingra , Manzil Zaheer , Xiang Ren , William W. Cohen

Commonsense reasoning simulates the human ability to make presumptions about our physical world, and it is an indispensable cornerstone in building general AI systems. We propose a new commonsense reasoning dataset based on human's…

Artificial Intelligence · Computer Science 2020-10-21 Mo Yu , Xiaoxiao Guo , Yufei Feng , Xiaodan Zhu , Michael Greenspan , Murray Campbell

Recently, large-scale pre-trained language models have demonstrated impressive performance on several commonsense-reasoning benchmark datasets. However, building machines with commonsense to compose realistically plausible sentences remains…

Computation and Language · Computer Science 2020-12-01 Bill Yuchen Lin , Wangchunshu Zhou , Ming Shen , Pei Zhou , Chandra Bhagavatula , Yejin Choi , Xiang Ren

CommonsenseQA is a task in which a correct answer is predicted through commonsense reasoning with pre-defined knowledge. Most previous works have aimed to improve the performance with distributed representation without considering the…

Computation and Language · Computer Science 2020-11-09 Jungwoo Lim , Dongsuk Oh , Yoonna Jang , Kisu Yang , Heuiseok Lim

Answering complex questions is a time-consuming activity for humans that requires reasoning and integration of information. Recent work on reading comprehension made headway in answering simple questions, but tackling complex questions is…

Computation and Language · Computer Science 2018-03-20 Alon Talmor , Jonathan Berant

Recent developments in pre-trained neural language modeling have led to leaps in accuracy on commonsense question-answering benchmarks. However, there is increasing concern that models overfit to specific tasks, without learning to utilize…

Computation and Language · Computer Science 2020-12-16 Kaixin Ma , Filip Ilievski , Jonathan Francis , Yonatan Bisk , Eric Nyberg , Alessandro Oltramari

Given questions regarding some prototypical situation such as Name something that people usually do before they leave the house for work? a human can easily answer them via acquired experiences. There can be multiple right answers for such…

Computation and Language · Computer Science 2020-10-29 Michael Boratko , Xiang Lorraine Li , Rajarshi Das , Tim O'Gorman , Dan Le , Andrew McCallum

It remains an open question whether incorporating external knowledge benefits commonsense reasoning while maintaining the flexibility of pretrained sequence models. To investigate this question, we develop generated knowledge prompting,…

Computation and Language · Computer Science 2022-09-30 Jiacheng Liu , Alisa Liu , Ximing Lu , Sean Welleck , Peter West , Ronan Le Bras , Yejin Choi , Hannaneh Hajishirzi

Commonsense reasoning is an important aspect of building robust AI systems and is receiving significant attention in the natural language understanding, computer vision, and knowledge graphs communities. At present, a number of valuable…

Artificial Intelligence · Computer Science 2020-06-24 Filip Ilievski , Pedro Szekely , Jingwei Cheng , Fu Zhang , Ehsan Qasemi

Despite extensive research on a wide range of question answering (QA) systems, most existing work focuses on answer containment-i.e., assuming that answers can be directly extracted and/or generated from documents in the corpus. However,…

Computation and Language · Computer Science 2026-02-03 Jamshid Mozafari , Hamed Zamani , Guido Zuccon , Adam Jatowt

Question answering models commonly have access to two sources of "knowledge" during inference time: (1) parametric knowledge - the factual knowledge encoded in the model weights, and (2) contextual knowledge - external knowledge (e.g., a…

Computation and Language · Computer Science 2022-11-11 Ella Neeman , Roee Aharoni , Or Honovich , Leshem Choshen , Idan Szpektor , Omri Abend