English
Related papers

Related papers: An Enhanced Knowledge Injection Model for Commonse…

200 papers

Inferring contextually-relevant and diverse commonsense to understand narratives remains challenging for knowledge models. In this work, we develop a series of knowledge models, DiffuCOMET, that leverage diffusion to learn to reconstruct…

Computation and Language · Computer Science 2024-10-02 Silin Gao , Mete Ismayilzada , Mengjie Zhao , Hiromi Wakaki , Yuki Mitsufuji , Antoine Bosselut

Transformer models pre-trained with a masked-language-modeling objective (e.g., BERT) encode commonsense knowledge as evidenced by behavioral probes; however, the extent to which this knowledge is acquired by systematic inference over the…

Computation and Language · Computer Science 2021-12-17 Ian Porada , Alessandro Sordoni , Jackie Chi Kit Cheung

Recent advances in general purpose pre-trained language models have shown great potential in commonsense reasoning. However, current works still perform poorly on standard commonsense reasoning benchmarks including the Com2Sense Dataset. We…

Computation and Language · Computer Science 2023-10-11 Yu Zhou , Yunqiu Han , Hanyu Zhou , Yulun Wu

Although large language models (LLMs) excel in knowledge recall and reasoning, their static nature leads to outdated information as the real world evolves or when adapting to domain-specific knowledge, highlighting the need for effective…

Computation and Language · Computer Science 2025-04-02 Ruoxi Xu , Yunjie Ji , Boxi Cao , Yaojie Lu , Hongyu Lin , Xianpei Han , Ben He , Yingfei Sun , Xiangang Li , Le Sun

Conventional Machine Reading Comprehension (MRC) has been well-addressed by pattern matching, but the ability of commonsense reasoning remains a gap between humans and machines. Previous methods tackle this problem by enriching word…

Computation and Language · Computer Science 2021-03-29 Damai Dai , Hua Zheng , Zhifang Sui , Baobao Chang

Commonsense question answering (QA) requires background knowledge which is not explicitly stated in a given context. Prior works use commonsense knowledge graphs (KGs) to obtain this knowledge for reasoning. However, relying entirely on…

Computation and Language · Computer Science 2020-09-22 Peifeng Wang , Nanyun Peng , Filip Ilievski , Pedro Szekely , Xiang Ren

A hyperbole is an intentional and creative exaggeration not to be taken literally. Despite its ubiquity in daily life, the computational explorations of hyperboles are scarce. In this paper, we tackle the under-explored and challenging…

Computation and Language · Computer Science 2021-09-14 Yufei Tian , Arvind krishna Sridhar , Nanyun Peng

Commonsense knowledge has proven to be beneficial to a variety of application areas, including question answering and natural language understanding. Previous work explored collecting commonsense knowledge triples automatically from text to…

Computation and Language · Computer Science 2021-02-02 Zhicheng Liang , Deborah L. McGuinness

We consider generation and comprehension of natural language referring expression for objects in an image. Unlike generic "image captioning" which lacks natural standard evaluation criteria, quality of a referring expression may be measured…

Computer Vision and Pattern Recognition · Computer Science 2017-01-13 Ruotian Luo , Gregory Shakhnarovich

Grounding dialogue on external knowledge and interpreting linguistic patterns in dialogue history context, such as ellipsis, anaphora, and co-references is critical for dialogue comprehension and generation. In this paper, we present a…

Computation and Language · Computer Science 2022-05-30 Deeksha Varshney , Akshara Prabhakar , Asif Ekbal

This work establishes the concept of commonsense scene composition, with a focus on extending Belief Scene Graphs by estimating the spatial distribution of unseen objects. Specifically, the commonsense scene composition capability refers to…

Commonsense reasoning aims to incorporate sets of commonsense facts, retrieved from Commonsense Knowledge Graphs (CKG), to draw conclusion about ordinary situations. The dynamic nature of commonsense knowledge postulates models capable of…

Artificial Intelligence · Computer Science 2021-05-17 Farhad Moghimifar , Lizhen Qu , Yue Zhuo , Gholamreza Haffari , Mahsa Baktashmotlagh

Induction of common sense knowledge about prototypical sequences of events has recently received much attention. Instead of inducing this knowledge in the form of graphs, as in much of the previous work, in our method, distributed…

Machine Learning · Computer Science 2017-02-13 Ashutosh Modi , Ivan Titov

This paper studies constrained text generation, which is to generate sentences under certain pre-conditions. We focus on CommonGen, the task of generating text based on a set of concepts, as a representative task of constrained text…

Computation and Language · Computer Science 2021-03-15 Yixian Liu , Liwen Zhang , Wenjuan Han , Yue Zhang , Kewei Tu

A fundamental ability of humans is to utilize commonsense knowledge in language understanding and question answering. In recent years, many knowledge-enhanced Commonsense Question Answering (CQA) approaches have been proposed. However, it…

Computation and Language · Computer Science 2021-01-06 Ning Bian , Xianpei Han , Bo Chen , Le Sun

In question answering requiring common sense, language models (e.g., GPT-3) have been used to generate text expressing background knowledge that helps improve performance. Yet the cost of working with such models is very high; in this work,…

Computation and Language · Computer Science 2023-07-18 Wenya Wang , Vivek Srikumar , Hanna Hajishirzi , Noah A. Smith

When humans perform inductive learning, they often enhance the process with background knowledge. With the increasing availability of well-formed collaborative knowledge bases, the performance of learning algorithms could be significantly…

Artificial Intelligence · Computer Science 2018-02-02 Lior Friedman , Shaul Markovitch

Building dialog agents that can converse naturally with humans is a challenging yet intriguing problem of artificial intelligence. In open-domain human-computer conversation, where the conversational agent is expected to respond to human…

Artificial Intelligence · Computer Science 2018-02-13 Tom Young , Erik Cambria , Iti Chaturvedi , Minlie Huang , Hao Zhou , Subham Biswas

Commonsense reasoning simulates the human ability to make presumptions about our physical world, and it is an indispensable cornerstone in building general AI systems. We propose a new commonsense reasoning dataset based on human's…

Artificial Intelligence · Computer Science 2020-10-21 Mo Yu , Xiaoxiao Guo , Yufei Feng , Xiaodan Zhu , Michael Greenspan , Murray Campbell

Commonsense question answering (CQA) aims to test if models can answer questions regarding commonsense knowledge that everyone knows. Prior works that incorporate external knowledge bases have shown promising results, but knowledge bases…

Computation and Language · Computer Science 2022-01-04 Zi-Yi Dou , Nanyun Peng