English
Related papers

Related papers: An Enhanced Knowledge Injection Model for Commonse…

200 papers

Deploying AI-powered systems requires trustworthy models supporting effective human interactions, going beyond raw prediction accuracy. Concept bottleneck models promote trustworthiness by conditioning classification tasks on an…

After learning a concept, humans are also able to continually generalize their learned concepts to new domains by observing only a few labeled instances without any interference with the past learned knowledge. In contrast, learning…

Machine Learning · Computer Science 2019-09-10 Mohammad Rostami , Soheil Kolouri , James McClelland , Praveen Pilly

Commonsense knowledge representation and reasoning is key for tasks such as artificial intelligence and natural language understanding. Since commonsense consists of information that humans take for granted, gathering it is an extremely…

Multimedia · Computer Science 2016-02-04 Erik Cambria , Tam V. Nguyen , Brian Cheng , Kenneth Kwok , Jose Sepulveda

Conversation generation as a challenging task in Natural Language Generation (NLG) has been increasingly attracting attention over the last years. A number of recent works adopted sequence-to-sequence structures along with external…

Computation and Language · Computer Science 2021-08-23 Changzhen Ji , Yating Zhang , Xiaozhong Liu , Adam Jatowt , Changlong Sun , Conghui Zhu , Tiejun Zhao

Concept Bottleneck Models (CBMs) map the black-box visual representations extracted by deep neural networks onto a set of interpretable concepts and use the concepts to make predictions, enhancing the transparency of the decision-making…

Machine Learning · Computer Science 2024-04-18 Chenming Shang , Shiji Zhou , Hengyuan Zhang , Xinzhe Ni , Yujiu Yang , Yuwang Wang

In this work we leverage commonsense knowledge in form of knowledge paths to establish connections between sentences, as a form of explicitation of implicit knowledge. Such connections can be direct (singlehop paths) or require intermediate…

Computation and Language · Computer Science 2021-05-10 Maria Becker , Katharina Korfhage , Debjit Paul , Anette Frank

Prior work has shown that the ordering in which concepts are shown to a commonsense generator plays an important role, affecting the quality of the generated sentence. However, it remains a challenge to determine the optimal ordering of a…

Computation and Language · Computer Science 2023-09-13 Tianhui Zhang , Danushka Bollegala , Bei Peng

The pre-trained conversational models still fail to capture the implicit commonsense (CS) knowledge hidden in the dialogue interaction, even though they were pre-trained with an enormous dataset. In order to build a dialogue agent with CS…

Computation and Language · Computer Science 2022-10-03 Ye Liu , Wolfgang Maier , Wolfgang Minker , Stefan Ultes

Word embeddings capture syntactic and semantic information about words. Definition modeling aims to make the semantic content in each embedding explicit, by outputting a natural language definition based on the embedding. However, existing…

Computation and Language · Computer Science 2019-09-23 Ruimin Zhu , Thanapon Noraset , Alisa Liu , Wenxin Jiang , Doug Downey

Current language models are unable to quickly learn new concepts on the fly, often requiring a more involved finetuning process to learn robustly. Prompting in-context is not robust to context distractions, and often fails to confer much…

Computation and Language · Computer Science 2024-10-18 Ryan Teehan , Brenden Lake , Mengye Ren

Concept bottleneck models (CBM) aim to produce inherently interpretable models that rely on human-understandable concepts for their predictions. However, existing approaches to design interpretable generative models based on CBMs are not…

Computer Vision and Pattern Recognition · Computer Science 2025-03-26 Akshay Kulkarni , Ge Yan , Chung-En Sun , Tuomas Oikarinen , Tsui-Wei Weng

There has been considerable recent interest in interpretable concept-based models such as Concept Bottleneck Models (CBMs), which first predict human-interpretable concepts and then map them to output classes. To reduce reliance on…

Machine Learning · Computer Science 2024-07-08 Simon Schrodi , Julian Schur , Max Argus , Thomas Brox

Mastering commonsense understanding and reasoning is a pivotal skill essential for conducting engaging conversations. While there have been several attempts to create datasets that facilitate commonsense inferences in dialogue contexts,…

Computation and Language · Computer Science 2024-01-30 Sarah E. Finch , Jinho D. Choi

The sequential process of conceptualization and instantiation is essential to generalizable commonsense reasoning as it allows the application of existing knowledge to unfamiliar scenarios. However, existing works tend to undervalue the…

Computation and Language · Computer Science 2024-05-24 Weiqi Wang , Tianqing Fang , Chunyang Li , Haochen Shi , Wenxuan Ding , Baixuan Xu , Zhaowei Wang , Jiaxin Bai , Xin Liu , Jiayang Cheng , Chunkit Chan , Yangqiu Song

We motivate and propose a suite of simple but effective improvements for concept-to-text generation called SAPPHIRE: Set Augmentation and Post-hoc PHrase Infilling and REcombination. We demonstrate their effectiveness on generative…

Computation and Language · Computer Science 2021-12-03 Steven Y. Feng , Jessica Huynh , Chaitanya Narisetty , Eduard Hovy , Varun Gangal

Many hallmarks of human intelligence, such as generalizing from limited experience, abstract reasoning and planning, analogical reasoning, creative problem solving, and capacity for language require the ability to consolidate experience…

Artificial Intelligence · Computer Science 2018-11-07 Igor Mordatch

Human conversations naturally evolve around related concepts and scatter to multi-hop concepts. This paper presents a new conversation generation model, ConceptFlow, which leverages commonsense knowledge graphs to explicitly model…

Computation and Language · Computer Science 2020-05-07 Houyu Zhang , Zhenghao Liu , Chenyan Xiong , Zhiyuan Liu

Large language models (LLMs) sometimes demonstrate poor performance on knowledge-intensive tasks, commonsense reasoning is one of them. Researchers typically address these issues by retrieving related knowledge from knowledge graphs or…

Computation and Language · Computer Science 2024-10-15 Jiachun Li , Pengfei Cao , Chenhao Wang , Zhuoran Jin , Yubo Chen , Kang Liu , Xiaojian Jiang , Jiexin Xu , Jun Zhao

This paper proposes a knowledge-enhanced disease diagnosis method based on a prompt learning framework. The method retrieves structured knowledge from external knowledge graphs related to clinical cases, encodes it, and injects it into the…

Computation and Language · Computer Science 2024-09-17 Zhang Zheng

We study knowledge-grounded dialogue generation with pre-trained language models. To leverage the redundant external knowledge under capacity constraint, we propose equipping response generation defined by a pre-trained language model with…

Computation and Language · Computer Science 2020-10-20 Xueliang Zhao , Wei Wu , Can Xu , Chongyang Tao , Dongyan Zhao , Rui Yan