English
Related papers

Related papers: Semantically Enhanced Models for Commonsense Knowl…

200 papers

With the emerging branch of incorporating factual knowledge into pre-trained language models such as BERT, most existing models consider shallow, static, and separately pre-trained entity embeddings, which limits the performance gains of…

Computation and Language · Computer Science 2020-10-02 Tianxiang Sun , Yunfan Shao , Xipeng Qiu , Qipeng Guo , Yaru Hu , Xuanjing Huang , Zheng Zhang

Knowledge Graph Embedding (KGE) aims to represent entities and relations of knowledge graph in a low-dimensional continuous vector space. Recent works focus on incorporating structural knowledge with additional information, such as entity…

Computation and Language · Computer Science 2018-08-14 Kai Wang , Yu Liu , Xiujuan Xu , Dan Lin

Knowledge Editing (KE) aims to adjust a Large Language Model's (LLM) internal representations and parameters to correct inaccuracies and improve output consistency without incurring the computational expense of re-training the entire model.…

Computation and Language · Computer Science 2025-05-29 Liyu Zhang , Weiqi Wang , Tianqing Fang , Yangqiu Song

Answering logical queries on knowledge graphs (KG) poses a significant challenge for machine reasoning. The primary obstacle in this task stems from the inherent incompleteness of KGs. Existing research has predominantly focused on…

Machine Learning · Computer Science 2024-03-20 Zezhong Xu , Peng Ye , Lei Liang , Huajun Chen , Wen Zhang

Non-extractive commonsense QA remains a challenging AI task, as it requires systems to reason about, synthesize, and gather disparate pieces of information, in order to generate responses to queries. Recent approaches on such tasks show…

Computation and Language · Computer Science 2019-11-01 Kaixin Ma , Jonathan Francis , Quanyang Lu , Eric Nyberg , Alessandro Oltramari

Neural models of Knowledge Base data have typically employed compositional representations of graph objects: entity and relation embeddings are systematically combined to evaluate the truth of a candidate Knowedge Base entry. Using a model…

Computation and Language · Computer Science 2019-08-14 Matthias Lalisse , Paul Smolensky

Knowledge graph embedding (KGE) is an increasingly popular technique that aims to represent entities and relations of knowledge graphs into low-dimensional semantic spaces for a wide spectrum of applications such as link prediction,…

Machine Learning · Computer Science 2023-10-17 Jiahang Cao , Jinyuan Fang , Zaiqiao Meng , Shangsong Liang

Many mathematical models have been leveraged to design embeddings for representing Knowledge Graph (KG) entities and relations for link prediction and many downstream tasks. These mathematically-inspired models are not only highly scalable…

Artificial Intelligence · Computer Science 2023-09-25 Xiou Ge , Yun-Cheng Wang , Bin Wang , C. -C. Jay Kuo

Knowledge Graph Embedding (KGE) methods have gained enormous attention from a wide range of AI communities including Natural Language Processing (NLP) for text generation, classification and context induction. Embedding a huge number of…

Artificial Intelligence · Computer Science 2022-09-19 Mojtaba Moattari , Sahar Vahdati , Farhana Zulkernine

Generative commonsense reasoning refers to the task of generating acceptable and logical assumptions about everyday situations based on commonsense understanding. By utilizing an existing dataset such as Korean CommonGen, language…

Computation and Language · Computer Science 2023-06-27 Dahyun Jung , Jaehyung Seo , Jaewook Lee , Chanjun Park , Heuiseok Lim

Commonsense knowledge graph reasoning(CKGR) is the task of predicting a missing entity given one existing and the relation in a commonsense knowledge graph (CKG). Existing methods can be classified into two categories generation method and…

Computation and Language · Computer Science 2020-08-14 Cunxiang Wang , Jinhang Wu , Luxin Liu , Yue Zhang

Knowledge Graph Embedding (KGE) techniques play a pivotal role in transforming symbolic Knowledge Graphs (KGs) into numerical representations, thereby enhancing various deep learning models for knowledge-augmented applications. Unlike…

Machine Learning · Computer Science 2025-03-24 Guanglin Niu

Commonsense knowledge is crucial to many natural language processing tasks. Existing works usually incorporate graph knowledge with conventional graph neural networks (GNNs), resulting in a sequential pipeline that compartmentalizes the…

Computation and Language · Computer Science 2024-09-24 Hongbo Zhang , Chen Tang , Tyler Loakman , Bohao Yang , Stefan Goetze , Chenghua Lin

Embedding models for deterministic Knowledge Graphs (KG) have been extensively studied, with the purpose of capturing latent semantic relations between entities and incorporating the structured knowledge into machine learning. However,…

Artificial Intelligence · Computer Science 2019-12-24 Xuelu Chen , Muhao Chen , Weijia Shi , Yizhou Sun , Carlo Zaniolo

Knowledge graphs (KGs) consisting of a large number of triples have become widespread recently, and many knowledge graph embedding (KGE) methods are proposed to embed entities and relations of a KG into continuous vector spaces. Such…

Machine Learning · Computer Science 2022-05-09 Mingyang Chen , Wen Zhang , Yushan Zhu , Hongting Zhou , Zonggang Yuan , Changliang Xu , Huajun Chen

Building dialog agents that can converse naturally with humans is a challenging yet intriguing problem of artificial intelligence. In open-domain human-computer conversation, where the conversational agent is expected to respond to human…

Artificial Intelligence · Computer Science 2018-02-13 Tom Young , Erik Cambria , Iti Chaturvedi , Minlie Huang , Hao Zhou , Subham Biswas

Recently, pretrained language models (e.g., BERT) have achieved great success on many downstream natural language understanding tasks and exhibit a certain level of commonsense reasoning ability. However, their performance on commonsense…

Artificial Intelligence · Computer Science 2023-02-17 Shiyang Li , Jianshu Chen , Dian Yu

Knowledge graph embedding (KGE), aiming to embed entities and relations into low-dimensional vectors, has attracted wide attention recently. However, the existing research is mainly based on the black-box neural models, which makes it…

Computation and Language · Computer Science 2020-11-13 Xiaoyu Kou , Yankai Lin , Yuntao Li , Jiahao Xu , Peng Li , Jie Zhou , Yan Zhang

Knowledge graphs (KGs), as structured representations of real world facts, are intelligent databases incorporating human knowledge that can help machine imitate the way of human problem solving. However, KGs are usually huge and there are…

Machine Learning · Computer Science 2023-06-27 Haotian Li , Hongri Liu , Yao Wang , Guodong Xin , Yuliang Wei

Commonsense question answering has demonstrated considerable potential across various applications like assistants and social robots. Although fully fine-tuned pre-trained Language Models(LM) have achieved remarkable performance in…

Computation and Language · Computer Science 2024-05-10 Ruiting Dai , Yuqiao Tan , Lisi Mo , Shuang Liang , Guohao Huo , Jiayi Luo , Yao Cheng