English
Related papers

Related papers: Towards Continual Knowledge Graph Embedding via In…

200 papers

Efficient deployment of deep neural networks on resource-constrained devices demands advanced compression techniques that preserve accuracy and interoperability. This paper proposes a machine learning framework that augments Knowledge…

Machine Learning · Computer Science 2025-03-18 David E. Hernandez , Jose Ramon Chang , Torbjörn E. M. Nordling

We present a novel class incremental learning approach based on deep neural networks, which continually learns new tasks with limited memory for storing examples in the previous tasks. Our algorithm is based on knowledge distillation and…

Machine Learning · Computer Science 2022-04-05 Minsoo Kang , Jaeyoo Park , Bohyung Han

Knowledge graph embedding (KGE) is a technique that enhances knowledge graphs by addressing incompleteness and improving knowledge retrieval. A limitation of the existing KGE models is their underutilization of ontologies, specifically the…

Social and Information Networks · Computer Science 2025-04-07 Takanori Ugai

Embedding models for deterministic Knowledge Graphs (KG) have been extensively studied, with the purpose of capturing latent semantic relations between entities and incorporating the structured knowledge into machine learning. However,…

Artificial Intelligence · Computer Science 2019-12-24 Xuelu Chen , Muhao Chen , Weijia Shi , Yizhou Sun , Carlo Zaniolo

Commonsense knowledge graph (CKG) is a special type of knowledge graph (KG), where entities are composed of free-form text. However, most existing CKG completion methods focus on the setting where all the entities are presented at training…

Artificial Intelligence · Computer Science 2021-02-19 Bin Wang , Guangtao Wang , Jing Huang , Jiaxuan You , Jure Leskovec , C. -C. Jay Kuo

Nowadays, Knowledge graphs (KGs) have been playing a pivotal role in AI-related applications. Despite the large sizes, existing KGs are far from complete and comprehensive. In order to continuously enrich KGs, automatic knowledge…

Computation and Language · Computer Science 2021-11-12 Zhao Zhang , Fuzhen Zhuang , Hengshu Zhu , Chao Li , Hui Xiong , Qing He , Yongjun Xu

Inductive knowledge graph completion has been considered as the task of predicting missing triplets between new entities that are not observed during training. While most inductive knowledge graph completion methods assume that all entities…

Machine Learning · Computer Science 2023-08-21 Jaejun Lee , Chanyoung Chung , Joyce Jiyoung Whang

Continual Knowledge Graph Embedding (CKGE) seeks to integrate new knowledge while preserving past information. However, existing methods struggle with efficiency and scalability due to two key limitations: (1) suboptimal knowledge…

Computation and Language · Computer Science 2025-06-11 Lijing Zhu , Qizhen Lan , Qing Tian , Wenbo Sun , Li Yang , Lu Xia , Yixin Xie , Xi Xiao , Tiehang Duan , Cui Tao , Shuteng Niu

Knowledge graph embedding~(KGE) aims to represent entities and relations into low-dimensional vectors for many real-world applications. The representations of entities and relations are learned via contrasting the positive and negative…

Artificial Intelligence · Computer Science 2022-02-22 Feihu Che , Guohua Yang , Pengpeng Shao , Dawei Zhang , Jianhua Tao

Graph autoencoders (GAEs), as a kind of generative self-supervised learning approach, have shown great potential in recent years. GAEs typically rely on distance-based criteria, such as mean-square-error (MSE), to reconstruct the input…

Machine Learning · Computer Science 2024-06-26 Ge Chen , Yulan Hu , Sheng Ouyang , Yong Liu , Cuicui Luo

Knowledge graph completion (KGC), the task of predicting missing information based on the existing relational data inside a knowledge graph (KG), has drawn significant attention in recent years. However, the predictive power of KGC methods…

Computation and Language · Computer Science 2023-05-26 Weihang Zhang , Ovidiu Serban , Jiahao Sun , Yi-ke Guo

Knowledge graph embedding (KGE) focuses on representing the entities and relations of a knowledge graph (KG) into the continuous vector spaces, which can be employed to predict the missing triples to achieve knowledge graph completion…

Computation and Language · Computer Science 2023-07-25 Yichi Zhang , Wen Zhang

Knowledge graphs (KGs) consisting of triples are always incomplete, so it's important to do Knowledge Graph Completion (KGC) by predicting missing triples. Multi-Source KG is a common situation in real KG applications which can be viewed as…

Computation and Language · Computer Science 2020-10-27 Mingyang Chen , Wen Zhang , Zonggang Yuan , Yantao Jia , Huajun Chen

Knowledge Graph Embedding (KGE) is a common approach for Knowledge Graphs (KGs) in AI tasks. Embedding dimensions depend on application scenarios. Requiring a new dimension means training a new KGE model from scratch, increasing cost and…

Artificial Intelligence · Computer Science 2025-06-13 Yushan Zhu , Wen Zhang , Zhiqiang Liu , Mingyang Chen , Lei Liang , Huajun Chen

Dynamic graph representation learning strategies are based on different neural architectures to capture the graph evolution over time. However, the underlying neural architectures require a large amount of parameters to train and suffer…

Machine Learning · Computer Science 2020-11-12 Stefanos Antaris , Dimitrios Rafailidis

Integrating structured knowledge from Knowledge Graphs (KGs) into Large Language Models (LLMs) remains a key challenge for symbolic reasoning. Existing methods mainly rely on prompt engineering or fine-tuning, which lose structural fidelity…

Machine Learning · Computer Science 2025-05-13 Erica Coppolillo

Incremental learning methods can learn new classes continually by distilling knowledge from the last model (as a teacher model) to the current model (as a student model) in the sequentially learning process. However, these methods cannot…

Computer Vision and Pattern Recognition · Computer Science 2022-02-25 Longhui Yu , Zhenyu Weng , Yuqing Wang , Yuesheng Zhu

Knowledge graph embedding (KGE) is a technique for learning continuous embeddings for entities and relations in the knowledge graph.Due to its benefit to a variety of downstream tasks such as knowledge graph completion, question answering…

Machine Learning · Computer Science 2019-06-25 Hengtong Zhang , Tianhang Zheng , Jing Gao , Chenglin Miao , Lu Su , Yaliang Li , Kui Ren

Knowledge distillation is a powerful technique for transferring knowledge from a pre-trained teacher model to a student model. However, the true potential of knowledge transfer has not been fully explored. Existing approaches primarily…

Machine Learning · Computer Science 2023-06-23 Shuoxi Zhang , Hanpeng Liu , Kun He

Knowledge graph embedding plays an important role in knowledge representation, reasoning, and data mining applications. However, for multiple cross-domain knowledge graphs, state-of-the-art embedding models cannot make full use of the data…

Machine Learning · Computer Science 2021-08-17 Hao Peng , Haoran Li , Yangqiu Song , Vincent Zheng , Jianxin Li