English
Related papers

Related papers: KRACL: Contrastive Learning with Graph Context Mod…

200 papers

Knowledge Graph Completion (KGC) has garnered massive research interest recently, and most existing methods are designed following a transductive setting where all entities are observed during training. Despite the great progress on the…

Computation and Language · Computer Science 2024-04-25 Zhiwen Xie , Yi Zhang , Guangyou Zhou , Jin Liu , Xinhui Tu , Jimmy Xiangji Huang

Knowledge-Enhanced Pre-trained Language Models (KEPLMs) improve the performance of various downstream NLP tasks by injecting knowledge facts from large-scale Knowledge Graphs (KGs). However, existing methods for pre-training KEPLMs with…

Computation and Language · Computer Science 2023-11-14 Ruyao Xu , Taolin Zhang , Chengyu Wang , Zhongjie Duan , Cen Chen , Minghui Qiu , Dawei Cheng , Xiaofeng He , Weining Qian

Short text classification has gained significant attention in the information age due to its prevalence and real-world applications. Recent advancements in graph learning combined with contrastive learning have shown promising results in…

Computation and Language · Computer Science 2025-01-17 Yonghao Liu , Fausto Giunchiglia , Lan Huang , Ximing Li , Xiaoyue Feng , Renchu Guan

Continual Knowledge Graph Embedding (CKGE) aims to continually learn embeddings for new knowledge, i.e., entities and relations, while retaining previously acquired knowledge. Most existing CKGE methods mitigate catastrophic forgetting via…

Information Retrieval · Computer Science 2026-04-21 Jing Qi , Yuxiang Wang , Zhiyuan Yu , Xiaoliang Xu , Yuanshi Zheng , Tianxing Wu

Answering complex queries over incomplete knowledge graphs (KGs) is a challenging job. Most previous works have focused on learning entity/relation embeddings and simulating first-order logic operators with various neural networks. However,…

Computation and Language · Computer Science 2025-03-04 Tianle Xia , Liang Ding , Guojia Wan , Yibing Zhan , Bo Du , Dacheng Tao

Most researches for knowledge graph completion learn representations of entities and relations to predict missing links in incomplete knowledge graphs. However, these methods fail to take full advantage of both the contextual information of…

Computation and Language · Computer Science 2020-12-15 Ziyue Qiao , Zhiyuan Ning , Yi Du , Yuanchun Zhou

Learning over sparse, high-dimensional data frequently necessitates the use of specialized methods such as the hashing trick. In this work, we design a highly scalable alternative approach that leverages the low degree of feature…

Machine Learning · Statistics 2020-06-09 Vladimir Feinberg , Peter Bailis

Knowledge graph (KG) reasoning is an important problem for knowledge graphs. In this paper, we propose a novel and principled framework called \textbf{RulE} (stands for {Rul}e {E}mbedding) to effectively leverage logical rules to enhance KG…

Artificial Intelligence · Computer Science 2024-05-21 Xiaojuan Tang , Song-Chun Zhu , Yitao Liang , Muhan Zhang

Among the top approaches of recent years, link prediction using knowledge graph embedding (KGE) models has gained significant attention for knowledge graph completion. Various embedding models have been proposed so far, among which, some…

Artificial Intelligence · Computer Science 2021-06-01 Chengjin Xu , Mojtaba Nayyeri , Sahar Vahdati , Jens Lehmann

In graph self-supervised learning, masked autoencoders (MAE) and contrastive learning (CL) are two prominent paradigms. MAE focuses on reconstructing masked elements, while CL maximizes similarity between augmented graph views. Recent…

Machine Learning · Computer Science 2025-06-10 Di Lin , Wanjing Ren , Xuanbin Li , Rui Zhang

Graph representation learning has emerged as a powerful tool for preserving graph topology when mapping nodes to vector representations, enabling various downstream tasks such as node classification and community detection. However, most…

Machine Learning · Computer Science 2025-03-21 Kaizhe Fan , Quanjun Li

Temporal knowledge graphs (TKGs) have been identified as a promising approach to represent the dynamics of facts along the timeline. The extrapolation of TKG is to predict unknowable facts happening in the future, holding significant…

Artificial Intelligence · Computer Science 2023-12-05 Wei Chen , Huaiyu Wan , Yuting Wu , Shuyuan Zhao , Jiayaqi Cheng , Yuxin Li , Youfang Lin

While contrastive self-supervised learning has become the de-facto learning paradigm for graph neural networks, the pursuit of higher task accuracy requires a larger hidden dimensionality to learn informative and discriminative…

Neural and Evolutionary Computing · Computer Science 2024-02-20 Jintang Li , Huizhe Zhang , Ruofan Wu , Zulun Zhu , Baokun Wang , Changhua Meng , Zibin Zheng , Liang Chen

Knowledge graphs (KGs) contain rich information about world knowledge, entities and relations. Thus, they can be great supplements to existing pre-trained language models. However, it remains a challenge to efficiently integrate information…

Computation and Language · Computer Science 2020-10-05 Donghan Yu , Chenguang Zhu , Yiming Yang , Michael Zeng

Knowledge representation learning aims at modeling knowledge graph by encoding entities and relations into a low dimensional space. Most of the traditional works for knowledge embedding need negative sampling to minimize a margin-based…

Artificial Intelligence · Computer Science 2018-10-01 Peifeng Wang , Shuangyin Li , Rong pan

Knowledge Graph Embedding (KGE) techniques are crucial in learning compact representations of entities and relations within a knowledge graph, facilitating efficient reasoning and knowledge discovery. While existing methods typically focus…

Computation and Language · Computer Science 2024-10-29 Pengcheng Jiang , Lang Cao , Cao Xiao , Parminder Bhatia , Jimeng Sun , Jiawei Han

Knowledge tracing (KT) is a popular approach for modeling students' learning progress over time, which can enable more personalized and adaptive learning. However, existing KT approaches face two major limitations: (1) they rely heavily on…

Machine Learning · Computer Science 2025-03-14 Yilmazcan Ozyurt , Stefan Feuerriegel , Mrinmaya Sachan

Knowledge graph reasoning (KGR) infers missing facts, with recent advances increasingly harnessing the semantic priors and reasoning abilities of Large Language Models (LLMs). However, prevailing generative paradigms are prone to memorizing…

Computation and Language · Computer Science 2026-02-26 Bo Xue , Yuan Jin , Luoyi Fu , Jiaxin Ding , Xinbing Wang

Knowledge graph embedding methods learn embeddings of entities and relations in a low dimensional space which can be used for various downstream machine learning tasks such as link prediction and entity matching. Various graph convolutional…

Machine Learning · Computer Science 2021-02-16 Nasrullah Sheikh , Xiao Qin , Berthold Reinwald , Christoph Miksovic , Thomas Gschwind , Paolo Scotton

Graph contrastive learning (GCL) aims to align the positive features while differentiating the negative features in the latent space by minimizing a pair-wise contrastive loss. As the embodiment of an outstanding discriminative unsupervised…

Machine Learning · Computer Science 2023-12-27 Jiangmeng Li , Yifan Jin , Hang Gao , Wenwen Qiang , Changwen Zheng , Fuchun Sun