English
Related papers

Related papers: Breaking Rank Bottlenecks in Knowledge Graph Embed…

200 papers

Knowledge graph embedding (KGE) is a technique for learning continuous embeddings for entities and relations in the knowledge graph.Due to its benefit to a variety of downstream tasks such as knowledge graph completion, question answering…

Machine Learning · Computer Science 2019-06-25 Hengtong Zhang , Tianhang Zheng , Jing Gao , Chenglin Miao , Lu Su , Yaliang Li , Kui Ren

Embedding knowledge graphs (KGs) for multi-hop logical reasoning is a challenging problem due to massive and complicated structures in many KGs. Recently, many promising works projected entities and queries into a geometric space to…

Machine Learning · Computer Science 2023-04-25 Dong Yang , Peijun Qing , Yang Li , Haonan Lu , Xiaodong Lin

Little is known about the trustworthiness of predictions made by knowledge graph embedding (KGE) models. In this paper we take initial steps toward this direction by investigating the calibration of KGE models, or the extent to which they…

Artificial Intelligence · Computer Science 2020-10-07 Tara Safavi , Danai Koutra , Edgar Meij

The Mixture-of-Experts (MoE) architecture has become a predominant paradigm for scaling large language models (LLMs). Despite offering strong performance and computational efficiency, large MoE-based LLMs like DeepSeek-V3-0324 and…

Machine Learning · Computer Science 2025-08-08 Xiaodong Chen , Mingming Ha , Zhenzhong Lan , Jing Zhang , Jianguo Li

Ontology Alignment (OA) is essential for enabling semantic interoperability across heterogeneous knowledge systems. While recent advances have focused on large language models (LLMs) for capturing contextual semantics, this work revisits…

Artificial Intelligence · Computer Science 2025-10-01 Hamed Babaei Giglou , Jennifer D'Souza , Sören Auer , Mahsa Sanaei

Knowledge Graph (KG) is a flexible structure that is able to describe the complex relationship between data entities. Currently, most KG embedding models are trained based on negative sampling, i.e., the model aims to maximize some…

Artificial Intelligence · Computer Science 2021-06-17 Zelong Li , Jianchao Ji , Zuohui Fu , Yingqiang Ge , Shuyuan Xu , Chong Chen , Yongfeng Zhang

Recently, link prediction algorithms based on neural embeddings have gained tremendous popularity in the Semantic Web community, and are extensively used for knowledge graph completion. While algorithmic advances have strongly focused on…

Artificial Intelligence · Computer Science 2020-08-31 Asan Agibetov , Matthias Samwald

Knowledge Graphs (KGs) extracted from text sources are often noisy and lead to poor performance in downstream application tasks such as KG-based question answering.While much of the recent activity is focused on addressing the sparsity of…

Artificial Intelligence · Computer Science 2020-06-09 Siddhant Arora , Srikanta Bedathur , Maya Ramanath , Deepak Sharma

Knowledge Graphs (KGs) enable applications in various domains such as semantic search, recommendation systems, and natural language processing. KGs are often incomplete, missing entities and relations, an issue addressed by Knowledge Graph…

Computation and Language · Computer Science 2025-08-22 Haji Gul , Abul Ghani Naim , Ajaz Ahmad Bhat

Despite their success in various domains, the growing dependence on GNNs raises a critical concern about the nature of the combinatorial reasoning underlying their predictions, which is often hidden within their black-box architectures.…

Machine Learning · Computer Science 2026-03-03 Yue Niu , Zhaokai Sun , Jiayi Yang , Xiaofeng Cao , Rui Fan , Xin Sun , Hanli Wang , Wei Ye

Mixture-of-Experts (MoE) layers scale transformers by routing tokens to a sparse subset of feed-forward experts. Token-level routing, however, assigns an entire semantic spectrum to each expert, creating capacity bottlenecks, load-balancing…

Computation and Language · Computer Science 2025-10-07 Harshil Vejendla

Knowledge graph embedding, which aims to represent entities and relations as low dimensional vectors (or matrices, tensors, etc.), has been shown to be a powerful technique for predicting missing links in knowledge graphs. Existing…

Machine Learning · Computer Science 2022-04-07 Zhanqiu Zhang , Jianyu Cai , Yongdong Zhang , Jie Wang

Continual Knowledge Graph Embedding (CKGE) seeks to integrate new knowledge while preserving past information. However, existing methods struggle with efficiency and scalability due to two key limitations: (1) suboptimal knowledge…

Computation and Language · Computer Science 2025-06-11 Lijing Zhu , Qizhen Lan , Qing Tian , Wenbo Sun , Li Yang , Lu Xia , Yixin Xie , Xi Xiao , Tiehang Duan , Cui Tao , Shuteng Niu

In this thesis, we study the problem of feature learning on heterogeneous knowledge graphs. These features can be used to perform tasks such as link prediction, classification and clustering on graphs. Knowledge graphs provide rich…

Machine Learning · Computer Science 2018-09-11 Sebastian Bischoff

Many mathematical models have been leveraged to design embeddings for representing Knowledge Graph (KG) entities and relations for link prediction and many downstream tasks. These mathematically-inspired models are not only highly scalable…

Artificial Intelligence · Computer Science 2023-09-25 Xiou Ge , Yun-Cheng Wang , Bin Wang , C. -C. Jay Kuo

Knowledge Graph Embedding (KGE) is a popular method for KG reasoning and training KGEs with higher dimension are usually preferred since they have better reasoning capability. However, high-dimensional KGEs pose huge challenges to storage…

Artificial Intelligence · Computer Science 2021-12-14 Yushan Zhu , Wen Zhang , Mingyang Chen , Hui Chen , Xu Cheng , Wei Zhang , Huajun Chen

Knowledge Graphs (KGs) have been applied to many tasks including Web search, link prediction, recommendation, natural language processing, and entity linking. However, most KGs are far from complete and are growing at a rapid pace. To…

Artificial Intelligence · Computer Science 2017-11-10 Baoxu Shi , Tim Weninger

Knowledge graph completion (KGC) aims to predict missing facts from the observed KG. While a number of KGC models have been studied, the evaluation of KGC still remain underexplored. In this paper, we observe that existing metrics overlook…

Artificial Intelligence · Computer Science 2025-12-09 Sooho Moon , Yunyong Ko

Representation learning on a knowledge graph (KG) is to embed entities and relations of a KG into low-dimensional continuous vector spaces. Early KG embedding methods only pay attention to structured information encoded in triples, which…

Computation and Language · Computer Science 2020-01-01 Guanglin Niu , Yongfei Zhang , Bo Li , Peng Cui , Si Liu , Jingyang Li , Xiaowei Zhang

In the last few years, the solution to Knowledge Graph (KG) completion via learning embeddings of entities and relations has attracted a surge of interest. Temporal KGs(TKGs) extend traditional Knowledge Graphs (KGs) by associating static…

Artificial Intelligence · Computer Science 2023-02-14 Zhongwu Chen , Chengjin Xu , Fenglong Su , Zhen Huang , You Dou