English
Related papers

Related papers: Geometric Structural Knowledge Graph Foundation Mo…

200 papers

Question Answering over Knowledge Graph (KGQA) aims to seek answer entities for the natural language question from a large-scale Knowledge Graph~(KG). To better perform reasoning on KG, recent work typically adopts a pre-trained language…

Computation and Language · Computer Science 2024-01-02 Jinhao Jiang , Kun Zhou , Wayne Xin Zhao , Yaliang Li , Ji-Rong Wen

Predicting missing links between entities in a knowledge graph is a fundamental task to deal with the incompleteness of data on the Web. Knowledge graph embeddings map nodes into a vector space to predict new links, scoring them according…

Artificial Intelligence · Computer Science 2023-02-14 Cosimo Gregucci , Mojtaba Nayyeri , Daniel Hernández , Steffen Staab

Recent studies of federated graph foundational models (FedGFMs) break the idealized and untenable assumption of having centralized data storage to train graph foundation models, and accommodate the reality of distributed, privacy-restricted…

Machine Learning · Computer Science 2026-01-30 Yinlin Zhu , Di Wu , Xianzhi Zhang , Yuming Ai , Xunkai Li , Miao Hu , Guocong Quan

Real-world graphs naturally exhibit hierarchical or cyclical structures that are unfit for the typical Euclidean space. While there exist graph neural networks that leverage hyperbolic or spherical spaces to learn representations that embed…

Machine Learning · Computer Science 2023-09-11 Sungjun Cho , Seunghyuk Cho , Sungwoo Park , Hankook Lee , Honglak Lee , Moontae Lee

Knowledge graph embedding (KGE) aims at learning powerful representations to benefit various artificial intelligence applications. Meanwhile, contrastive learning has been widely leveraged in graph learning as an effective mechanism to…

Artificial Intelligence · Computer Science 2023-06-14 Ke Liang , Yue Liu , Sihang Zhou , Wenxuan Tu , Yi Wen , Xihong Yang , Xiangjun Dong , Xinwang Liu

In this article we propose feature graph architectures (FGA), which are deep learning systems employing a structured initialisation and training method based on a feature graph which facilitates improved generalisation performance compared…

Machine Learning · Computer Science 2013-12-17 Richard Davis , Sanjay Chawla , Philip Leong

Graph foundation models (GFM) aim to acquire transferable knowledge by pre-training on diverse graphs, which can be adapted to various downstream tasks. However, domain shift in graphs is inherently two-dimensional: graphs differ not only…

Computation and Language · Computer Science 2026-03-12 Xingtong Yu , Shenghua Ye , Ruijuan Liang , Chang Zhou , Hong Cheng , Xinming Zhang , Yuan Fang

Entity alignment (EA) which links equivalent entities across different knowledge graphs (KGs) plays a crucial role in knowledge fusion. In recent years, graph neural networks (GNNs) have been successfully applied in many embedding-based EA…

Computation and Language · Computer Science 2023-05-01 Feng Xie , Xiang Zeng , Bin Zhou , Yusong Tan

Large Language Models (LLMs) excel at generating natural language answers, yet their outputs often remain unverifiable and difficult to trace. Knowledge Graphs (KGs) offer a complementary strength by representing entities and their…

Computation and Language · Computer Science 2025-12-05 Alfonso Amayuelas , Joy Sain , Simerjot Kaur , Charese Smiley

Graphs provide a powerful means for representing complex interactions between entities. Recently, deep learning approaches are emerging for representing and modeling graph-structured data, although the conventional deep learning methods…

Neural and Evolutionary Computing · Computer Science 2016-12-06 Jaekoo Lee , Hyunjae Kim , Jongsun Lee , Sungroh Yoon

The foundation model has heralded a new era in artificial intelligence, pretraining a single model to offer cross-domain transferability on different datasets. Graph neural networks excel at learning graph data, the omnipresent…

Machine Learning · Computer Science 2025-04-09 Li Sun , Zhenhao Huang , Suyang Zhou , Qiqi Wan , Hao Peng , Philip Yu

Knowledge graphs (KGs) play a key role in promoting various multimedia and AI applications. However, with the explosive growth of multi-modal information, traditional knowledge graph completion (KGC) models cannot be directly applied. This…

Multimedia · Computer Science 2025-05-29 Linyu Li , Zhi Jin , Yichi Zhang , Dongming Jin , Chengfeng Dou , Yuanpeng He , Xuan Zhang , Haiyan Zhao

Answering semantically-complicated questions according to an image is challenging in Visual Question Answering (VQA) task. Although the image can be well represented by deep learning, the question is always simply embedded and cannot well…

Computer Vision and Pattern Recognition · Computer Science 2021-12-15 JianJian Cao , Xiameng Qin , Sanyuan Zhao , Jianbing Shen

Performing link prediction using knowledge graph embedding models has become a popular approach for knowledge graph completion. Such models employ a transformation function that maps nodes via edges into a vector space in order to measure…

Artificial Intelligence · Computer Science 2021-03-16 Mojtaba Nayyeri , Sahar Vahdati , Can Aykul , Jens Lehmann

Knowledge graph (KG) embedding aims at embedding entities and relations in a KG into a lowdimensional latent representation space. Existing KG embedding approaches model entities andrelations in a KG by utilizing real-valued ,…

Machine Learning · Computer Science 2021-03-24 Chengjin Xu , Mojtaba Nayyeri , Yung-Yu Chen , Jens Lehmann

Knowledge graph (KG) representation learning aims to encode entities and relations into dense continuous vector spaces such that knowledge contained in a dataset could be consistently represented. Dense embeddings trained from KG datasets…

Machine Learning · Computer Science 2022-04-18 Tong Yang , Yifei Wang , Long Sha , Jan Engelbrecht , Pengyu Hong

We introduce Graph Memory (GM), a structured non-parametric framework that represents an embedding space through a compact graph of reliability-annotated prototype regions. GM encodes local geometry and regional ambiguity through prototype…

Machine Learning · Computer Science 2026-03-27 Artur A. Oliveira , Mateus Espadoto , Roberto M. Cesar , Roberto Hirata

Graph Foundation Models (GFMs) have emerged as a frontier in graph learning, which are expected to deliver transferable representations across diverse tasks. However, GFMs remain constrained by in-memory bottlenecks: they attempt to encode…

Machine Learning · Computer Science 2026-01-27 Haonan Yuan , Qingyun Sun , Jiacheng Tao , Xingcheng Fu , Jianxin Li

Knowledge graph embedding methods learn embeddings of entities and relations in a low dimensional space which can be used for various downstream machine learning tasks such as link prediction and entity matching. Various graph convolutional…

Machine Learning · Computer Science 2021-02-16 Nasrullah Sheikh , Xiao Qin , Berthold Reinwald , Christoph Miksovic , Thomas Gschwind , Paolo Scotton

The paradigm of Transformers using the self-attention mechanism has manifested its advantage in learning graph-structured data. Yet, Graph Transformers are capable of modeling full range dependencies but are often deficient in extracting…

Machine Learning · Computer Science 2024-09-11 Minhong Zhu , Zhenhao Zhao , Weiran Cai