English
Related papers

Related papers: Noise-powered Multi-modal Knowledge Graph Represen…

200 papers

Conventional Knowledge Graph Completion (KGC) assumes that all test entities appear during training. However, in real-world scenarios, Knowledge Graphs (KG) evolve fast with out-of-knowledge-graph (OOKG) entities added frequently, and we…

Computation and Language · Computer Science 2020-09-29 Damai Dai , Hua Zheng , Fuli Luo , Pengcheng Yang , Baobao Chang , Zhifang Sui

Large language models (LLMs) based Multilingual Knowledge Graph Completion (MKGC) aim to predict missing facts by leveraging LLMs' multilingual understanding capabilities, improving the completeness of multilingual knowledge graphs (KGs).…

Computation and Language · Computer Science 2025-10-10 Cunli Mao , Xiaofei Gao , Ran Song , Shizhu He , Shengxiang Gao , Kang Liu , Zhengtao Yu

We present MMKG, a collection of three knowledge graphs that contain both numerical features and (links to) images for all entities as well as entity alignments between pairs of KGs. Therefore, multi-relational link prediction and entity…

Artificial Intelligence · Computer Science 2019-03-14 Ye Liu , Hui Li , Alberto Garcia-Duran , Mathias Niepert , Daniel Onoro-Rubio , David S. Rosenblum

Multimodal pre-training breaks down the modality barriers and allows the individual modalities to be mutually augmented with information, resulting in significant advances in representation learning. However, graph modality, as a very…

Multimedia · Computer Science 2022-11-01 Xuan Yang , Quanjin Tao , Xiao Feng , Donghong Cai , Xiang Ren , Yang Yang

Knowledge graph (KG) alignment - the task of recognizing entities referring to the same thing in different KGs - is recognized as one of the most important operations in the field of KG construction and completion. However, existing…

Computation and Language · Computer Science 2022-03-16 Vinh Van Tong , Thanh Trung Huynh , Thanh Tam Nguyen , Hongzhi Yin , Quoc Viet Hung Nguyen , Quyet Thang Huynh

Currently, the main approach for Large Language Models (LLMs) to tackle the hallucination issue is incorporating Knowledge Graphs(KGs).However, LLMs typically treat KGs as plain text, extracting only semantic information and limiting their…

Computation and Language · Computer Science 2025-09-29 Yifang Zhang , Pengfei Duan , Yiwen Yang , Shengwu Xiong

Real-world multimodal knowledge graphs (MKGs) are inherently heterogeneous, modeling entities that are associated with diverse modalities. Traditional knowledge graph embedding (KGE) methods excel at learning continuous representations of…

Artificial Intelligence · Computer Science 2026-03-16 Athanasios Efthymiou , Stevan Rudinac , Monika Kackovic , Nachoem Wijnberg , Marcel Worring

As a crucial extension of entity alignment (EA), multi-modal entity alignment (MMEA) aims to identify identical entities across disparate knowledge graphs (KGs) by exploiting associated visual information. However, existing MMEA approaches…

Artificial Intelligence · Computer Science 2023-08-02 Zhuo Chen , Lingbing Guo , Yin Fang , Yichi Zhang , Jiaoyan Chen , Jeff Z. Pan , Yangning Li , Huajun Chen , Wen Zhang

Multimodal Knowledge Graphs (MKGs) extend traditional knowledge graphs by incorporating visual and textual modalities, enabling richer and more expressive entity representations. However, existing MKGs often suffer from incompleteness,…

Artificial Intelligence · Computer Science 2026-01-07 Wei Huang , Peining Li , Meiyu Liang , Xu Hou , Junping Du , Yingxia Shao , Guanhua Ye , Wu Liu , Kangkang Lu , Yang Yu

Large Language Models (LLMs) have demonstrated substantial efficacy in advancing graph-structured data analysis. Prevailing LLM-based graph methods excel in adapting LLMs to text-rich graphs, wherein node attributes are text descriptions.…

Artificial Intelligence · Computer Science 2025-06-04 Dongzhe Fan , Yi Fang , Jiajin Liu , Djellel Difallah , Qiaoyu Tan

Multimodal reasoning in Large Language Models (LLMs) struggles with incomplete knowledge and hallucination artifacts, challenges that textual Knowledge Graphs (KGs) only partially mitigate due to their modality isolation. While Multimodal…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Junming Liu , Siyuan Meng , Yanting Gao , Song Mao , Pinlong Cai , Guohang Yan , Yirong Chen , Zilin Bian , Ding Wang , Botian Shi

Multilingual knowledge graph (KG) embeddings provide latent semantic representations of entities and structured knowledge with cross-lingual inferences, which benefit various knowledge-driven cross-lingual NLP tasks. However, precisely…

Artificial Intelligence · Computer Science 2018-06-19 Muhao Chen , Yingtao Tian , Kai-Wei Chang , Steven Skiena , Carlo Zaniolo

Current Multimodal Knowledge Graph Construction (MKGC) models struggle with the real-world dynamism of continuously emerging entities and relations, often succumbing to catastrophic forgetting-loss of previously acquired knowledge. This…

Computation and Language · Computer Science 2024-05-28 Xiang Chen , Jintian Zhang , Xiaohan Wang , Ningyu Zhang , Tongtong Wu , Yuxiang Wang , Yongheng Wang , Huajun Chen

Multi-modal knowledge graphs (MMKGs), which ground various non-symbolic data (e.g., images and videos) into symbols, have attracted attention as resources enabling knowledge processing and machine learning across modalities. However, the…

Artificial Intelligence · Computer Science 2024-08-29 Shusaku Egami , Takahiro Ugai , Swe Nwe Nwe Htun , Ken Fukuda

In the task of Knowledge Graph Completion (KGC), the existing datasets and their inherent subtasks carry a wealth of shared knowledge that can be utilized to enhance the representation of knowledge triplets and overall performance. However,…

Computation and Language · Computer Science 2024-05-14 Yongxue Shan , Jie Zhou , Jie Peng , Xin Zhou , Jiaqian Yin , Xiaodong Wang

Multimodal graphs are gaining increasing attention due to their rich representational power and wide applicability, yet they introduce substantial challenges arising from severe modality confusion. To address this issue, we propose NSG…

Machine Learning · Computer Science 2026-02-03 Yihan Zhang , Ercan E. Kuruoglu

Knowledge Graphs (KGs) play a pivotal role in advancing various AI applications, with the semantic web community's exploration into multi-modal dimensions unlocking new avenues for innovation. In this survey, we carefully review over 300…

Knowledge graph completion (KGC) aims to predict missing facts in knowledge graphs (KGs), which is crucial as modern KGs remain largely incomplete. While training KGC models on multiple aligned KGs can improve performance, previous methods…

Computation and Language · Computer Science 2023-12-19 Wei Tang , Zhiqian Wu , Yixin Cao , Yong Liao , Pengyuan Zhou

Multimodal knowledge graph link prediction aims to improve the accuracy and efficiency of link prediction tasks for multimodal data. However, for complex multimodal information and sparse training data, it is usually difficult to achieve…

Artificial Intelligence · Computer Science 2023-01-12 Yilin Wen , Biao Luo , Yuqian Zhao

The objective of knowledge graph embedding is to encode both entities and relations of knowledge graphs into continuous low-dimensional vector spaces. Previously, most works focused on symbolic representation of knowledge graph with…

Computation and Language · Computer Science 2016-12-14 Jiacheng Xu , Kan Chen , Xipeng Qiu , Xuanjing Huang