English
Related papers

Related papers: Noise-powered Multi-modal Knowledge Graph Represen…

200 papers

Multimodal knowledge graph completion (MKGC) aims to predict missing entities in MKGs. Previous works usually share relation representation across modalities. This results in mutual interference between modalities during training, since for…

Computation and Language · Computer Science 2022-11-02 Yu Zhao , Xiangrui Cai , Yike Wu , Haiwei Zhang , Ying Zhang , Guoqing Zhao , Ning Jiang

Knowledge graphs (KGs) play a key role in promoting various multimedia and AI applications. However, with the explosive growth of multi-modal information, traditional knowledge graph completion (KGC) models cannot be directly applied. This…

Multimedia · Computer Science 2025-05-29 Linyu Li , Zhi Jin , Yichi Zhang , Dongming Jin , Chengfeng Dou , Yuanpeng He , Xuan Zhang , Haiyan Zhao

Multi-modal knowledge graph completion (MMKGC) aims to discover unobserved knowledge from given knowledge graphs, collaboratively leveraging structural information from the triples and multi-modal information of the entities to overcome the…

Artificial Intelligence · Computer Science 2024-12-17 Yichi Zhang , Zhuo Chen , Lingbing Guo , Yajing Xu , Binbin Hu , Ziqi Liu , Wen Zhang , Huajun Chen

Multi-modal knowledge graphs (MKGs) include not only the relation triplets, but also related multi-modal auxiliary data (i.e., texts and images), which enhance the diversity of knowledge. However, the natural incompleteness has…

Artificial Intelligence · Computer Science 2022-09-07 Shangfei Zheng , Weiqing Wang , Jianfeng Qu , Hongzhi Yin , Wei Chen , Lei Zhao

Learning high-quality multi-modal entity representations is an important goal of multi-modal knowledge graph (MMKG) representation learning, which can enhance reasoning tasks within the MMKGs, such as MMKG completion (MMKGC). The main…

Artificial Intelligence · Computer Science 2025-04-08 Yichi Zhang , Zhuo Chen , Lingbing Guo , Yajing Xu , Binbin Hu , Ziqi Liu , Wen Zhang , Huajun Chen

Multi-Modal Entity Alignment (MMEA) is a critical task that aims to identify equivalent entity pairs across multi-modal knowledge graphs (MMKGs). However, this task faces challenges due to the presence of different types of information,…

Computation and Language · Computer Science 2023-10-11 Qian Li , Cheng Ji , Shu Guo , Zhaoji Liang , Lihong Wang , Jianxin Li

Recent years have witnessed the resurgence of knowledge engineering which is featured by the fast growth of knowledge graphs. However, most of existing knowledge graphs are represented with pure symbols, which hurts the machine's capability…

Artificial Intelligence · Computer Science 2022-12-20 Xiangru Zhu , Zhixu Li , Xiaodan Wang , Xueyao Jiang , Penglei Sun , Xuwu Wang , Yanghua Xiao , Nicholas Jing Yuan

Multi-Modal Knowledge Graphs (MMKGs) have proven valuable for various downstream tasks. However, scaling them up is challenging because building large-scale MMKGs often introduces mismatched images (i.e., noise). Most entities in KGs belong…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Yikai Zhang , Qianyu He , Xintao Wang , Siyu Yuan , Jiaqing Liang , Yanghua Xiao

Multimodal knowledge graph completion (MMKGC) aims to predict missing links in multimodal knowledge graphs (MMKGs) by leveraging information from various modalities alongside structural data. Existing MMKGC approaches primarily extend…

Computation and Language · Computer Science 2025-09-16 Haodi Ma , Dzmitry Kasinets , Daisy Zhe Wang

Multimodal Knowledge Graphs (MMKGs), which represent explicit knowledge across multiple modalities, play a pivotal role by complementing the implicit knowledge of Multimodal Large Language Models (MLLMs) and enabling more grounded reasoning…

Computation and Language · Computer Science 2025-09-29 Hyeongcheol Park , Jiyoung Seo , MinHyuk Jang , Hogun Park , Ha Dam Baek , Gyusam Chang , Hyeonsoo Im , Sangpil Kim

Multimodal reasoning with large language models (LLMs) often suffers from hallucinations and the presence of deficient or outdated knowledge within LLMs. Some approaches have sought to mitigate these issues by employing textual knowledge…

Computation and Language · Computer Science 2024-06-06 Junlin Lee , Yequan Wang , Jing Li , Min Zhang

Nowadays, Knowledge graphs (KGs) have been playing a pivotal role in AI-related applications. Despite the large sizes, existing KGs are far from complete and comprehensive. In order to continuously enrich KGs, automatic knowledge…

Computation and Language · Computer Science 2021-11-12 Zhao Zhang , Fuzhen Zhuang , Hengshu Zhu , Chao Li , Hui Xiong , Qing He , Yongjun Xu

Multimodal knowledge graphs (MKGs), which intuitively organize information in various modalities, can benefit multiple practical downstream tasks, such as recommendation systems, and visual question answering. However, most MKGs are still…

Artificial Intelligence · Computer Science 2023-07-10 Ke Liang , Sihang Zhou , Yue Liu , Lingyuan Meng , Meng Liu , Xinwang Liu

Multi-modal Knowledge Graph Completion (MMKGC) aims to uncover hidden world knowledge in multimodal knowledge graphs by leveraging both multimodal and structural entity information. However, the inherent imbalance in multimodal knowledge…

Artificial Intelligence · Computer Science 2025-07-29 Lijian Li

Many AI-related tasks involve the interactions of data in multiple modalities. It has been a new trend to merge multi-modal information into knowledge graph(KG), resulting in multi-modal knowledge graphs (MMKG). However, MMKGs usually…

Artificial Intelligence · Computer Science 2021-06-08 Hao Guo , Jiuyang Tang , Weixin Zeng , Xiang Zhao , Li Liu

Knowledge graphs (KGs) consisting of a large number of triples have become widespread recently, and many knowledge graph embedding (KGE) methods are proposed to embed entities and relations of a KG into continuous vector spaces. Such…

Machine Learning · Computer Science 2022-05-09 Mingyang Chen , Wen Zhang , Yushan Zhu , Hongting Zhou , Zonggang Yuan , Changliang Xu , Huajun Chen

Multimodal Knowledge Graphs (MKGs), which organize visual-text factual knowledge, have recently been successfully applied to tasks such as information retrieval, question answering, and recommendation system. Since most MKGs are far from…

Computation and Language · Computer Science 2023-09-19 Xiang Chen , Ningyu Zhang , Lei Li , Shumin Deng , Chuanqi Tan , Changliang Xu , Fei Huang , Luo Si , Huajun Chen

The multi-modal entity alignment (MMEA) aims to find all equivalent entity pairs between multi-modal knowledge graphs (MMKGs). Rich attributes and neighboring entities are valuable for the alignment task, but existing works ignore…

Computation and Language · Computer Science 2023-04-05 Qian Li , Shu Guo , Yangyifei Luo , Cheng Ji , Lihong Wang , Jiawei Sheng , Jianxin Li

Real-world multimodal knowledge graphs (MMKGs) are dynamic, with new entities, relations, and multimodal knowledge emerging over time. Existing continual knowledge graph reasoning (CKGR) methods focus on structural triples and cannot fully…

Computation and Language · Computer Science 2026-04-06 Linyu Li , Zhi Jin , Yichi Zhang , Dongming Jin , Yuanpeng He , Haoran Duan , Gadeng Luosang , Nyima Tashi

Knowledge graph (KG) alignment and completion are usually treated as two independent tasks. While recent work has leveraged entity and relation alignments from multiple KGs, such as alignments between multilingual KGs with common entities…

Computation and Language · Computer Science 2022-10-19 Vinh Tong , Dat Quoc Nguyen , Trung Thanh Huynh , Tam Thanh Nguyen , Quoc Viet Hung Nguyen , Mathias Niepert
‹ Prev 1 2 3 10 Next ›