English
Related papers

Related papers: Tokenization, Fusion, and Augmentation: Towards Fi…

200 papers

Multi-modal Knowledge Graph Completion (MMKGC) aims to uncover hidden world knowledge in multimodal knowledge graphs by leveraging both multimodal and structural entity information. However, the inherent imbalance in multimodal knowledge…

Artificial Intelligence · Computer Science 2025-07-29 Lijian Li

Learning high-quality multi-modal entity representations is an important goal of multi-modal knowledge graph (MMKG) representation learning, which can enhance reasoning tasks within the MMKGs, such as MMKG completion (MMKGC). The main…

Artificial Intelligence · Computer Science 2025-04-08 Yichi Zhang , Zhuo Chen , Lingbing Guo , Yajing Xu , Binbin Hu , Ziqi Liu , Wen Zhang , Huajun Chen

Multi-modal knowledge graph completion (MMKGC) aims to discover missing facts in multi-modal knowledge graphs (MMKGs) by leveraging both structural relationships and diverse modality information of entities. Existing MMKGC methods follow…

Computation and Language · Computer Science 2026-04-20 Zhiqiang Liu , Yichi Zhang , Mengshu Sun , Lei Liang , Wen Zhang

Knowledge graphs (KGs) play a key role in promoting various multimedia and AI applications. However, with the explosive growth of multi-modal information, traditional knowledge graph completion (KGC) models cannot be directly applied. This…

Multimedia · Computer Science 2025-05-29 Linyu Li , Zhi Jin , Yichi Zhang , Dongming Jin , Chengfeng Dou , Yuanpeng He , Xuan Zhang , Haiyan Zhao

Leveraging Large Language Models (LLMs) for Knowledge Graph Completion (KGC) is promising but hindered by a fundamental granularity mismatch. LLMs operate on fragmented token sequences, whereas entities are the fundamental units in…

Computation and Language · Computer Science 2026-02-27 Siyue Su , Jian Yang , Bo Li , Guanglin Niu

Multi-modal knowledge graph reasoning (MMKGR) aims to predict the missing links by exploiting both graph structure information and multi-modal entity contents. Most existing works are designed for a transductive setting, which learns…

Computation and Language · Computer Science 2026-02-19 Yichi Zhang , Zhuo Chen , Lingbing Guo , Wen Zhang , Huajun Chen

Multimodal knowledge graphs (MMKGs) enrich traditional knowledge graphs (KGs) by incorporating diverse modalities such as images and text. multimodal knowledge graph completion (MMKGC) seeks to exploit these heterogeneous signals to infer…

Computation and Language · Computer Science 2025-08-12 Yongkang Xiao , Rui Zhang

Multi-modal knowledge graphs (MKGs) include not only the relation triplets, but also related multi-modal auxiliary data (i.e., texts and images), which enhance the diversity of knowledge. However, the natural incompleteness has…

Artificial Intelligence · Computer Science 2022-09-07 Shangfei Zheng , Weiqing Wang , Jianfeng Qu , Hongzhi Yin , Wei Chen , Lei Zhao

The rise of Multi-modal Pre-training highlights the necessity for a unified Multi-Modal Knowledge Graph (MMKG) representation learning framework. Such a framework is essential for embedding structured knowledge into multi-modal Large…

Computation and Language · Computer Science 2025-01-16 Zhuo Chen , Yin Fang , Yichi Zhang , Lingbing Guo , Jiaoyan Chen , Jeff Z. Pan , Huajun Chen , Wen Zhang

Knowledge graph completion (KGC) seeks to predict missing entities (e.g., heads or tails) or relationships in knowledge graphs (KGs), which often contain incomplete data. Traditional embedding-based methods, such as TransE and ComplEx, have…

Computation and Language · Computer Science 2025-03-11 Haji Gul , Ajaz Ahmad Bhat , Abdul Ghani Haji Naim

Recent years have seen significant advancements in multi-modal knowledge graph completion (MMKGC). MMKGC enhances knowledge graph completion (KGC) by integrating multi-modal entity information, thereby facilitating the discovery of…

Computation and Language · Computer Science 2023-08-15 Yichi Zhang , Zhuo Chen , Wen Zhang

Real-world multimodal knowledge graphs (MMKGs) are dynamic, with new entities, relations, and multimodal knowledge emerging over time. Existing continual knowledge graph reasoning (CKGR) methods focus on structural triples and cannot fully…

Computation and Language · Computer Science 2026-04-06 Linyu Li , Zhi Jin , Yichi Zhang , Dongming Jin , Yuanpeng He , Haoran Duan , Gadeng Luosang , Nyima Tashi

Knowledge graph completion (KGC) aims to predict missing facts in knowledge graphs (KGs), which is crucial as modern KGs remain largely incomplete. While training KGC models on multiple aligned KGs can improve performance, previous methods…

Computation and Language · Computer Science 2023-12-19 Wei Tang , Zhiqian Wu , Yixin Cao , Yong Liao , Pengyuan Zhou

Multimodal knowledge graph completion (MKGC) aims to predict missing entities in MKGs. Previous works usually share relation representation across modalities. This results in mutual interference between modalities during training, since for…

Computation and Language · Computer Science 2022-11-02 Yu Zhao , Xiangrui Cai , Yike Wu , Haiwei Zhang , Ying Zhang , Guoqing Zhao , Ning Jiang

Multimodal knowledge graph completion (MMKGC) aims to predict missing links in multimodal knowledge graphs (MMKGs) by leveraging information from various modalities alongside structural data. Existing MMKGC approaches primarily extend…

Computation and Language · Computer Science 2025-09-16 Haodi Ma , Dzmitry Kasinets , Daisy Zhe Wang

We present MMKG, a collection of three knowledge graphs that contain both numerical features and (links to) images for all entities as well as entity alignments between pairs of KGs. Therefore, multi-relational link prediction and entity…

Artificial Intelligence · Computer Science 2019-03-14 Ye Liu , Hui Li , Alberto Garcia-Duran , Mathias Niepert , Daniel Onoro-Rubio , David S. Rosenblum

Recommender systems traditionally represent items using unique identifiers (ItemIDs), but this approach struggles with large, dynamic item corpora and sparse long-tail data, limiting scalability and generalization. Semantic IDs, derived…

Information Retrieval · Computer Science 2026-03-03 Yi Xu , Moyu Zhang , Chenxuan Li , Zhihao Liao , Haibo Xing , Hao Deng , Jinxin Hu , Yu Zhang , Xiaoyi Zeng , Jing Zhang

Multimodal fact verification is an under-explored and emerging field that has gained increasing attention in recent years. The goal is to assess the veracity of claims that involve multiple modalities by analyzing the retrieved evidence.…

Multimedia · Computer Science 2024-07-16 Han Cao , Lingwei Wei , Wei Zhou , Songlin Hu

Multi-modal knowledge graph completion (MMKGC) aims to predict the missing triples in the multi-modal knowledge graphs by incorporating structural, visual, and textual information of entities into the discriminant models. The information…

Artificial Intelligence · Computer Science 2024-02-26 Yichi Zhang , Zhuo Chen , Lei Liang , Huajun Chen , Wen Zhang

Multi-Modal Knowledge Graphs (MMKGs) have proven valuable for various downstream tasks. However, scaling them up is challenging because building large-scale MMKGs often introduces mismatched images (i.e., noise). Most entities in KGs belong…

Computer Vision and Pattern Recognition · Computer Science 2024-06-18 Yikai Zhang , Qianyu He , Xintao Wang , Siyu Yuan , Jiaqing Liang , Yanghua Xiao
‹ Prev 1 2 3 10 Next ›