English
Related papers

Related papers: MMKG: Multi-Modal Knowledge Graphs

200 papers

The ability of knowledge graphs to represent complex relationships at scale has led to their adoption for various needs including knowledge representation, question-answering, and recommendation systems. Knowledge graphs are often…

Computation and Language · Computer Science 2023-05-18 Jason Youn , Ilias Tagkopoulos

Knowledge Graphs (KGs) often have two characteristics: heterogeneous graph structure and text-rich entity/relation information. Text-based KG embeddings can represent entities by encoding descriptions with pre-trained language models, but…

Computation and Language · Computer Science 2023-09-15 Xin Xie , Zhoubo Li , Xiaohan Wang , Zekun Xi , Ningyu Zhang

Multi-modal Knowledge Graphs (MMKGs) have been widely applied across various domains for knowledge representation. However, the existing MMKGs are significantly fewer than required, and their construction faces numerous challenges,…

Artificial Intelligence · Computer Science 2025-04-21 Yajing Xu , Zhiqiang Liu , Jiaoyan Chen , Mingchen Tu , Zhuo Chen , Jeff Z. Pan , Yichi Zhang , Yushan Zhu , Wen Zhang , Huajun Chen

Multi-Modal Entity Alignment (MMEA) is a critical task that aims to identify equivalent entity pairs across multi-modal knowledge graphs (MMKGs). However, this task faces challenges due to the presence of different types of information,…

Computation and Language · Computer Science 2023-10-11 Qian Li , Cheng Ji , Shu Guo , Zhaoji Liang , Lihong Wang , Jianxin Li

Multi-modal knowledge graphs (MMKGs) combine different modal data (e.g., text and image) for a comprehensive understanding of entities. Despite the recent progress of large-scale MMKGs, existing MMKGs neglect the multi-aspect nature of…

Computation and Language · Computer Science 2023-09-19 Jingdan Zhang , Jiaan Wang , Xiaodan Wang , Zhixu Li , Yanghua Xiao

The multi-modal entity alignment (MMEA) aims to find all equivalent entity pairs between multi-modal knowledge graphs (MMKGs). Rich attributes and neighboring entities are valuable for the alignment task, but existing works ignore…

Computation and Language · Computer Science 2023-04-05 Qian Li , Shu Guo , Yangyifei Luo , Cheng Ji , Lihong Wang , Jiawei Sheng , Jianxin Li

Most Knowledge Graphs (KGs) contain textual descriptions of entities in various natural languages. These descriptions of entities provide valuable information that may not be explicitly represented in the structured part of the KG. Based on…

Computation and Language · Computer Science 2020-04-23 Genet Asefa Gesese , Mehwish Alam , Harald Sack

This paper presents $\mu\text{KG}$, an open-source Python library for representation learning over knowledge graphs. $\mu\text{KG}$ supports joint representation learning over multi-source knowledge graphs (and also a single knowledge…

Computation and Language · Computer Science 2022-07-29 Xindi Luo , Zequn Sun , Wei Hu

Multimodal knowledge graph completion (MMKGC) aims to predict missing links in multimodal knowledge graphs (MMKGs) by leveraging information from various modalities alongside structural data. Existing MMKGC approaches primarily extend…

Computation and Language · Computer Science 2025-09-16 Haodi Ma , Dzmitry Kasinets , Daisy Zhe Wang

Large language models appear to learn facts from the large text corpora they are trained on. Such facts are encoded implicitly within their many parameters, making it difficult to verify or manipulate what knowledge has been learned.…

Computation and Language · Computer Science 2022-10-27 Yifan Hou , Wenxiang Jiao , Meizhen Liu , Carl Allen , Zhaopeng Tu , Mrinmaya Sachan

In the task of Knowledge Graph Completion (KGC), the existing datasets and their inherent subtasks carry a wealth of shared knowledge that can be utilized to enhance the representation of knowledge triplets and overall performance. However,…

Computation and Language · Computer Science 2024-05-14 Yongxue Shan , Jie Zhou , Jie Peng , Xin Zhou , Jiaqian Yin , Xiaodong Wang

Multilingual knowledge graph (KG) embeddings provide latent semantic representations of entities and structured knowledge with cross-lingual inferences, which benefit various knowledge-driven cross-lingual NLP tasks. However, precisely…

Artificial Intelligence · Computer Science 2018-06-19 Muhao Chen , Yingtao Tian , Kai-Wei Chang , Steven Skiena , Carlo Zaniolo

We present MMCOMET, the first multimodal commonsense knowledge graph (MMKG) that integrates physical, social, and eventive knowledge. MMCOMET extends the ATOMIC2020 knowledge graph to include a visual dimension, through an efficient image…

Artificial Intelligence · Computer Science 2026-03-03 Eileen Wang , Hiba Arnaout , Dhita Pratama , Shuo Yang , Dangyang Liu , Jie Yang , Josiah Poon , Jeff Pan , Caren Han

Knowledge graph embedding (KGE) models are often used to predict missing links for knowledge graphs (KGs). However, multiple KG embeddings can perform almost equally well for link prediction yet give conflicting predictions for unseen…

Artificial Intelligence · Computer Science 2024-10-07 Yuqicheng Zhu , Nico Potyka , Mojtaba Nayyeri , Bo Xiong , Yunjie He , Evgeny Kharlamov , Steffen Staab

N-ary Knowledge Graphs (NKGs) are a specialized type of knowledge graph designed to efficiently represent complex real-world facts. Unlike traditional knowledge graphs, where a fact typically involves two entities, NKGs can capture n-ary…

Artificial Intelligence · Computer Science 2025-06-11 Jiyao Wei , Saiping Guan , Da Li , Xiaolong Jin , Jiafeng Guo , Xueqi Cheng

Knowledge graphs have emerged as an important model for studying complex multi-relational data. This has given rise to the construction of numerous large scale but incomplete knowledge graphs encoding information extracted from various…

Machine Learning · Computer Science 2018-07-24 Rakshit Trivedi , Bunyamin Sisman , Jun Ma , Christos Faloutsos , Hongyuan Zha , Xin Luna Dong

Knowledge graph completion (KGC) is a widely used method to tackle incompleteness in knowledge graphs (KGs) by making predictions for missing links. Description-based KGC leverages pre-trained language models to learn entity and relation…

Computation and Language · Computer Science 2024-03-05 Derong Xu , Ziheng Zhang , Zhenxi Lin , Xian Wu , Zhihong Zhu , Tong Xu , Xiangyu Zhao , Yefeng Zheng , Enhong Chen

Knowledge graphs (KGs) contain rich information about world knowledge, entities and relations. Thus, they can be great supplements to existing pre-trained language models. However, it remains a challenge to efficiently integrate information…

Computation and Language · Computer Science 2020-10-05 Donghan Yu , Chenguang Zhu , Yiming Yang , Michael Zeng

Knowledge graph reasoning (KGR), aiming to deduce new facts from existing facts based on mined logic rules underlying knowledge graphs (KGs), has become a fast-growing research direction. It has been proven to significantly benefit the…

Artificial Intelligence · Computer Science 2024-10-28 Ke Liang , Lingyuan Meng , Meng Liu , Yue Liu , Wenxuan Tu , Siwei Wang , Sihang Zhou , Xinwang Liu , Fuchun Sun

Multimodal knowledge graphs (MMKGs) enrich traditional knowledge graphs (KGs) by incorporating diverse modalities such as images and text. multimodal knowledge graph completion (MMKGC) seeks to exploit these heterogeneous signals to infer…

Computation and Language · Computer Science 2025-08-12 Yongkang Xiao , Rui Zhang