English
Related papers

Related papers: When Modalities Remember: Continual Learning for M…

200 papers

Retrieval-Augmented Generation (RAG) has recently been extended to multimodal settings, connecting multimodal large language models (MLLMs) with vast corpora of external knowledge such as multimodal knowledge graphs (MMKGs). Despite their…

Computation and Language · Computer Science 2026-04-14 Hyeongcheol Park , Jiyoung Seo , Jaewon Mun , Hogun Park , Wonmin Byeon , Sung June Kim , Hyeonsoo Im , JeungSub Lee , Sangpil Kim

We present MMCOMET, the first multimodal commonsense knowledge graph (MMKG) that integrates physical, social, and eventive knowledge. MMCOMET extends the ATOMIC2020 knowledge graph to include a visual dimension, through an efficient image…

Artificial Intelligence · Computer Science 2026-03-03 Eileen Wang , Hiba Arnaout , Dhita Pratama , Shuo Yang , Dangyang Liu , Jie Yang , Josiah Poon , Jeff Pan , Caren Han

Knowledge Graphs (KGs) play a pivotal role in advancing various AI applications, with the semantic web community's exploration into multi-modal dimensions unlocking new avenues for innovation. In this survey, we carefully review over 300…

Continual Graph Learning (CGL), which aims to accommodate new tasks over evolving graph data without forgetting prior knowledge, is garnering significant research interest. Mainstream solutions adopt the memory replay-based idea, ie,…

Machine Learning · Computer Science 2025-02-11 Qi Wang , Tianfei Zhou , Ye Yuan , Rui Mao

Recent years have seen significant advancements in multi-modal knowledge graph completion (MMKGC). MMKGC enhances knowledge graph completion (KGC) by integrating multi-modal entity information, thereby facilitating the discovery of…

Computation and Language · Computer Science 2023-08-15 Yichi Zhang , Zhuo Chen , Wen Zhang

Temporal knowledge graph reasoning (TKGR) is increasingly gaining attention for its ability to extrapolate new events from historical data, thereby enriching the inherently incomplete temporal knowledge graphs. Existing graph-based…

Machine Learning · Computer Science 2025-01-27 Jinze Sun , Yongpan Sheng , Lirong He , Yongbin Qin , Ming Liu , Tao Jia

Inferring new facts from existing knowledge graphs (KG) with explainable reasoning processes is a significant problem and has received much attention recently. However, few studies have focused on relation types unseen in the original KG,…

Machine Learning · Computer Science 2019-06-14 Zhengxiao Du , Chang Zhou , Ming Ding , Hongxia Yang , Jie Tang

Temporal knowledge graph (TKG) completion models typically rely on having access to the entire graph during training. However, in real-world scenarios, TKG data is often received incrementally as events unfold, leading to a dynamic…

Machine Learning · Computer Science 2023-05-31 Mehrnoosh Mirtaheri , Mohammad Rostami , Aram Galstyan

Biomedical Knowledge Graphs (BKGs) integrate diverse datasets to elucidate complex relationships within the biomedical field. Effective link prediction on these graphs can uncover valuable connections, such as potential novel drug-disease…

Computation and Language · Computer Science 2025-07-01 Tien Dang , Viet Thanh Duy Nguyen , Minh Tuan Le , Truong-Son Hy

Knowledge graph (KG) alignment and completion are usually treated as two independent tasks. While recent work has leveraged entity and relation alignments from multiple KGs, such as alignments between multilingual KGs with common entities…

Computation and Language · Computer Science 2022-10-19 Vinh Tong , Dat Quoc Nguyen , Trung Thanh Huynh , Tam Thanh Nguyen , Quoc Viet Hung Nguyen , Mathias Niepert

Medical deep learning models depend heavily on domain-specific knowledge to perform well on knowledge-intensive clinical tasks. Prior work has primarily leveraged unimodal knowledge graphs, such as the Unified Medical Language System…

Artificial Intelligence · Computer Science 2025-05-26 Xiaochen Wang , Yuan Zhong , Lingwei Zhang , Lisong Dai , Ting Wang , Fenglong Ma

Clinicians are increasingly looking towards machine learning to gain insights about patient evolutions. We propose a novel approach named Multi-Modal UMLS Graph Learning (MMUGL) for learning meaningful representations of medical concepts…

Machine Learning · Computer Science 2024-02-07 Manuel Burger , Gunnar Rätsch , Rita Kuznetsova

Analogical reasoning is fundamental to human cognition and holds an important place in various fields. However, previous studies mainly focus on single-modal analogical reasoning and ignore taking advantage of structure knowledge. Notably,…

Computation and Language · Computer Science 2023-03-02 Ningyu Zhang , Lei Li , Xiang Chen , Xiaozhuan Liang , Shumin Deng , Huajun Chen

In the task of Knowledge Graph Completion (KGC), the existing datasets and their inherent subtasks carry a wealth of shared knowledge that can be utilized to enhance the representation of knowledge triplets and overall performance. However,…

Computation and Language · Computer Science 2024-05-14 Yongxue Shan , Jie Zhou , Jie Peng , Xin Zhou , Jiaqian Yin , Xiaodong Wang

The multi-modal entity alignment (MMEA) aims to find all equivalent entity pairs between multi-modal knowledge graphs (MMKGs). Rich attributes and neighboring entities are valuable for the alignment task, but existing works ignore…

Computation and Language · Computer Science 2023-04-05 Qian Li , Shu Guo , Yangyifei Luo , Cheng Ji , Lihong Wang , Jiawei Sheng , Jianxin Li

Knowledge graphs (KGs) that modelings the world knowledge as structural triples are inevitably incomplete. Such problems still exist for multimodal knowledge graphs (MMKGs). Thus, knowledge graph completion (KGC) is of great importance to…

Artificial Intelligence · Computer Science 2022-09-16 Yichi Zhang , Wen Zhang

The knowledge graph (KG) is an essential form of knowledge representation that has grown in prominence in recent years. Because it concentrates on nominal entities and their relationships, traditional knowledge graphs are static and…

Artificial Intelligence · Computer Science 2022-09-14 Feng Zhao , Ziqi Zhang , Donglin Wang

Multilingual Knowledge Graph Completion (mKGC) aim at solving queries like (h, r, ?) in different languages by reasoning a tail entity t thus improving multilingual knowledge graphs. Previous studies leverage multilingual pretrained…

Computation and Language · Computer Science 2024-06-27 Ran Song , Shizhu He , Shengxiang Gao , Li Cai , Kang Liu , Zhengtao Yu , Jun Zhao

Large language models (LLMs) based Multilingual Knowledge Graph Completion (MKGC) aim to predict missing facts by leveraging LLMs' multilingual understanding capabilities, improving the completeness of multilingual knowledge graphs (KGs).…

Computation and Language · Computer Science 2025-10-10 Cunli Mao , Xiaofei Gao , Ran Song , Shizhu He , Shengxiang Gao , Kang Liu , Zhengtao Yu

Unified Multimodal Generative Models (UMGMs) unify visual understanding and image generation within a single autoregressive framework. However, their ability to continually learn new tasks is severely hindered by catastrophic forgetting,…

Machine Learning · Computer Science 2025-12-04 Xiwen Wei , Mustafa Munir , Radu Marculescu