中文
相关论文

相关论文: When Modalities Remember: Continual Learning for M…

200 篇论文

Retrieval-Augmented Generation (RAG) has recently been extended to multimodal settings, connecting multimodal large language models (MLLMs) with vast corpora of external knowledge such as multimodal knowledge graphs (MMKGs). Despite their…

计算与语言 · 计算机科学 2026-04-14 Hyeongcheol Park , Jiyoung Seo , Jaewon Mun , Hogun Park , Wonmin Byeon , Sung June Kim , Hyeonsoo Im , JeungSub Lee , Sangpil Kim

We present MMCOMET, the first multimodal commonsense knowledge graph (MMKG) that integrates physical, social, and eventive knowledge. MMCOMET extends the ATOMIC2020 knowledge graph to include a visual dimension, through an efficient image…

人工智能 · 计算机科学 2026-03-03 Eileen Wang , Hiba Arnaout , Dhita Pratama , Shuo Yang , Dangyang Liu , Jie Yang , Josiah Poon , Jeff Pan , Caren Han

Knowledge Graphs (KGs) play a pivotal role in advancing various AI applications, with the semantic web community's exploration into multi-modal dimensions unlocking new avenues for innovation. In this survey, we carefully review over 300…

Continual Graph Learning (CGL), which aims to accommodate new tasks over evolving graph data without forgetting prior knowledge, is garnering significant research interest. Mainstream solutions adopt the memory replay-based idea, ie,…

机器学习 · 计算机科学 2025-02-11 Qi Wang , Tianfei Zhou , Ye Yuan , Rui Mao

Recent years have seen significant advancements in multi-modal knowledge graph completion (MMKGC). MMKGC enhances knowledge graph completion (KGC) by integrating multi-modal entity information, thereby facilitating the discovery of…

计算与语言 · 计算机科学 2023-08-15 Yichi Zhang , Zhuo Chen , Wen Zhang

Temporal knowledge graph reasoning (TKGR) is increasingly gaining attention for its ability to extrapolate new events from historical data, thereby enriching the inherently incomplete temporal knowledge graphs. Existing graph-based…

机器学习 · 计算机科学 2025-01-27 Jinze Sun , Yongpan Sheng , Lirong He , Yongbin Qin , Ming Liu , Tao Jia

Inferring new facts from existing knowledge graphs (KG) with explainable reasoning processes is a significant problem and has received much attention recently. However, few studies have focused on relation types unseen in the original KG,…

机器学习 · 计算机科学 2019-06-14 Zhengxiao Du , Chang Zhou , Ming Ding , Hongxia Yang , Jie Tang

Temporal knowledge graph (TKG) completion models typically rely on having access to the entire graph during training. However, in real-world scenarios, TKG data is often received incrementally as events unfold, leading to a dynamic…

机器学习 · 计算机科学 2023-05-31 Mehrnoosh Mirtaheri , Mohammad Rostami , Aram Galstyan

Biomedical Knowledge Graphs (BKGs) integrate diverse datasets to elucidate complex relationships within the biomedical field. Effective link prediction on these graphs can uncover valuable connections, such as potential novel drug-disease…

计算与语言 · 计算机科学 2025-07-01 Tien Dang , Viet Thanh Duy Nguyen , Minh Tuan Le , Truong-Son Hy

Knowledge graph (KG) alignment and completion are usually treated as two independent tasks. While recent work has leveraged entity and relation alignments from multiple KGs, such as alignments between multilingual KGs with common entities…

计算与语言 · 计算机科学 2022-10-19 Vinh Tong , Dat Quoc Nguyen , Trung Thanh Huynh , Tam Thanh Nguyen , Quoc Viet Hung Nguyen , Mathias Niepert

Medical deep learning models depend heavily on domain-specific knowledge to perform well on knowledge-intensive clinical tasks. Prior work has primarily leveraged unimodal knowledge graphs, such as the Unified Medical Language System…

人工智能 · 计算机科学 2025-05-26 Xiaochen Wang , Yuan Zhong , Lingwei Zhang , Lisong Dai , Ting Wang , Fenglong Ma

Clinicians are increasingly looking towards machine learning to gain insights about patient evolutions. We propose a novel approach named Multi-Modal UMLS Graph Learning (MMUGL) for learning meaningful representations of medical concepts…

机器学习 · 计算机科学 2024-02-07 Manuel Burger , Gunnar Rätsch , Rita Kuznetsova

Analogical reasoning is fundamental to human cognition and holds an important place in various fields. However, previous studies mainly focus on single-modal analogical reasoning and ignore taking advantage of structure knowledge. Notably,…

计算与语言 · 计算机科学 2023-03-02 Ningyu Zhang , Lei Li , Xiang Chen , Xiaozhuan Liang , Shumin Deng , Huajun Chen

In the task of Knowledge Graph Completion (KGC), the existing datasets and their inherent subtasks carry a wealth of shared knowledge that can be utilized to enhance the representation of knowledge triplets and overall performance. However,…

计算与语言 · 计算机科学 2024-05-14 Yongxue Shan , Jie Zhou , Jie Peng , Xin Zhou , Jiaqian Yin , Xiaodong Wang

The multi-modal entity alignment (MMEA) aims to find all equivalent entity pairs between multi-modal knowledge graphs (MMKGs). Rich attributes and neighboring entities are valuable for the alignment task, but existing works ignore…

计算与语言 · 计算机科学 2023-04-05 Qian Li , Shu Guo , Yangyifei Luo , Cheng Ji , Lihong Wang , Jiawei Sheng , Jianxin Li

Knowledge graphs (KGs) that modelings the world knowledge as structural triples are inevitably incomplete. Such problems still exist for multimodal knowledge graphs (MMKGs). Thus, knowledge graph completion (KGC) is of great importance to…

人工智能 · 计算机科学 2022-09-16 Yichi Zhang , Wen Zhang

The knowledge graph (KG) is an essential form of knowledge representation that has grown in prominence in recent years. Because it concentrates on nominal entities and their relationships, traditional knowledge graphs are static and…

人工智能 · 计算机科学 2022-09-14 Feng Zhao , Ziqi Zhang , Donglin Wang

Multilingual Knowledge Graph Completion (mKGC) aim at solving queries like (h, r, ?) in different languages by reasoning a tail entity t thus improving multilingual knowledge graphs. Previous studies leverage multilingual pretrained…

计算与语言 · 计算机科学 2024-06-27 Ran Song , Shizhu He , Shengxiang Gao , Li Cai , Kang Liu , Zhengtao Yu , Jun Zhao

Large language models (LLMs) based Multilingual Knowledge Graph Completion (MKGC) aim to predict missing facts by leveraging LLMs' multilingual understanding capabilities, improving the completeness of multilingual knowledge graphs (KGs).…

计算与语言 · 计算机科学 2025-10-10 Cunli Mao , Xiaofei Gao , Ran Song , Shizhu He , Shengxiang Gao , Kang Liu , Zhengtao Yu

Unified Multimodal Generative Models (UMGMs) unify visual understanding and image generation within a single autoregressive framework. However, their ability to continually learn new tasks is severely hindered by catastrophic forgetting,…

机器学习 · 计算机科学 2025-12-04 Xiwen Wei , Mustafa Munir , Radu Marculescu