English
Related papers

Related papers: When Modalities Remember: Continual Learning for M…

200 papers

Multimodal misinformation poses an escalating challenge that often evades traditional detectors, which are opaque black boxes and fragile against new manipulation tactics. We present Probabilistic Concept Graph Reasoning (PCGR), an…

Computer Vision and Pattern Recognition · Computer Science 2026-03-27 Ruichao Yang , Wei Gao , Xiaobin Zhu , Jing Ma , Hongzhan Lin , Ziyang Luo , Bo-Wen Zhang , Xu-Cheng Yin

Retrieval-Augmented Generation (RAG) mitigates hallucinations in Multimodal Large Language Models (MLLMs), yet existing systems struggle with complex cross-modal reasoning. Flat vector retrieval often ignores structural dependencies, while…

Information Retrieval · Computer Science 2026-04-08 Sijun Dai , Qiang Huang , Xiaoxing You , Jun Yu

In multimodal graph learning, graph structures that integrate information from multiple sources, such as vision and text, can more comprehensively model complex entity relationships. However, the continuous growth of their data scale poses…

Machine Learning · Computer Science 2026-02-10 Lian Shen , Zhendan Chen , Meijia Song , Yinhui jiang , Ziming Su , Juan Liu , Xiangrong Liu

Generative Knowledge Graph Construction (KGC) refers to those methods that leverage the sequence-to-sequence framework for building knowledge graphs, which is flexible and can be adapted to widespread tasks. In this study, we summarize the…

Computation and Language · Computer Science 2023-09-19 Hongbin Ye , Ningyu Zhang , Hui Chen , Huajun Chen

Since Multimodal Emotion Recognition in Conversation (MERC) can be applied to public opinion monitoring, intelligent dialogue robots, and other fields, it has received extensive research attention in recent years. Unlike traditional…

Machine Learning · Computer Science 2024-07-25 Tao Meng , Fuchen Zhang , Yuntao Shou , Hongen Shao , Wei Ai , Keqin Li

Temporal Knowledge Graph (TKG) is an extension of regular knowledge graph by attaching the time scope. Existing temporal knowledge graph question answering (TKGQA) models solely approach simple questions, owing to the prior assumption that…

Computation and Language · Computer Science 2024-01-05 Rikui Huang , Wei Wei , Xiaoye Qu , Wenfeng Xie , Xianling Mao , Dangyang Chen

In recent years, the introduction of knowledge graphs (KGs) has significantly advanced recommender systems by facilitating the discovery of potential associations between items. However, existing methods still face several limitations.…

Information Retrieval · Computer Science 2025-04-18 Ziqiang Cui , Yunpeng Weng , Xing Tang , Fuyuan Lyu , Dugang Liu , Xiuqiang He , Chen Ma

Multimodal-attributed graphs (MAGs) are a fundamental data structure for multimodal graph learning (MGL), enabling both graph-centric and modality-centric tasks. However, our empirical analysis reveals inherent topology quality limitations…

Machine Learning · Computer Science 2026-03-31 Yinlin Zhu , Xunkai Li , Di Wu , Wang Luo , Miao Hu , Di Wu

Dynamic graphs are prevalent in real-world scenarios, where continuous structural changes induce catastrophic forgetting in graph neural networks (GNNs). While continual learning has been extended to dynamic graphs, existing methods…

Machine Learning · Computer Science 2025-12-15 Tingxu Yan , Ye Yuan

Continual learning is essential for adapting models to new tasks while retaining previously acquired knowledge. While existing approaches predominantly focus on uni-modal data, multi-modal learning offers substantial benefits by utilizing…

Machine Learning · Computer Science 2025-11-11 Evelyn Chee , Wynne Hsu , Mong Li Lee

Knowledge graphs (KGs) consisting of a large number of triples have become widespread recently, and many knowledge graph embedding (KGE) methods are proposed to embed entities and relations of a KG into continuous vector spaces. Such…

Machine Learning · Computer Science 2022-05-09 Mingyang Chen , Wen Zhang , Yushan Zhu , Hongting Zhou , Zonggang Yuan , Changliang Xu , Huajun Chen

Temporal Knowledge Graph Forecasting (TKGF) aims to predict future events based on the observed events in history. Recently, Large Language Models (LLMs) have exhibited remarkable capabilities, generating significant research interest in…

Information Retrieval · Computer Science 2025-01-22 He Chang , Jie Wu , Zhulin Tao , Yunshan Ma , Xianglin Huang , Tat-Seng Chua

Arguments often do not make explicit how a conclusion follows from its premises. To compensate for this lack, we enrich arguments with structured background knowledge to support knowledge-intense argumentation tasks. We present a new…

Computation and Language · Computer Science 2023-05-16 Moritz Plenz , Juri Opitz , Philipp Heinisch , Philipp Cimiano , Anette Frank

Large Language Models (LMs) are known to encode world knowledge in their parameters as they pretrain on a vast amount of web corpus, which is often utilized for performing knowledge-dependent downstream tasks such as question answering,…

Computation and Language · Computer Science 2022-05-25 Joel Jang , Seonghyeon Ye , Sohee Yang , Joongbo Shin , Janghoon Han , Gyeonghun Kim , Stanley Jungkyu Choi , Minjoon Seo

Knowledge graphs (KG) have served as the key component of various natural language processing applications. Commonsense knowledge graphs (CKG) are a special type of KG, where entities and relations are composed of free-form text. However,…

Computation and Language · Computer Science 2023-01-04 Haodi Ma , Daisy Zhe Wang

Federated graph learning (FGL) has emerged as a promising paradigm for collaborative graph representation learning, enabling multiple parties to jointly train models while preserving data privacy. However, most existing approaches assume…

Machine Learning · Computer Science 2026-01-01 Zhengyu Wu , Guang Zeng , Huilin Lai , Daohan Su , Jishuo Jia , Yinlin Zhu , Xunkai Li , Rong-Hua Li , Guoren Wang , Chenghu Zhou

Graph Neural Networks (GNNs) have recently received significant research attention due to their superior performance on a variety of graph-related learning tasks. Most of the current works focus on either static or dynamic graph settings,…

Machine Learning · Computer Science 2021-02-09 Fan Zhou , Chengtai Cao

Procedural Multimodal Documents (PMDs) organize textual instructions and corresponding images step by step. Comprehending PMDs and inducing their representations for the downstream reasoning tasks is designated as Procedural MultiModal…

Computation and Language · Computer Science 2022-04-07 Huibin Zhang , Zhengkun Zhang , Yao Zhang , Jun Wang , Yufan Li , Ning jiang , Xin wei , Zhenglu Yang

Concept Bottleneck Models (CBMs) enhance the interpretability of AI systems, particularly by bridging visual input with human-understandable concepts, effectively acting as a form of multimodal interpretability model. However, existing CBMs…

Machine Learning · Computer Science 2025-08-06 Songning Lai , Mingqian Liao , Zhangyi Hu , Jiayu Yang , Wenshuo Chen , Hongru Xiao , Jianheng Tang , Haicheng Liao , Yutao Yue

Knowledge graphs (KGs) are the cornerstone of the semantic web, offering up-to-date representations of real-world entities and relations. Yet large language models (LLMs) remain largely static after pre-training, causing their internal…

Computation and Language · Computer Science 2026-03-24 Songlin Zhai , Guilin Qi , Yue Wang , Yuan Meng