English
Related papers

Related papers: CMKL: Modality-Aware Continual Learning for Evolvi…

200 papers

Recent advances in knowledge representation learning (KRL) highlight the urgent necessity to unify symbolic knowledge graphs (KGs) with language models (LMs) for richer semantic understanding. However, existing approaches typically…

Computation and Language · Computer Science 2025-06-05 Zirui Chen , Xin Wang , Zhao Li , Wenbin Guo , Dongxiao He

Knowledge graphs (KGs) require continual updates as new information emerges, but neural embedding models suffer from catastrophic forgetting when learning new tasks sequentially. We evaluate Elastic Weight Consolidation (EWC), a…

Machine Learning · Computer Science 2025-12-02 Gaganpreet Jhajj , Fuhua Lin

In electronic health record (EHR) mining, learning high-quality representations of medical concepts (e.g., standardized diagnosis, medication, and procedure codes) is fundamental for downstream clinical prediction. However, ro bust concept…

Machine Learning · Computer Science 2026-05-05 Mohsen Nayebi Kerdabadi , Arya Hadizadeh Moghaddam , Chen Chen , Dongjie Wang , Zijun Yao

Graphs are essential for modeling complex interactions across domains such as social networks, biology, and recommendation systems. Traditional Graph Neural Networks, particularly Message Passing Neural Networks (MPNNs), rely heavily on…

Machine Learning · Computer Science 2025-06-13 Wei Li , Mengcheng Lan , Jiaxing Xu , Yiping Ke

Mixture of Experts (MoE) architectures have recently advanced the scalability and adaptability of large language models (LLMs) for continual multimodal learning. However, efficiently extending these models to accommodate sequential tasks…

Computation and Language · Computer Science 2025-06-26 Hengyuan Zhao , Ziqin Wang , Qixin Sun , Kaiyou Song , Yilin Li , Xiaolin Hu , Qingpei Guo , Si Liu

While vision-language pre-trained models (VL-PTMs) have advanced multimodal research in recent years, their mastery in a few languages like English restricts their applicability in broader communities. To this end, there is an increasing…

Computer Vision and Pattern Recognition · Computer Science 2024-01-31 Bang Yang , Yong Dai , Xuxin Cheng , Yaowei Li , Asif Raza , Yuexian Zou

The widespread application of graph data in various high-risk scenarios has increased attention to graph anomaly detection (GAD). Faced with real-world graphs that often carry node descriptions in the form of raw text sequences, termed…

Machine Learning · Computer Science 2025-08-04 Yiming Xu , Xu Hua , Zhen Peng , Bin Shi , Jiarun Chen , Xingbo Fu , Song Wang , Bo Dong

Significant efforts have been dedicated to integrating the powerful Large Language Models (LLMs) with diverse modalities, particularly focusing on the fusion of language, vision and audio data. However, the graph-structured data, which is…

Computation and Language · Computer Science 2024-12-31 Zipeng Liu , Likang Wu , Ming He , Zhong Guan , Hongke Zhao , Nan Feng

Knowledge graphs are powerful tools for representing and organising complex biomedical data. Several knowledge graph embedding algorithms have been proposed to learn from and complete knowledge graphs. However, a recent study demonstrates…

In recent years, the introduction of knowledge graphs (KGs) has significantly advanced recommender systems by facilitating the discovery of potential associations between items. However, existing methods still face several limitations.…

Information Retrieval · Computer Science 2025-04-18 Ziqiang Cui , Yunpeng Weng , Xing Tang , Fuyuan Lyu , Dugang Liu , Xiuqiang He , Chen Ma

Complex node interactions are common in knowledge graphs, and these interactions also contain rich knowledge information. However, traditional methods usually treat a triple as a training unit during the knowledge representation learning…

Computation and Language · Computer Science 2021-10-01 Bin He , Di Zhou , Jinghui Xiao , Xin jiang , Qun Liu , Nicholas Jing Yuan , Tong Xu

Skeleton-based action recognition has garnered significant attention due to the utilization of concise and resilient skeletons. Nevertheless, the absence of detailed body information in skeletons restricts performance, while other…

Computer Vision and Pattern Recognition · Computer Science 2024-08-16 Jinfu Liu , Chen Chen , Mengyuan Liu

The development of continual learning (CL) methods, which aim to learn new tasks in a sequential manner from the training data acquired continuously, has gained great attention in remote sensing (RS). The existing CL methods in RS, while…

Computer Vision and Pattern Recognition · Computer Science 2025-06-27 Lars Möllenbrok , Behnood Rasti , Begüm Demir

The ability to learn in dynamic, nonstationary environments without forgetting previous knowledge, also known as Continual Learning (CL), is a key enabler for scalable and trustworthy deployments of adaptive solutions. While the importance…

Machine Learning · Computer Science 2021-03-25 Andrea Cossu , Antonio Carta , Davide Bacciu

Neuroscience research publications encompass a vast wealth of knowledge. Accurately retrieving existing information and discovering new insights from this extensive literature is essential for advancing the field. However, when knowledge is…

Computation and Language · Computer Science 2025-10-28 Pralaypati Ta , Sriram Venkatesaperumal , Keerthi Ram , Mohanasankar Sivaprakasam

Federated Continual Learning (FCL) leverages inter-client collaboration to balance new knowledge acquisition and prior knowledge retention in non-stationary data. However, existing batch-based FCL methods lack adaptability to streaming…

Machine Learning · Computer Science 2026-01-28 Sixing Tan , Xianmin Liu

A knowledge graph (KG) is a data structure which represents entities and relations as the vertices and edges of a directed graph with edge types. KGs are an important primitive in modern machine learning and artificial intelligence.…

Artificial Intelligence · Computer Science 2021-10-20 Michael R. Douglas , Michael Simkin , Omri Ben-Eliezer , Tianqi Wu , Peter Chin , Trung V. Dang , Andrew Wood

Large Language Models (LLMs) possess human-level cognitive and decision-making capabilities, making them a key technology for 6G. However, applying LLMs to the communication domain faces three major challenges: 1) Inadequate communication…

Information Theory · Computer Science 2025-02-27 Feibo Jiang , Wanyun Zhu , Li Dong , Kezhi Wang , Kun Yang , Cunhua Pan , Octavia A. Dobre

Continual learning (CL) for Foundation Models (FMs) is an essential yet underexplored challenge, especially in Federated Continual Learning (FCL), where each client learns from a private, evolving task stream under strict data and…

Machine Learning · Computer Science 2025-08-14 Hao Yu , Xin Yang , Boyang Fan , Xuemei Cao , Hanlin Gu , Lixin Fan , Qiang Yang

When handling streaming graphs, existing graph representation learning models encounter a catastrophic forgetting problem, where previously learned knowledge of these models is easily overwritten when learning with newly incoming graphs. In…

Machine Learning · Computer Science 2024-07-11 Yilun Liu , Ruihong Qiu , Yanran Tang , Hongzhi Yin , Zi Huang