English
Related papers

Related papers: Continual Graph Learning: A Survey

200 papers

The goal of graph representation learning is to embed each vertex in a graph into a low-dimensional vector space. Existing graph representation learning methods can be classified into two categories: generative models that learn the…

Machine Learning · Computer Science 2017-11-23 Hongwei Wang , Jia Wang , Jialin Wang , Miao Zhao , Weinan Zhang , Fuzheng Zhang , Xing Xie , Minyi Guo

Continual learning~(CL) is a field concerned with learning a series of inter-related task with the tasks typically defined in the sense of either regression or classification. In recent years, CL has been studied extensively when these…

Machine Learning · Computer Science 2023-11-07 Krishnan Raghavan , Prasanna Balaprakash

The rapid growth of graph data poses significant challenges in storage, transmission, and particularly the training of graph neural networks (GNNs). To address these challenges, graph condensation (GC) has emerged as an innovative solution.…

Machine Learning · Computer Science 2025-01-28 Xinyi Gao , Junliang Yu , Tong Chen , Guanhua Ye , Wentao Zhang , Hongzhi Yin

Attribute graphs are ubiquitous in multimedia applications, and graph representation learning (GRL) has been successful in analyzing attribute graph data. However, incomplete graph data and missing node attributes can have a negative impact…

Machine Learning · Computer Science 2023-05-09 Xiaochuan Zhang , Mengran Li , Ye Wang , Haojun Fei

Continual learning is the problem of learning new tasks or knowledge while protecting old knowledge and ideally generalizing from old experience to learn new tasks faster. Neural networks trained by stochastic gradient descent often degrade…

Machine Learning · Computer Science 2019-11-27 David Rolnick , Arun Ahuja , Jonathan Schwarz , Timothy P. Lillicrap , Greg Wayne

In this work, we introduce Adapt & Align, a method for continual learning of neural networks by aligning latent representations in generative models. Neural Networks suffer from abrupt loss in performance when retrained with additional…

Machine Learning · Computer Science 2023-12-22 Kamil Deja , Bartosz Cywiński , Jan Rybarczyk , Tomasz Trzciński

Among different existing graph self-supervised learning strategies, graph contrastive learning (GCL) has been one of the most prevalent approaches to this problem. Despite the remarkable performance those GCL methods have achieved, existing…

Machine Learning · Computer Science 2022-10-27 Qianlong Wen , Zhongyu Ouyang , Chunhui Zhang , Yiyue Qian , Yanfang Ye , Chuxu Zhang

Recent advances in unsupervised deep graph clustering have been significantly promoted by contrastive learning. Despite the strides, most graph contrastive learning models face challenges: 1) graph augmentation is used to improve learning…

Machine Learning · Computer Science 2024-08-23 Chusheng Zeng , Bocheng Wang , Jinghui Yuan , Rong Wang , Mulin Chen

Graph condensation reduces the size of large graphs while preserving performance, addressing the scalability challenges of Graph Neural Networks caused by computational inefficiencies on large datasets. Existing methods often rely on…

Machine Learning · Computer Science 2025-10-10 Lin Wang , Qing Li

Graph contrastive learning (GCL), as a self-supervised learning method, can solve the problem of annotated data scarcity. It mines explicit features in unannotated graphs to generate favorable graph representations for downstream tasks.…

Machine Learning · Computer Science 2024-04-02 Jinhuan Wang , Jiafei Shao , Zeyu Wang , Shanqing Yu , Qi Xuan , Xiaoniu Yang

Continual Federated Learning (CFL) combines Federated Learning (FL), the decentralized learning of a central model on a number of client devices that may not communicate their data, and Continual Learning (CL), the learning of a model from…

Machine Learning · Computer Science 2023-10-24 Jack Good , Jimit Majmudar , Christophe Dupuy , Jixuan Wang , Charith Peris , Clement Chung , Richard Zemel , Rahul Gupta

Graph contrastive learning (GCL) has emerged as a promising approach to enhance graph neural networks' (GNNs) ability to learn rich representations from unlabeled graph-structured data. However, current GCL models face challenges with…

Machine Learning · Computer Science 2025-03-11 Yujia Wu , Junyi Mo , Elynn Chen , Yuzhou Chen

By treating users' interactions as a user-item graph, graph learning models have been widely deployed in Collaborative Filtering(CF) based recommendation. Recently, researchers have introduced Graph Contrastive Learning(GCL) techniques into…

Information Retrieval · Computer Science 2023-07-12 Yonghui Yang , Zhengwei Wu , Le Wu , Kun Zhang , Richang Hong , Zhiqiang Zhang , Jun Zhou , Meng Wang

Graph Neural Networks (GNN) endure catastrophic forgetting, undermining their capacity to preserve previously acquired knowledge amid the assimilation of novel information. Rehearsal-based techniques revisit historical examples, adopted as…

Machine Learning · Computer Science 2025-05-16 Lei Song , Jiaxing Li , Shihan Guan , Youyong Kong

Training on large-scale graphs has achieved remarkable results in graph representation learning, but its cost and storage have raised growing concerns. As one of the most promising directions, graph condensation methods address these issues…

Machine Learning · Computer Science 2024-09-30 Tianle Zhang , Yuchen Zhang , Kun Wang , Kai Wang , Beining Yang , Kaipeng Zhang , Wenqi Shao , Ping Liu , Joey Tianyi Zhou , Yang You

Continual learning consists in incrementally training a model on a sequence of datasets and testing on the union of all datasets. In this paper, we examine continual learning for the problem of sound classification, in which we wish to…

Machine Learning · Computer Science 2019-06-04 Zhepei Wang , Cem Subakan , Efthymios Tzinis , Paris Smaragdis , Laurent Charlin

In recent years, there has been remarkable progress in the field of digital pathology, driven by the ability to model complex tissue patterns using advanced deep-learning algorithms. However, the robustness of these models is often severely…

Image and Video Processing · Electrical Eng. & Systems 2024-09-11 Pratibha Kumari , Daniel Reisenbüchler , Lucas Luttner , Nadine S. Schaadt , Friedrich Feuerhake , Dorit Merhof

Graph neural networks (GNNs) have attracted widespread attention for their impressive capability of graph representation learning. However, the increasing prevalence of large-scale graphs presents a significant challenge for GNN training…

Machine Learning · Computer Science 2025-05-13 Xinyi Gao , Hongzhi Yin , Tong Chen , Guanhua Ye , Wentao Zhang , Bin Cui

Graph classification is essential for understanding complex biological systems, where molecular structures and interactions are naturally represented as graphs. Traditional graph neural networks (GNNs) perform well on static tasks but…

Machine Learning · Computer Science 2025-10-29 Ding Zhang , Jane Downer , Can Chen , Ren Wang

A major obstacle to developing artificial intelligence applications capable of true lifelong learning is that artificial neural networks quickly or catastrophically forget previously learned tasks when trained on a new one. Numerous methods…

Machine Learning · Computer Science 2019-04-18 Gido M. van de Ven , Andreas S. Tolias