English
Related papers

Related papers: Continual Learning on Graphs: A Survey

200 papers

Dynamic graph learning has gained significant attention as it offers a powerful means to model intricate interactions among entities across various real-world and scientific domains. Notably, graphs serve as effective representations for…

Machine Learning · Computer Science 2024-01-17 Sanaz Hasanzadeh Fard

It has been observed that neural networks perform poorly when the data or tasks are presented sequentially. Unlike humans, neural networks suffer greatly from catastrophic forgetting, making it impossible to perform life-long learning. To…

Machine Learning · Computer Science 2023-01-31 Longhui Yu , Tianyang Hu , Lanqing Hong , Zhen Liu , Adrian Weller , Weiyang Liu

Despite remarkable successes achieved by modern neural networks in a wide range of applications, these networks perform best in domain-specific stationary environments where they are trained only once on large-scale controlled data…

Neural and Evolutionary Computing · Computer Science 2019-04-23 Pouya Bashivan , Martin Schrimpf , Robert Ajemian , Irina Rish , Matthew Riemer , Yuhai Tu

Continual learning refers to the ability of a biological or artificial system to seamlessly learn from continuous streams of information while preventing catastrophic forgetting, i.e., a condition in which new incoming information strongly…

Machine Learning · Computer Science 2019-07-04 German I. Parisi , Christopher Kanan

In recent years, there has been a resurgence in methods that use distributed (neural) representations to represent and reason about semantic knowledge for robotics applications. However, while robots often observe previously unknown…

Robotics · Computer Science 2021-05-11 Angel Daruna , Mehul Gupta , Mohan Sridharan , Sonia Chernova

Research on graph representation learning has received a lot of attention in recent years since many data in real-world applications come in form of graphs. High-dimensional graph data are often in irregular form, which makes them more…

Machine Learning · Computer Science 2020-06-03 Fenxiao Chen , Yuncheng Wang , Bin Wang , C. -C. Jay Kuo

Graphs arise naturally in many real-world applications including social networks, recommender systems, ontologies, biology, and computational finance. Traditionally, machine learning models for graphs have been mostly designed for static…

Machine Learning · Computer Science 2020-04-28 Seyed Mehran Kazemi , Rishab Goel , Kshitij Jain , Ivan Kobyzev , Akshay Sethi , Peter Forsyth , Pascal Poupart

The adaptive processing of graph data is a long-standing research topic which has been lately consolidated as a theme of major interest in the deep learning community. The snap increase in the amount and breadth of related research has come…

Machine Learning · Computer Science 2020-06-16 Davide Bacciu , Federico Errica , Alessio Micheli , Marco Podda

One of the objectives of continual learning is to prevent catastrophic forgetting in learning multiple tasks sequentially, and the existing solutions have been driven by the conceptualization of the plasticity-stability dilemma. However,…

Machine Learning · Computer Science 2024-04-16 Seungyub Han , Yeongmo Kim , Taehyun Cho , Jungwoo Lee

Inferring the underlying graph topology that characterizes structured data is pivotal to many graph-based models when pre-defined graphs are not available. This paper focuses on learning graphs in the case of sequential data in dynamic…

Machine Learning · Computer Science 2022-02-25 Xiang Zhang

Graph-structured data are pervasive in the real-world such as social networks, molecular graphs and transaction networks. Graph neural networks (GNNs) have achieved great success in representation learning on graphs, facilitating various…

Machine Learning · Computer Science 2025-02-27 Zhimeng Guo , Teng Xiao , Zongyu Wu , Charu Aggarwal , Hui Liu , Suhang Wang

Data augmentation has recently seen increased interest in graph machine learning given its demonstrated ability to improve model performance and generalization by added training data. Despite this recent surge, the area is still relatively…

Machine Learning · Computer Science 2023-01-20 Tong Zhao , Wei Jin , Yozen Liu , Yingheng Wang , Gang Liu , Stephan Günnemann , Neil Shah , Meng Jiang

Graph learning models have demonstrated great prowess in learning expressive representations from large-scale graph data in a wide variety of real-world scenarios. As a prevalent strategy for training powerful graph learning models, the…

Machine Learning · Computer Science 2025-06-11 Xingbo Fu , Zehong Wang , Zihan Chen , Jiazheng Li , Yaochen Zhu , Zhenyu Lei , Cong Shen , Yanfang Ye , Chuxu Zhang , Jundong Li

Time-dependent data-generating distributions have proven to be difficult for gradient-based training of neural networks, as the greedy updates result in catastrophic forgetting of previously learned knowledge. Despite the progress in the…

Machine Learning · Computer Science 2023-04-03 Matthias De Lange , Gido van de Ven , Tinne Tuytelaars

Medical imaging analysis has witnessed remarkable advancements even surpassing human-level performance in recent years, driven by the rapid development of advanced deep-learning algorithms. However, when the inference dataset slightly…

Image and Video Processing · Electrical Eng. & Systems 2024-10-11 Pratibha Kumari , Joohi Chauhan , Afshin Bozorgpour , Boqiang Huang , Reza Azad , Dorit Merhof

Addressing catastrophic forgetting is one of the key challenges in continual learning where machine learning systems are trained with sequential or streaming tasks. Despite recent remarkable progress in state-of-the-art deep learning, deep…

Machine Learning · Computer Science 2019-05-22 Xilai Li , Yingbo Zhou , Tianfu Wu , Richard Socher , Caiming Xiong

Continual graph learning (CGL) aims to learn from dynamically evolving graphs while mitigating catastrophic forgetting. Existing CGL approaches typically adopt a task-based formulation, where the data stream is partitioned into a sequence…

Machine Learning · Computer Science 2026-05-15 Guiquan Sun , Xikun Zhang , Jingchao Ni , Dongjin Song

Graph neural networks (GNN) are powerful models for many graph-structured tasks. Existing models often assume that the complete structure of the graph is available during training. In practice, however, graph-structured data is usually…

Machine Learning · Computer Science 2022-03-29 Chen Wang , Yuheng Qiu , Dasong Gao , Sebastian Scherer

On the one hand, there has been considerable progress on neural network verification in recent years, which makes certifying neural networks a possibility. On the other hand, neural networks in practice are often re-trained over time to…

Machine Learning · Computer Science 2024-07-10 Long H. Pham , Jun Sun

Graph data in real-world scenarios undergo rapid and frequent changes, making it challenging for existing graph models to effectively handle the continuous influx of new data and accommodate data withdrawal requests. The approach to…

Machine Learning · Computer Science 2025-08-26 Jiaxing Miao , Liang Hu , Qi Zhang , Longbing Cao