English
Related papers

Related papers: Towards Continuous Reuse of Graph Models via Holis…

200 papers

Continual learning for Semantic Segmentation (CSS) is a rapidly emerging field, in which the capabilities of the segmentation model are incrementally improved by learning new classes or new domains. A central challenge in Continual Learning…

Computer Vision and Pattern Recognition · Computer Science 2022-09-21 Tobias Kalb , Björn Mauthe , Jürgen Beyerer

Continual Graph Learning (CGL), which aims to accommodate new tasks over evolving graph data without forgetting prior knowledge, is garnering significant research interest. Mainstream solutions adopt the memory replay-based idea, ie,…

Machine Learning · Computer Science 2025-02-11 Qi Wang , Tianfei Zhou , Ye Yuan , Rui Mao

Predictive Autoscaling is used to forecast the workloads of servers and prepare the resources in advance to ensure service level objectives (SLOs) in dynamic cloud environments. However, in practice, its prediction task often suffers from…

Machine Learning · Computer Science 2023-09-06 Hongyan Hao , Zhixuan Chu , Shiyi Zhu , Gangwei Jiang , Yan Wang , Caigao Jiang , James Zhang , Wei Jiang , Siqiao Xue , Jun Zhou

We investigate the replay buffer in rehearsal-based approaches for graph continual learning (GCL) methods. Existing rehearsal-based GCL methods select the most representative nodes for each class and store them in a replay buffer for later…

Machine Learning · Computer Science 2024-03-05 Seungyoon Choi , Wonjoong Kim , Sungwon Kim , Yeonjun In , Sein Kim , Chanyoung Park

We propose a novel graph-driven generative model, that unifies multiple heterogeneous learning tasks into the same framework. The proposed model is based on the fact that heterogeneous learning tasks, which correspond to different…

Machine Learning · Computer Science 2019-11-21 Wenlin Wang , Hongteng Xu , Zhe Gan , Bai Li , Guoyin Wang , Liqun Chen , Qian Yang , Wenqi Wang , Lawrence Carin

Continual learning is a challenging problem in machine learning, especially for image classification tasks with imbalanced datasets. It becomes even more challenging when it involves learning new classes incrementally. One method for…

Machine Learning · Computer Science 2024-06-14 Sohaib Younis , Bernhard Seeger

The prevalence of real-world multi-view data makes incomplete multi-view clustering (IMVC) a crucial research. The rapid development of Graph Neural Networks (GNNs) has established them as one of the mainstream approaches for multi-view…

We consider the problem of constructing embeddings of large attributed graphs and supporting multiple downstream learning tasks. We develop a graph embedding method, which is based on extending deep metric and unbiased contrastive learning…

Machine Learning · Computer Science 2024-11-22 Xiang Li , Gagan Agrawal , Ruoming Jin , Rajiv Ramnath

We present a novel class incremental learning approach based on deep neural networks, which continually learns new tasks with limited memory for storing examples in the previous tasks. Our algorithm is based on knowledge distillation and…

Machine Learning · Computer Science 2022-04-05 Minsoo Kang , Jaeyoo Park , Bohyung Han

Despite advances in deep learning, neural networks can only learn multiple tasks when trained on them jointly. When tasks arrive sequentially, they lose performance on previously learnt tasks. This phenomenon called catastrophic forgetting…

Machine Learning · Computer Science 2018-05-29 Nitin Kamra , Umang Gupta , Yan Liu

In continual learning, the learner learns multiple tasks in sequence, with data being acquired only once for each task. Catastrophic forgetting is a major challenge to continual learning. To reduce forgetting, some existing rehearsal-based…

Machine Learning · Computer Science 2023-10-13 Zihao Xu , Xuan Tang , Yufei Shi , Jianfeng Zhang , Jian Yang , Mingsong Chen , Xian Wei

Graph Neural Networks (GNNs) have recently received significant research attention due to their superior performance on a variety of graph-related learning tasks. Most of the current works focus on either static or dynamic graph settings,…

Machine Learning · Computer Science 2021-02-09 Fan Zhou , Chengtai Cao

A continual learning agent learns online with a non-stationary and never-ending stream of data. The key to such learning process is to overcome the catastrophic forgetting of previously seen data, which is a well known problem of neural…

Machine Learning · Computer Science 2019-11-01 Rahaf Aljundi , Min Lin , Baptiste Goujaud , Yoshua Bengio

Catastrophic forgetting remains a key challenge in Continual Learning (CL). In replay-based CL with severe memory constraints, performance critically depends on the sample selection strategy for the replay buffer. Most existing approaches…

Machine Learning · Computer Science 2026-04-10 Danit Yanowsky , Daphna Weinshall

Learning effective embedding has been proved to be useful in many real-world problems, such as recommender systems, search ranking and online advertisement. However, one of the challenges is data sparsity in learning large-scale item…

Machine Learning · Computer Science 2019-05-27 Yi Ouyang , Bin Guo , Xing Tang , Xiuqiang He , Jian Xiong , Zhiwen Yu

Artificial intelligence for graphs has achieved remarkable success in modeling complex systems, ranging from dynamic networks in biology to interacting particle systems in physics. However, the increasingly heterogeneous graph datasets call…

Machine Learning · Computer Science 2023-01-25 Yasha Ektefaie , George Dasoulas , Ayush Noori , Maha Farhat , Marinka Zitnik

Despite huge success, deep networks are unable to learn effectively in sequential multitask learning settings as they forget the past learned tasks after learning new tasks. Inspired from complementary learning systems theory, we address…

Machine Learning · Computer Science 2019-06-04 Mohammad Rostami , Soheil Kolouri , Praveen K. Pilly

Continual learning in computer vision faces the critical challenge of catastrophic forgetting, where models struggle to retain prior knowledge while adapting to new tasks. Although recent studies have attempted to leverage the…

Computer Vision and Pattern Recognition · Computer Science 2025-03-25 Xusheng Cao , Haori Lu , Linlan Huang , Fei Yang , Xialei Liu , Ming-Ming Cheng

Collaborative learning, which enables collaborative and decentralized training of deep neural networks at multiple institutions in a privacy-preserving manner, is rapidly emerging as a valuable technique in healthcare applications. However,…

Computer Vision and Pattern Recognition · Computer Science 2022-04-15 Liangqiong Qu , Niranjan Balachandar , Miao Zhang , Daniel Rubin

Neural networks are prone to catastrophic forgetting when trained incrementally on different tasks. Popular incremental learning methods mitigate such forgetting by retaining a subset of previously seen samples and replaying them during the…

Computer Vision and Pattern Recognition · Computer Science 2022-12-07 Kevin Thandiackal , Tiziano Portenier , Andrea Giovannini , Maria Gabrani , Orcun Goksel