English
Related papers

Related papers: Unbiased Online Curvature Approximation for Regula…

200 papers

Graph contrastive learning (GCL) is the most representative and prevalent self-supervised learning approach for graph-structured data. Despite its remarkable success, existing GCL methods highly rely on an augmentation scheme to learn the…

Machine Learning · Computer Science 2022-06-07 Haonan Wang , Jieyu Zhang , Qi Zhu , Wei Huang

Continual learning (CL) involves acquiring and accumulating knowledge from evolving tasks while alleviating catastrophic forgetting. Recently, leveraging contrastive loss to construct more transferable and less forgetful representations has…

Machine Learning · Computer Science 2025-09-22 Jia Tang , Xinrui Wang , Songcan Chen

Contrastive learning methods based on InfoNCE loss are popular in node representation learning tasks on graph-structured data. However, its reliance on data augmentation and its quadratic computational complexity might lead to inconsistency…

Machine Learning · Computer Science 2022-12-12 Hengrui Zhang , Qitian Wu , Yu Wang , Shaofeng Zhang , Junchi Yan , Philip S. Yu

Graph Contrastive Learning (GCL) has recently made progress as an unsupervised graph representation learning paradigm. GCL approaches can be categorized into augmentation-based and augmentation-free methods. The former relies on complex…

Machine Learning · Computer Science 2025-04-25 Yanan Zhao , Feng Ji , Kai Zhao , Xuhao Li , Qiyu Kang , Wenfei Liang , Yahya Alkhatib , Xingchao Jian , Wee Peng Tay

Graph Neural Networks (GNNs) have achieved great success in learning graph representations and thus facilitating various graph-related tasks. However, most GNN methods adopt a supervised learning setting, which is not always feasible in…

Machine Learning · Computer Science 2022-08-16 Hongliang Chi , Yao Ma

Many scientific datasets are of high dimension, and the analysis usually requires visual manipulation by retaining the most important structures of data. Principal curve is a widely used approach for this purpose. However, many existing…

Artificial Intelligence · Computer Science 2016-01-19 Qi Mao , Li Wang , Ivor W. Tsang , Yijun Sun

Exemplar-Free Class Incremental Learning (EFCIL) aims to learn from a sequence of tasks without having access to previous task data. In this paper, we consider the challenging Cold Start scenario in which insufficient data is available in…

Computer Vision and Pattern Recognition · Computer Science 2024-05-31 Simone Magistri , Tomaso Trinci , Albin Soutif-Cormerais , Joost van de Weijer , Andrew D. Bagdanov

Pre-trained representation is one of the key elements in the success of modern deep learning. However, existing works on continual learning methods have mostly focused on learning models incrementally from scratch. In this paper, we explore…

Machine Learning · Computer Science 2022-08-18 Hyounguk Shon , Janghyeon Lee , Seung Hwan Kim , Junmo Kim

By treating users' interactions as a user-item graph, graph learning models have been widely deployed in Collaborative Filtering(CF) based recommendation. Recently, researchers have introduced Graph Contrastive Learning(GCL) techniques into…

Information Retrieval · Computer Science 2023-07-12 Yonghui Yang , Zhengwei Wu , Le Wu , Kun Zhang , Richang Hong , Zhiqiang Zhang , Jun Zhou , Meng Wang

Graph contrastive learning (GCL) learns node and graph representations by contrasting multiple views of the same graph. Existing methods typically rely on fixed, handcrafted views-usually a local and a global perspective, which limits their…

Machine Learning · Computer Science 2026-05-12 Yanan Zhao , Feng Ji , Jingyang Dai , Jiaze Ma , Keyue Jiang , Kai Zhao , Wee Peng Tay

Continual graph learning (CGL) aims to learn from dynamically evolving graphs while mitigating catastrophic forgetting. Existing CGL approaches typically adopt a task-based formulation, where the data stream is partitioned into a sequence…

Machine Learning · Computer Science 2026-05-15 Guiquan Sun , Xikun Zhang , Jingchao Ni , Dongjin Song

Graph Contrastive Learning (GCL) has emerged as a popular unsupervised graph representation learning method. However, it has been shown that GCL is vulnerable to adversarial attacks on both the graph structure and node attributes. Although…

Cryptography and Security · Computer Science 2023-10-06 Minhua Lin , Teng Xiao , Enyan Dai , Xiang Zhang , Suhang Wang

Neural networks have achieved remarkable success in many cognitive tasks. However, when they are trained sequentially on multiple tasks without access to old data, their performance on early tasks tend to drop significantly. This problem is…

Machine Learning · Computer Science 2021-02-10 Dong Yin , Mehrdad Farajtabar , Ang Li , Nir Levine , Alex Mott

Graph Contrastive Learning (GCL) has emerged as a popular training approach for learning node embeddings from augmented graphs without labels. Despite the key principle that maximizing the similarity between positive node pairs while…

Machine Learning · Computer Science 2024-05-27 Yue Yu , Xiao Wang , Mengmei Zhang , Nian Liu , Chuan Shi

Graph data in real-world scenarios undergo rapid and frequent changes, making it challenging for existing graph models to effectively handle the continuous influx of new data and accommodate data withdrawal requests. The approach to…

Machine Learning · Computer Science 2025-08-26 Jiaxing Miao , Liang Hu , Qi Zhang , Longbing Cao

Online continual learning (OCL) aims to train neural networks incrementally from a non-stationary data stream with a single pass through data. Rehearsal-based methods attempt to approximate the observed input distributions over time with a…

Machine Learning · Computer Science 2022-11-15 Yaqian Zhang , Bernhard Pfahringer , Eibe Frank , Albert Bifet , Nick Jin Sean Lim , Yunzhe Jia

Hard negative mining has shown effective in enhancing self-supervised contrastive learning (CL) on diverse data types, including graph CL (GCL). The existing hardness-aware CL methods typically treat negative instances that are most similar…

Machine Learning · Computer Science 2024-01-09 Chaoxi Niu , Guansong Pang , Ling Chen

Unsupervised graph representation learning is a non-trivial topic. The success of contrastive methods in the unsupervised representation learning on structured data inspires similar attempts on the graph. Existing graph contrastive learning…

Machine Learning · Computer Science 2024-04-02 Tianyu Zhang , Yuxiang Ren , Wenzheng Feng , Weitao Du , Xuecang Zhang

Continual learning on graphs tackles the problem of training a graph neural network (GNN) where graph data arrive in a streaming fashion and the model tends to forget knowledge from previous tasks when updating with new data. Traditional…

Machine Learning · Computer Science 2024-01-09 Xiaoxue Han , Zhuo Feng , Yue Ning

Continual learning~(CL) is a field concerned with learning a series of inter-related task with the tasks typically defined in the sense of either regression or classification. In recent years, CL has been studied extensively when these…

Machine Learning · Computer Science 2023-11-07 Krishnan Raghavan , Prasanna Balaprakash