中文
相关论文

相关论文: Calibrating and Improving Graph Contrastive Learni…

200 篇论文

Contrastive learning has gained popularity and pushes state-of-the-art performance across numerous large-scale benchmarks. In contrastive learning, the contrastive loss function plays a pivotal role in discerning similarities between…

计算机视觉与模式识别 · 计算机科学 2025-12-03 Haojin Deng , Yimin Yang

Spurious correlations pose a major challenge for robust machine learning. Models trained with empirical risk minimization (ERM) may learn to rely on correlations between class labels and spurious attributes, leading to poor performance on…

机器学习 · 计算机科学 2024-12-12 Michael Zhang , Nimit S. Sohoni , Hongyang R. Zhang , Chelsea Finn , Christopher Ré

Self-supervised learning on graphs can be bifurcated into contrastive and generative methods. Contrastive methods, also known as graph contrastive learning (GCL), have dominated graph self-supervised learning in the past few years, but the…

机器学习 · 计算机科学 2024-02-13 Liang Wang , Xiang Tao , Qiang Liu , Shu Wu , Liang Wang

Graph Neural Networks (GNNs) are widely adopted in Web-related applications, serving as a core technique for learning from graph-structured data, such as text-attributed graphs. Yet in real-world scenarios, such graphs exhibit deficiencies…

机器学习 · 计算机科学 2025-10-03 Zhaoyan Wang , Zheng Gao , Arogya Kharel , In-Young Ko

Model miscalibration has been frequently identified in modern deep neural networks. Recent work aims to improve model calibration directly through a differentiable calibration proxy. However, the calibration produced is often biased due to…

机器学习 · 计算机科学 2024-06-26 Cheng Wang , Jacek Golebiowski

Continual Graph Learning (CGL) enables models to incrementally learn from streaming graph-structured data without forgetting previously acquired knowledge. Experience replay is a common solution that reuses a subset of past samples during…

机器学习 · 计算机科学 2026-03-31 Qiao Yuan , Sheng-Uei Guan , Pin Ni , Tianlun Luo , Ka Lok Man , Prudence Wong , Victor Chang

Graph matching has important applications in pattern recognition and beyond. Current approaches predominantly adopt supervised learning, demanding extensive labeled data which can be limited or costly. Meanwhile, self-supervised learning…

机器学习 · 计算机科学 2024-06-26 Jianyuan Bo , Yuan Fang

Graph Representation Learning (GRL) is a fundamental task in machine learning, aiming to encode high-dimensional graph-structured data into low-dimensional vectors. Self-Supervised Learning (SSL) methods are widely used in GRL because they…

机器学习 · 计算机科学 2025-06-13 Shifeng Xie , Aref Einizade , Jhony H. Giraldo

Contrastive learning (CL) has emerged as a powerful framework for learning representations of images and text in a self-supervised manner while enhancing model robustness against adversarial attacks. More recently, researchers have extended…

机器学习 · 计算机科学 2023-12-04 Filippo Guerranti , Zinuo Yi , Anna Starovoit , Rafiq Kamel , Simon Geisler , Stephan Günnemann

Graphs are a natural representation for systems based on relations between connected entities. Combinatorial optimization problems, which arise when considering an objective function related to a process of interest on discrete structures,…

机器学习 · 计算机科学 2024-08-21 Victor-Alexandru Darvariu , Stephen Hailes , Mirco Musolesi

Graph Neural Networks (GNNs) are widely used in collaborative filtering to capture high-order user-item relationships. To address the data sparsity problem in recommendation systems, Graph Contrastive Learning (GCL) has emerged as a…

信息检索 · 计算机科学 2025-07-11 Jinfeng Xu , Zheyu Chen , Shuo Yang , Jinze Li , Hewei Wang , Wei Wang , Xiping Hu , Edith Ngai

Graph contrastive learning has emerged as a powerful tool for unsupervised graph representation learning. The key to the success of graph contrastive learning is to acquire high-quality positive and negative samples as contrasting pairs for…

机器学习 · 计算机科学 2023-05-19 Haoran Yang , Hongxu Chen , Sixiao Zhang , Xiangguo Sun , Qian Li , Xiangyu Zhao , Guandong Xu

Pre-training Graph Neural Networks (GNN) via self-supervised contrastive learning has recently drawn lots of attention. However, most existing works focus on node-level contrastive learning, which cannot capture global graph structure. The…

机器学习 · 计算机科学 2021-04-19 Shichang Zhang , Ziniu Hu , Arjun Subramonian , Yizhou Sun

Self-supervised pre-training of deep learning models with contrastive learning is a widely used technique in image analysis. Current findings indicate a strong potential for contrastive pre-training on medical images. However, further…

图像与视频处理 · 电气工程与系统科学 2024-10-21 Daniel Wolf , Tristan Payer , Catharina Silvia Lisson , Christoph Gerhard Lisson , Meinrad Beer , Michael Götz , Timo Ropinski

This paper studies the problem of graph-level clustering, which is a novel yet challenging task. This problem is critical in a variety of real-world applications such as protein clustering and genome analysis in bioinformatics. Recent years…

机器学习 · 计算机科学 2023-03-09 Wei Ju , Yiyang Gu , Binqi Chen , Gongbo Sun , Yifang Qin , Xingyuming Liu , Xiao Luo , Ming Zhang

Graph-level representations are critical in various real-world applications, such as predicting the properties of molecules. But in practice, precise graph annotations are generally very expensive and time-consuming. To address this issue,…

机器学习 · 计算机科学 2022-07-26 Shuai Lin , Pan Zhou , Zi-Yuan Hu , Shuojia Wang , Ruihui Zhao , Yefeng Zheng , Liang Lin , Eric Xing , Xiaodan Liang

Heterogeneous Graphs (HGs) effectively model complex relationships in the real world through multi-type nodes and edges. In recent years, inspired by self-supervised learning (SSL), contrastive learning (CL)-based Heterogeneous Graphs…

机器学习 · 计算机科学 2025-05-06 Yu Wang , Lei Sang , Yi Zhang , Yiwen Zhang , Xindong Wu

Advanced graph neural networks have shown great potentials in graph classification tasks recently. Different from node classification where node embeddings aggregated from local neighbors can be directly used to learn node labels, graph…

机器学习 · 计算机科学 2022-03-16 Hao Jia , Junzhong Ji , Minglong Lei

Contrastive learning has been widely applied to graph representation learning, where the view generators play a vital role in generating effective contrastive samples. Most of the existing contrastive learning methods employ pre-defined…

机器学习 · 计算机科学 2022-01-04 Yihang Yin , Qingzhong Wang , Siyu Huang , Haoyi Xiong , Xiang Zhang

Contrastive representation learning has been recently proved to be very efficient for self-supervised training. These methods have been successfully used to train encoders which perform comparably to supervised training on downstream…

机器学习 · 计算机科学 2020-12-03 Ibrahim Merad , Yiyang Yu , Emmanuel Bacry , Stéphane Gaïffas