English
Related papers

Related papers: InfoNCE is a Free Lunch for Semantically guided Gr…

200 papers

Graph Neural Networks (GNNs) have demonstrated significant success in learning from graph-structured data but often struggle on heterophilous graphs, where connected nodes differ in features or class labels. This limitation arises from…

Machine Learning · Computer Science 2025-09-30 Zhongtian Sun , Anoushka Harit , Alexandra Cristea , Christl A. Donnelly , Pietro Liò

This paper details an empirical investigation into using Graph Contrastive Learning (GCL) to generate mathematical equation representations, a critical aspect of Mathematical Information Retrieval (MIR). Our findings reveal that this simple…

Information Retrieval · Computer Science 2024-02-22 Pei-Syuan Wang , Hung-Hsuan Chen

Contrastive learning (CL) has emerged as a powerful framework for learning representations of images and text in a self-supervised manner while enhancing model robustness against adversarial attacks. More recently, researchers have extended…

Machine Learning · Computer Science 2023-12-04 Filippo Guerranti , Zinuo Yi , Anna Starovoit , Rafiq Kamel , Simon Geisler , Stephan Günnemann

Unsupervised (or self-supervised) graph representation learning is essential to facilitate various graph data mining tasks when external supervision is unavailable. The challenge is to encode the information about the graph structure and…

Machine Learning · Computer Science 2020-09-16 Costas Mavromatis , George Karypis

In recommendation, graph-based Collaborative Filtering (CF) methods mitigate the data sparsity by introducing Graph Contrastive Learning (GCL). However, the random negative sampling strategy in these GCL-based CF models neglects the…

Information Retrieval · Computer Science 2023-10-25 Lei Han , Hui Yan , Zhicheng Qiao

In contemporary self-supervised contrastive algorithms like SimCLR, MoCo, etc., the task of balancing attraction between two semantically similar samples and repulsion between two samples of different classes is primarily affected by the…

Machine Learning · Computer Science 2024-05-13 Siladittya Manna , Soumitri Chattopadhyay , Rakesh Dey , Saumik Bhattacharya , Umapada Pal

Visual recognition is recently learned via either supervised learning on human-annotated image-label data or language-image contrastive learning with webly-crawled image-text pairs. While supervised learning may result in a more…

Computer Vision and Pattern Recognition · Computer Science 2022-04-08 Jianwei Yang , Chunyuan Li , Pengchuan Zhang , Bin Xiao , Ce Liu , Lu Yuan , Jianfeng Gao

Advances in the field of vision-language contrastive learning have made it possible for many downstream applications to be carried out efficiently and accurately by simply taking the dot product between image and text representations. One…

Machine Learning · Computer Science 2023-10-20 Yifei Zhou , Juntao Ren , Fengyu Li , Ramin Zabih , Ser-Nam Lim

Graph neural network(GNN) has been a powerful approach in collaborative filtering(CF) due to its ability to model high-order user-item relationships. Recently, to alleviate the data sparsity and enhance representation learning, many efforts…

Information Retrieval · Computer Science 2024-12-10 Bowen Zheng , Junjie Zhang , Hongyu Lu , Yu Chen , Ming Chen , Wayne Xin Zhao , Ji-Rong Wen

Graph Contrastive Learning (GCL) has recently drawn much research interest for learning generalizable node representations in a self-supervised manner. In general, the contrastive learning process in GCL is performed on top of the…

Machine Learning · Computer Science 2022-12-06 Kaize Ding , Yancheng Wang , Yingzhen Yang , Huan Liu

Graph Neural Networks (GNNs) are powerful tools for recommendation systems, but they often struggle under data sparsity and noise. To address these issues, we implemented LightGCL, a graph contrastive learning model that uses Singular Value…

Information Retrieval · Computer Science 2025-06-03 Aravinda Jatavallabha , Prabhanjan Bharadwaj , Ashish Chander

Graph Contrastive Learning (GCL), which fuses graph neural networks with contrastive learning, has evolved as a pivotal tool in user-item recommendations. While promising, existing GCL methods often lack explicit modeling of hierarchical…

Information Retrieval · Computer Science 2025-05-27 Jiawei Xue , Zhen Yang , Haitao Lin , Ziji Zhang , Luzhu Wang , Yikun Gu , Yao Xu , Xin Li

Personalized recommendation is widely used in the web applications, and graph contrastive learning (GCL) has gradually become a dominant approach in recommender systems, primarily due to its ability to extract self-supervised signals from…

Information Retrieval · Computer Science 2025-04-15 Yu Zhang , Yiwen Zhang , Yi Zhang , Lei Sang , Yun Yang

Graph contrastive learning (GCL), learning the node representation by contrasting two augmented graphs in a self-supervised way, has attracted considerable attention. GCL is usually believed to learn the invariant representation. However,…

Machine Learning · Computer Science 2024-03-08 Yanhu Mo , Xiao Wang , Shaohua Fan , Chuan Shi

Given augmented views of each input graph, contrastive learning methods (e.g., InfoNCE) optimize pairwise alignment of graph embeddings across views while providing no mechanism to control the global structure of the view specific…

Machine Learning · Computer Science 2025-12-23 Manh Nguyen

Visual place recognition is a challenging task in computer vision and a key component of camera-based localization and navigation systems. Recently, Convolutional Neural Networks (CNNs) achieved high results and good generalization…

Computer Vision and Pattern Recognition · Computer Science 2023-04-21 María Leyva-Vallina , Nicola Strisciuglio , Nicolai Petkov

Graph-based Semi-Supervised Learning (SSL) aims to transfer the labels of a handful of labeled data to the remaining massive unlabeled data via a graph. As one of the most popular graph-based SSL approaches, the recently proposed Graph…

Machine Learning · Computer Science 2020-09-22 Sheng Wan , Shirui Pan , Jian Yang , Chen Gong

Attribute graphs are ubiquitous in multimedia applications, and graph representation learning (GRL) has been successful in analyzing attribute graph data. However, incomplete graph data and missing node attributes can have a negative impact…

Machine Learning · Computer Science 2023-05-09 Xiaochuan Zhang , Mengran Li , Ye Wang , Haojun Fei

In recent years, Graph Neural Networks (GNNs) have become successful in molecular property prediction tasks such as toxicity analysis. However, due to the black-box nature of GNNs, their outputs can be concerning in high-stakes…

Machine Learning · Computer Science 2024-10-22 Yinhan He , Zaiyi Zheng , Patrick Soga , Yaozhen Zhu , yushun Dong , Jundong Li

Graph Convolutional Networks (GCNs) has demonstrated promising results for recommender systems, as they can effectively leverage high-order relationship. However, these methods usually encounter data sparsity issue in real-world scenarios.…

Information Retrieval · Computer Science 2023-09-21 Qian Zhao , Zhengwei Wu , Zhiqiang Zhang , Jun Zhou