English
Related papers

Related papers: Do Generated Data Always Help Contrastive Learning…

200 papers

As trustworthy AI continues to advance, the fairness issue in recommendations has received increasing attention. A recommender system is considered unfair when it produces unequal outcomes for different user groups based on user-sensitive…

Artificial Intelligence · Computer Science 2024-10-24 Wei Chen , Meng Yuan , Zhao Zhang , Ruobing Xie , Fuzhen Zhuang , Deqing Wang , Rui Liu

Graph contrastive learning (GCL) shows great potential in unsupervised graph representation learning. Data augmentation plays a vital role in GCL, and its optimal choice heavily depends on the downstream task. Many GCL methods with…

Machine Learning · Computer Science 2023-05-30 Xin Xiong , Furao Shen , Xiangyu Wang , Jian Zhao

Contrastive learning has led to substantial improvements in the quality of learned embedding representations for tasks such as image classification. However, a key drawback of existing contrastive augmentation methods is that they may lead…

Computer Vision and Pattern Recognition · Computer Science 2022-04-19 Zhibo Zhang , Jongseong Jang , Chiheb Trabelsi , Ruiwen Li , Scott Sanner , Yeonjeong Jeong , Dongsub Shim

In the domain of recommendation and collaborative filtering, Graph Contrastive Learning (GCL) has become an influential approach. Nevertheless, the reasons for the effectiveness of contrastive learning are still not well understood. In this…

Information Retrieval · Computer Science 2024-10-01 Chengkai Liu , Jianling Wang , James Caverlee

Contrastive learning is an effective unsupervised method in graph representation learning, and the key component of contrastive learning lies in the construction of positive and negative samples. Previous methods usually utilize the…

Machine Learning · Computer Science 2024-02-07 Shengyu Feng , Baoyu Jing , Yada Zhu , Hanghang Tong

Contrastive learning is one of the fastest growing research areas in machine learning due to its ability to learn useful representations without labeled data. However, contrastive learning is susceptible to feature suppression, i.e., it may…

Machine Learning · Computer Science 2021-11-30 Tianhong Li , Lijie Fan , Yuan Yuan , Hao He , Yonglong Tian , Rogerio Feris , Piotr Indyk , Dina Katabi

This study reveals the inherent tolerance of contrastive learning (CL) towards sampling bias, wherein negative samples may encompass similar semantics (\eg labels). However, existing theories fall short in providing explanations for this…

Machine Learning · Computer Science 2023-10-18 Junkang Wu , Jiawei Chen , Jiancan Wu , Wentao Shi , Xiang Wang , Xiangnan He

Recently, contrastiveness-based augmentation surges a new climax in the computer vision domain, where some operations, including rotation, crop, and flip, combined with dedicated algorithms, dramatically increase the model generalization…

Computer Vision and Pattern Recognition · Computer Science 2022-05-23 Han Yue , Chunhui Zhang , Chuxu Zhang , Hongfu Liu

Contrastive learning (CL), which can extract the information shared between different contrastive views, has become a popular paradigm for vision representation learning. Inspired by the success in computer vision, recent work introduces CL…

Machine Learning · Computer Science 2022-12-15 Xumeng Gong , Cheng Yang , Chuan Shi

The performance of generative adversarial networks (GANs) heavily deteriorates given a limited amount of training data. This is mainly because the discriminator is memorizing the exact training set. To combat it, we propose Differentiable…

Computer Vision and Pattern Recognition · Computer Science 2020-12-08 Shengyu Zhao , Zhijian Liu , Ji Lin , Jun-Yan Zhu , Song Han

Data-Efficient GANs (DE-GANs), which aim to learn generative models with a limited amount of training data, encounter several challenges for generating high-quality samples. Since data augmentation strategies have largely alleviated the…

Computer Vision and Pattern Recognition · Computer Science 2022-07-20 Ziqiang Li , Chaoyue Wang , Heliang Zheng , Jing Zhang , Bin Li

Contrastive learning enables learning useful audio and speech representations without ground-truth labels by maximizing the similarity between latent representations of similar signal segments. In this framework various data augmentation…

Audio and Speech Processing · Electrical Eng. & Systems 2022-04-11 Salah Zaiem , Titouan Parcollet , Slim Essid

Existing graph contrastive learning methods rely on augmentation techniques based on random perturbations (e.g., randomly adding or dropping edges and nodes). Nevertheless, altering certain edges or nodes can unexpectedly change the graph…

Machine Learning · Computer Science 2022-11-08 Huidong Liang , Xingjian Du , Bilei Zhu , Zejun Ma , Ke Chen , Junbin Gao

Unsupervised graph representation learning is a non-trivial topic. The success of contrastive methods in the unsupervised representation learning on structured data inspires similar attempts on the graph. Existing graph contrastive learning…

Machine Learning · Computer Science 2024-04-02 Tianyu Zhang , Yuxiang Ren , Wenzheng Feng , Weitao Du , Xuecang Zhang

Recent studies have demonstrated that gradient matching-based dataset synthesis, or dataset condensation (DC), methods can achieve state-of-the-art performance when applied to data-efficient learning tasks. However, in this study, we prove…

Computer Vision and Pattern Recognition · Computer Science 2022-06-17 Saehyung Lee , Sanghyuk Chun , Sangwon Jung , Sangdoo Yun , Sungroh Yoon

Data augmentation plays a pivotal role in enhancing and diversifying training data. Nonetheless, consistently improving model performance in varied learning scenarios, especially those with inherent data biases, remains challenging. To…

Machine Learning · Computer Science 2024-06-04 Xiaoling Zhou , Wei Ye , Zhemg Lee , Rui Xie , Shikun Zhang

Contrastive learning, commonly applied in large-scale multimodal models, often relies on data from diverse and often unreliable sources, which can include misaligned or mislabeled text-image pairs. This frequently leads to robustness issues…

Machine Learning · Computer Science 2025-02-04 Lijie Hu , Chenyang Ren , Huanyi Xie , Khouloud Saadi , Shu Yang , Zhen Tan , Jingfeng Zhang , Di Wang

Graph contrastive learning (GCL) learns node and graph representations by contrasting multiple views of the same graph. Existing methods typically rely on fixed, handcrafted views-usually a local and a global perspective, which limits their…

Machine Learning · Computer Science 2026-05-12 Yanan Zhao , Feng Ji , Jingyang Dai , Jiaze Ma , Keyue Jiang , Kai Zhao , Wee Peng Tay

Graph contrastive learning (GCL) has emerged as a pivotal technique in the domain of graph representation learning. A crucial aspect of effective GCL is the caliber of generated positive and negative samples, which is intrinsically dictated…

Machine Learning · Computer Science 2024-02-19 Xinjian Zhao , Liang Zhang , Yang Liu , Ruocheng Guo , Xiangyu Zhao

This study delves into the application of Generative Adversarial Networks (GANs) within the context of imbalanced datasets. Our primary aim is to enhance the performance and stability of GANs in such datasets. In pursuit of this objective,…

Machine Learning · Computer Science 2023-12-11 Ali Anaissi , Yuanzhe Jia , Ali Braytee , Mohamad Naji , Widad Alyassine