中文
相关论文

相关论文: A Simplified Framework for Contrastive Learning fo…

200 篇论文

Pseudo Labeling is a technique used to improve the performance of semi-supervised Graph Neural Networks (GNNs) by generating additional pseudo-labels based on confident predictions. However, the quality of generated pseudo-labels has been a…

机器学习 · 计算机科学 2023-12-20 Weigang Lu , Ziyu Guan , Wei Zhao , Yaming Yang , Yuanhai Lv , Lining Xing , Baosheng Yu , Dacheng Tao

Learning good representations involves capturing the diverse ways in which data samples relate. Contrastive loss - an objective matching related samples - underlies methods from self-supervised to multimodal learning. Contrastive losses,…

计算机视觉与模式识别 · 计算机科学 2024-09-13 Vlad Sobal , Mark Ibrahim , Randall Balestriero , Vivien Cabannes , Diane Bouchacourt , Pietro Astolfi , Kyunghyun Cho , Yann LeCun

How can neural networks trained by contrastive learning extract features from the unlabeled data? Why does contrastive learning usually need much stronger data augmentations than supervised learning to ensure good representations? These…

机器学习 · 计算机科学 2021-07-06 Zixin Wen , Yuanzhi Li

Neural networks have revolutionized various domains, exhibiting remarkable accuracy in tasks like natural language processing and computer vision. However, their vulnerability to slight alterations in input samples poses challenges,…

计算机视觉与模式识别 · 计算机科学 2023-11-15 Shashank Kotyan , Danilo Vasconcellos Vargas

Graph contrastive learning has been successfully applied in text classification due to its remarkable ability for self-supervised node representation learning. However, explicit graph augmentations may lead to a loss of semantics in the…

计算与语言 · 计算机科学 2024-11-28 Wei Ai , Jianbin Li , Ze Wang , Yingying Wei , Tao Meng , Yuntao Shou , Keqin Lib

As an exemplary self-supervised approach for representation learning, time-series contrastive learning has exhibited remarkable advancements in contemporary research. While recent contrastive learning strategies have focused on how to…

机器学习 · 计算机科学 2024-08-27 Xiyuan Jin , Jing Wang , Lei Liu , Youfang Lin

We propose $\textbf{MGCL}$, a model-driven graph contrastive learning (GCL) framework that leverages graphons (probabilistic generative models for graphs) to guide contrastive learning by accounting for the data's underlying generative…

机器学习 · 计算机科学 2025-06-09 Ali Azizpour , Nicolas Zilberstein , Santiago Segarra

Contrastive Learning (CL) has shown promising performance in collaborative filtering. The key idea is to generate augmentation-invariant embeddings by maximizing the Mutual Information between different augmented views of the same instance.…

信息检索 · 计算机科学 2024-01-01 Huiyuan Chen , Vivian Lai , Hongye Jin , Zhimeng Jiang , Mahashweta Das , Xia Hu

Although graph neural networks (GNNs) have achieved impressive achievements in graph classification, they often need abundant task-specific labels, which could be extensively costly to acquire. A credible solution is to explore additional…

机器学习 · 计算机科学 2025-07-15 Nan Yin , Li Shen , Mengzhu Wang , Long Lan , Zeyu Ma , Chong Chen , Xian-Sheng Hua , Xiao Luo

Contrastive learning is a family of self-supervised methods where a model is trained to solve a classification task constructed from unlabeled data. It has recently emerged as one of the leading learning paradigms in the absence of labels…

机器学习 · 统计学 2021-03-05 Bingbin Liu , Pradeep Ravikumar , Andrej Risteski

Unsupervised learning has recently made exceptional progress because of the development of more effective contrastive learning methods. However, CNNs are prone to depend on low-level features that humans deem non-semantic. This dependency…

计算机视觉与模式识别 · 计算机科学 2022-01-04 Songwei Ge , Shlok Mishra , Haohan Wang , Chun-Liang Li , David Jacobs

Network representation learning (NRL) advances the conventional graph mining of social networks, knowledge graphs, and complex biomedical and physics information networks. Over dozens of network representation learning algorithms have been…

社会与信息网络 · 计算机科学 2021-10-15 Jingya Zhou , Ling Liu , Wenqi Wei , Jianxi Fan

Contrastive learning methods based on InfoNCE loss are popular in node representation learning tasks on graph-structured data. However, its reliance on data augmentation and its quadratic computational complexity might lead to inconsistency…

机器学习 · 计算机科学 2022-12-12 Hengrui Zhang , Qitian Wu , Yu Wang , Shaofeng Zhang , Junchi Yan , Philip S. Yu

The lack of labeled data is a key challenge for learning useful representation from time series data. However, an unsupervised representation framework that is capable of producing high quality representations could be of great value. It is…

Heterogeneous graph neural network (HGNN) is a very popular technique for the modeling and analysis of heterogeneous graphs. Most existing HGNN-based approaches are supervised or semi-supervised learning methods requiring graphs to be…

机器学习 · 计算机科学 2023-11-17 Cuiying Huo , Dongxiao He , Yawen Li , Di Jin , Jianwu Dang , Weixiong Zhang , Witold Pedrycz , Lingfei Wu

Mitochondria segmentation in electron microscopy images is essential in neuroscience. However, due to the image degradation during the imaging process, the large variety of mitochondrial structures, as well as the presence of noise,…

计算机视觉与模式识别 · 计算机科学 2021-09-28 Zhili Li , Xuejin Chen , Jie Zhao , Zhiwei Xiong

The rapid expansion of genomic sequence data calls for new methods to achieve robust sequence representations. Existing techniques often neglect intricate structural details, emphasizing mainly contextual information. To address this, we…

机器学习 · 计算机科学 2023-12-08 Kacper Kapuśniak , Manuel Burger , Gunnar Rätsch , Amir Joudaki

Weather data, comprising multiple variables, poses significant challenges due to its high dimensionality and multimodal nature. Creating low-dimensional embeddings requires compressing this data into a compact, shared latent space. This…

机器学习 · 计算机科学 2026-03-27 Nathan Bailey

Contrastive learning has been applied successfully to learn vector representations of text. Previous research demonstrated that learning high-quality representations benefits from batch-wise contrastive loss with a large number of…

机器学习 · 计算机科学 2021-06-16 Luyu Gao , Yunyi Zhang , Jiawei Han , Jamie Callan

Robust radio signal recognition is fundamental to spectrum management, electromagnetic space security, and intelligent wireless applications, yet existing deep-learning methods rely heavily on large labeled datasets and struggle to capture…

信号处理 · 电气工程与系统科学 2026-04-14 Shilian Zheng , Jie Chen , Luxin Zhang , Xiaoniu Yang
‹ 上一页 1 8 9 10 下一页 ›