English
Related papers

Related papers: Probing Negative Sampling Strategies to Learn Grap…

200 papers

Pseudo Labeling is a technique used to improve the performance of semi-supervised Graph Neural Networks (GNNs) by generating additional pseudo-labels based on confident predictions. However, the quality of generated pseudo-labels has been a…

Machine Learning · Computer Science 2023-12-20 Weigang Lu , Ziyu Guan , Wei Zhao , Yaming Yang , Yuanhai Lv , Lining Xing , Baosheng Yu , Dacheng Tao

Despite the success of contrastive learning (CL) in vision and language, its theoretical foundations and mechanisms for building representations remain poorly understood. In this work, we build connections between noise contrastive…

Machine Learning · Computer Science 2025-02-28 Zihao Chen , Chi-Heng Lin , Ran Liu , Jingyun Xiao , Eva L Dyer

Trapped by the label scarcity in molecular property prediction and drug design, graph contrastive learning (GCL) came forward. Leading contrastive learning works show two kinds of view generators, that is, random or learnable data…

Machine Learning · Computer Science 2025-01-16 Xueyuan Chen , Shangzhe Li , Ruomei Liu , Bowen Shi , Jiaheng Liu , Junran Wu , Ke Xu

Learning good representations involves capturing the diverse ways in which data samples relate. Contrastive loss - an objective matching related samples - underlies methods from self-supervised to multimodal learning. Contrastive losses,…

Computer Vision and Pattern Recognition · Computer Science 2024-09-13 Vlad Sobal , Mark Ibrahim , Randall Balestriero , Vivien Cabannes , Diane Bouchacourt , Pietro Astolfi , Kyunghyun Cho , Yann LeCun

Learning on text-attributed graphs (TAGs), in which nodes are associated with one or more texts, has been the subject of much recent work. However, most approaches tend to make strong assumptions about the downstream task of interest, are…

Computation and Language · Computer Science 2024-07-11 William Brannon , Wonjune Kang , Suyash Fulay , Hang Jiang , Brandon Roy , Deb Roy , Jad Kabbara

Self-supervised learning (especially contrastive learning) methods on heterogeneous graphs can effectively get rid of the dependence on supervisory data. Meanwhile, most existing representation learning methods embed the heterogeneous…

Machine Learning · Computer Science 2022-06-28 Shichao Zhu , Chuan Zhou , Anfeng Cheng , Shirui Pan , Shuaiqiang Wang , Dawei Yin , Bin Wang

Contrastive learning (CL) has emerged as a powerful technique for representation learning, with or without label supervision. However, supervised CL is prone to collapsing representations of subclasses within a class by not capturing all…

Machine Learning · Computer Science 2023-05-30 Yihao Xue , Siddharth Joshi , Eric Gan , Pin-Yu Chen , Baharan Mirzasoleiman

Modality representation learning is an important problem for multimodal sentiment analysis (MSA), since the highly distinguishable representations can contribute to improving the analysis effect. Previous works of MSA have usually focused…

Multimedia · Computer Science 2023-01-31 Peipei Liu , Xin Zheng , Hong Li , Jie Liu , Yimo Ren , Hongsong Zhu , Limin Sun

Contrastive learning, which aims at minimizing the distance between positive pairs while maximizing that of negative ones, has been widely and successfully applied in unsupervised feature learning, where the design of positive and negative…

Computer Vision and Pattern Recognition · Computer Science 2021-08-09 Rui Zhu , Bingchen Zhao , Jingen Liu , Zhenglong Sun , Chang Wen Chen

Obtaining annotations for 3D medical images is expensive and time-consuming, despite its importance for automating segmentation tasks. Although multi-task learning is considered an effective method for training segmentation models using…

Computer Vision and Pattern Recognition · Computer Science 2020-09-24 Junichiro Iwasawa , Yuichiro Hirano , Yohei Sugawara

For many real-world classification problems, e.g., sentiment classification, most existing machine learning methods are biased towards the majority class when the Imbalance Ratio (IR) is high. To address this problem, we propose a set…

Information Retrieval · Computer Science 2021-04-14 Yang Gao , Yi-Fan Li , Yu Lin , Charu Aggarwal , Latifur Khan

Recent advances in Graph Convolutional Neural Networks (GCNNs) have shown their efficiency for non-Euclidean data on graphs, which often require a large amount of labeled data with high cost. It it thus critical to learn graph feature…

Computer Vision and Pattern Recognition · Computer Science 2020-03-20 Xiang Gao , Wei Hu , Guo-Jun Qi

Self-supervised learning (especially contrastive learning) has attracted great interest due to its huge potential in learning discriminative representations in an unsupervised manner. Despite the acknowledged successes, existing contrastive…

Computer Vision and Pattern Recognition · Computer Science 2021-10-22 Guangrun Wang , Keze Wang , Guangcong Wang , Philip H. S. Torr , Liang Lin

Graph Contrastive Learning (GCL) has recently emerged as a promising graph self-supervised learning framework for learning discriminative node representations without labels. The widely adopted objective function of GCL benefits from two…

Machine Learning · Computer Science 2024-11-05 Yunhui Liu , Tieke He , Tao Zheng , Jianhua Zhao

We consider the problem of learning a graph from a finite set of noisy graph signal observations, the goal of which is to find a smooth representation of the graph signal. Such a problem is motivated by the desire to infer relational…

Machine Learning · Computer Science 2023-02-08 Xiaolu Wang , Yuen-Man Pun , Anthony Man-Cho So

In the past few years, we have witnessed remarkable breakthroughs in self-supervised representation learning. Despite the success and adoption of representations learned through this paradigm, much is yet to be understood about how…

Computer Vision and Pattern Recognition · Computer Science 2021-08-20 Klemen Kotar , Gabriel Ilharco , Ludwig Schmidt , Kiana Ehsani , Roozbeh Mottaghi

Graph contrastive learning (GCL) has recently emerged as a promising approach for graph representation learning. Some existing methods adopt the 1-vs-K scheme to construct one positive and K negative samples for each graph, but it is…

Machine Learning · Computer Science 2023-09-06 Minjie Chen , Yao Cheng , Ye Wang , Xiang Li , Ming Gao

Detecting Out-of-Domain (OOD) or unknown intents from user queries is essential in a task-oriented dialog system. A key challenge of OOD detection is to learn discriminative semantic features. Traditional cross-entropy loss only focuses on…

Computation and Language · Computer Science 2021-06-01 Zhiyuan Zeng , Keqing He , Yuanmeng Yan , Zijun Liu , Yanan Wu , Hong Xu , Huixing Jiang , Weiran Xu

Existing scene text recognition (STR) methods struggle to recognize challenging texts, especially for artistic and severely distorted characters. The limitation lies in the insufficient exploration of character morphologies, including the…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Yadong Qu , Yuxin Wang , Bangbang Zhou , Zixiao Wang , Hongtao Xie , Yongdong Zhang

A graph-based classification method is proposed for semi-supervised learning in the case of Euclidean data and for classification in the case of graph data. Our manifold learning technique is based on a convex optimization problem involving…

Machine Learning · Computer Science 2019-01-29 Carlos M. Alaíz , Michaël Fanuel , Johan A. K. Suykens
‹ Prev 1 8 9 10 Next ›