English
Related papers

Related papers: False: False Negative Samples Aware Contrastive Le…

200 papers

As an important graph pre-training method, Graph Contrastive Learning (GCL) continues to play a crucial role in the ongoing surge of research on graph foundation models or LLM as enhancer for graphs. Traditional GCL optimizes InfoNCE by…

Machine Learning · Computer Science 2025-05-13 Zixu Wang , Bingbing Xu , Yige Yuan , Huawei Shen , Xueqi Cheng

Self-supervised learning (SSL) has emerged as a powerful strategy for representation learning under limited annotation regimes, yet its effectiveness remains highly sensitive to many factors, especially the nature of the target task. In…

Computer Vision and Pattern Recognition · Computer Science 2026-01-27 Jorge Quesada , Ghassan AlRegib

Graph contrastive learning (GCL) has been widely applied to text classification tasks due to its ability to generate self-supervised signals from unlabeled data, thus facilitating model training. However, existing GCL-based text…

Machine Learning · Computer Science 2024-10-25 Wei Ai , Jianbin Li , Ze Wang , Jiayi Du , Tao Meng , Yuntao Shou , Keqin Li

Self-supervised methods (SSL) have achieved significant success via maximizing the mutual information between two augmented views, where cropping is a popular augmentation technique. Cropped regions are widely used to construct positive…

Computer Vision and Pattern Recognition · Computer Science 2022-11-11 Yufei Xu , Qiming Zhang , Jing Zhang , Dacheng Tao

Although there is significant progress in supervised semantic segmentation, it remains challenging to deploy the segmentation models to unseen domains due to domain biases. Domain adaptation can help in this regard by transferring knowledge…

Computer Vision and Pattern Recognition · Computer Science 2022-05-03 Binhui Xie , Mingjia Li , Shuang Li

Collecting a large number of reliable training images annotated by multiple land-cover class labels in the framework of multi-label classification is time-consuming and costly in remote sensing (RS). To address this problem, publicly…

Computer Vision and Pattern Recognition · Computer Science 2022-11-15 Ahmet Kerem Aksoy , Mahdyar Ravanbakhsh , Tristan Kreuziger , Begum Demir

Supervised deep learning needs a large amount of labeled data to achieve high performance. However, in medical imaging analysis, each site may only have a limited amount of data and labels, which makes learning ineffective. Federated…

Image and Video Processing · Electrical Eng. & Systems 2022-08-09 Yawen Wu , Dewen Zeng , Zhepeng Wang , Yiyu Shi , Jingtong Hu

Generative AI models exhibit remarkable potential; however, hallucinations across various tasks present a significant challenge, particularly for longer inputs that current approaches struggle to address effectively. We introduce SCALE…

Computation and Language · Computer Science 2024-09-20 Barrett Martin Lattimer , Patrick Chen , Xinyuan Zhang , Yi Yang

Clustering of hyperspectral images is a fundamental but challenging task. The recent development of hyperspectral image clustering has evolved from shallow models to deep and achieved promising results in many benchmark datasets. However,…

Computer Vision and Pattern Recognition · Computer Science 2021-11-16 Yaoming Cai , Zijia Zhang , Yan Liu , Pedram Ghamisi , Kun Li , Xiaobo Liu , Zhihua Cai

Pixel-aligned implicit models, such as PIFu, PIFuHD, and ICON, are used for single-view clothed human reconstruction. These models need to be trained using a sampling training scheme. Existing sampling training schemes either fail to…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Kennard Yanting Chan , Fayao Liu , Guosheng Lin , Chuan Sheng Foo , Weisi Lin

Benchmarking the hundreds of functional connectivity (FC) modeling methods on large-scale fMRI datasets is critical for reproducible neuroscience. However, the combinatorial explosion of model-data pairings makes exhaustive evaluation…

Machine Learning · Computer Science 2026-02-06 Ling Zhan , Zhen Li , Junjie Huang , Tao Jia

State-of-the-art pre-trained image models predominantly adopt a two-stage approach: initial unsupervised pre-training on large-scale datasets followed by task-specific fine-tuning using Cross-Entropy loss~(CE). However, it has been…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Zijun Long , George Killick , Lipeng Zhuang , Gerardo Aragon-Camarasa , Zaiqiao Meng , Richard Mccreadie

Recent studies on semantic communication commonly rely on neural network (NN) based transceivers such as deep joint source and channel coding (DeepJSCC). Unlike traditional transceivers, these neural transceivers are trainable using actual…

Machine Learning · Computer Science 2023-10-17 Jinhyuk Choi , Jihong Park , Seung-Woo Ko , Jinho Choi , Mehdi Bennis , Seong-Lyun Kim

The compressive sensing (CS) scheme exploits much fewer measurements than suggested by the Nyquist-Shannon sampling theorem to accurately reconstruct images, which has attracted considerable attention in the computational imaging community.…

Image and Video Processing · Electrical Eng. & Systems 2022-10-26 Zhiyuan Zha , Bihan Wen , Xin Yuan , Saiprasad Ravishankar , Jiantao Zhou , Ce Zhu

We explore the value of weak labels in learning transferable representations for medical images. Compared to hand-labeled datasets, weak or inexact labels can be acquired in large quantities at significantly lower cost and can provide…

Computer Vision and Pattern Recognition · Computer Science 2021-08-05 Boon Peng Yap , Beng Koon Ng

Traditional Graph Neural Network (GNN), as a graph representation learning method, is constrained by label information. However, Graph Contrastive Learning (GCL) methods, which tackle the label problem effectively, mainly focus on the…

Machine Learning · Computer Science 2023-08-08 Kai Yang , Yuan Liu , Zijuan Zhao , Peijin Ding , Wenqian Zhao

Self-supervised contrastive learning (CL) has achieved remarkable empirical success, often producing representations that rival supervised pre-training on downstream tasks. Recent theory explains this by showing that the CL loss closely…

Machine Learning · Computer Science 2025-10-13 Achleshwar Luthra , Priyadarsi Mishra , Tomer Galanti

The similarity among samples and the discrepancy between clusters are two crucial aspects of image clustering. However, current deep clustering methods suffer from the inaccurate estimation of either feature similarity or semantic…

Computer Vision and Pattern Recognition · Computer Science 2022-11-23 Chuang Niu , Hongming Shan , Ge Wang

Deep Neural Network (DNN) based point cloud semantic segmentation has presented significant achievements on large-scale labeled aerial laser point cloud datasets. However, annotating such large-scaled point clouds is time-consuming. Due to…

Computer Vision and Pattern Recognition · Computer Science 2022-10-20 Yunsheng Zhang , Jianguo Yao , Ruixiang Zhang , Siyang Chen , Haifeng Li

Self-supervised learning algorithms based on instance discrimination train encoders to be invariant to pre-defined transformations of the same instance. While most methods treat different views of the same image as positives for a…

Computer Vision and Pattern Recognition · Computer Science 2021-10-08 Debidatta Dwibedi , Yusuf Aytar , Jonathan Tompson , Pierre Sermanet , Andrew Zisserman