中文
相关论文

相关论文: Feature-Suppressed Contrast for Self-Supervised Fo…

200 篇论文

Pretext Invariant Representation Learning (PIRL) followed by Supervised Fine-Tuning (SFT) has become a standard paradigm for learning with limited labels. We extend this approach to the Positive Unlabeled (PU) setting, where only a small…

Federated semi-supervised learning (FSSL) has emerged as a powerful paradigm for collaboratively training machine learning models using distributed data with label deficiency. Advanced FSSL methods predominantly focus on training a single…

机器学习 · 计算机科学 2024-02-23 Yonggang Zhang , Zhiqin Yang , Xinmei Tian , Nannan Wang , Tongliang Liu , Bo Han

We propose a Deep learning-based weak label learning method for analyzing whole slide images (WSIs) of Hematoxylin and Eosin (H&E) stained tumor tissue not requiring pixel-level or tile-level annotations using Self-supervised pre-training…

图像与视频处理 · 电气工程与系统科学 2023-06-29 Yoni Schirris , Efstratios Gavves , Iris Nederlof , Hugo Mark Horlings , Jonas Teuwen

In recent years, self-supervised learning has had significant success in applications involving computer vision and natural language processing. The type of pretext task is important to this boost in performance. One common pretext task is…

计算机视觉与模式识别 · 计算机科学 2022-01-24 Ademola Okerinde , Sam Hoggatt , Divya Vani Lakkireddy , Nolan Brubaker , William Hsu , Lior Shamir , Brian Spiesman

Recent work has shown that, when integrated with adversarial training, self-supervised pre-training can lead to state-of-the-art robustness In this work, we improve robustness-aware self-supervised pre-training by learning representations…

计算机视觉与模式识别 · 计算机科学 2020-10-27 Ziyu Jiang , Tianlong Chen , Ting Chen , Zhangyang Wang

Contrastive representation learning has proven to be an effective self-supervised learning method for images and videos. Most successful approaches are based on Noise Contrastive Estimation (NCE) and use different views of an instance as…

计算机视觉与模式识别 · 计算机科学 2023-09-27 Julien Denize , Jaonary Rabarisoa , Astrid Orcesi , Romain Hérault

Semi-supervised Learning (SSL) reduces the need for extensive annotations in deep learning, but the more realistic challenge of imbalanced data distribution in SSL remains largely unexplored. In Class Imbalanced Semi-supervised Learning…

计算机视觉与模式识别 · 计算机科学 2024-07-15 Qianhan Feng , Lujing Xie , Shijie Fang , Tong Lin

Rapid progress in 3D semantic segmentation is inseparable from the advances of deep network models, which highly rely on large-scale annotated data for training. To address the high cost and challenges of 3D point-level labeling, we present…

计算机视觉与模式识别 · 计算机科学 2021-10-18 Li Jiang , Shaoshuai Shi , Zhuotao Tian , Xin Lai , Shu Liu , Chi-Wing Fu , Jiaya Jia

Contrastive learning is a promising approach to unsupervised learning, as it inherits the advantages of well-studied deep models without a dedicated and complex model design. In this paper, based on bidirectional encoder representations…

计算与语言 · 计算机科学 2021-09-20 Haoxiang Shi , Cen Wang

We propose a self-supervised method to learn feature representations from videos. A standard approach in traditional self-supervised methods uses positive-negative data pairs to train with contrastive learning strategy. In such a case,…

计算机视觉与模式识别 · 计算机科学 2020-08-13 Li Tao , Xueting Wang , Toshihiko Yamasaki

An effective framework for learning 3D representations for perception tasks is distilling rich self-supervised image features via contrastive learning. However, image-to point representation learning for autonomous driving datasets faces…

计算机视觉与模式识别 · 计算机科学 2023-03-27 Anas Mahmoud , Jordan S. K. Hu , Tianshu Kuai , Ali Harakeh , Liam Paull , Steven L. Waslander

Deep learning-based recommender systems have achieved remarkable success in recent years. However, these methods usually heavily rely on labeled data (i.e., user-item interactions), suffering from problems such as data sparsity and…

信息检索 · 计算机科学 2023-10-12 Mengyuan Jing , Yanmin Zhu , Tianzi Zang , Ke Wang

Existing few-shot learning (FSL) methods rely on training with a large labeled dataset, which prevents them from leveraging abundant unlabeled data. From an information-theoretic perspective, we propose an effective unsupervised FSL method,…

计算机视觉与模式识别 · 计算机科学 2022-07-20 Yuning Lu , Liangjian Wen , Jianzhuang Liu , Yajing Liu , Xinmei Tian

As one of the most effective self-supervised representation learning methods, contrastive learning (CL) relies on multiple negative pairs to contrast against each positive pair. In the standard practice of contrastive learning, data…

机器学习 · 计算机科学 2024-01-18 Lu Wang , Chao Du , Pu Zhao , Chuan Luo , Zhangchi Zhu , Bo Qiao , Wei Zhang , Qingwei Lin , Saravan Rajmohan , Dongmei Zhang , Qi Zhang

Contrastive self-supervised learning has outperformed supervised pretraining on many downstream tasks like segmentation and object detection. However, current methods are still primarily applied to curated datasets like ImageNet. In this…

计算机视觉与模式识别 · 计算机科学 2021-12-15 Wouter Van Gansbeke , Simon Vandenhende , Stamatios Georgoulis , Luc Van Gool

Many leading self-supervised methods for unsupervised representation learning, in particular those for embedding image features, are built on variants of the instance discrimination task, whose optimization is known to be prone to…

计算机视觉与模式识别 · 计算机科学 2024-08-06 Daniel Shalam , Simon Korman

Contrastive learning (CL) approaches have gained great recognition as a very successful subset of self-supervised learning (SSL) methods. SSL enables learning from unlabeled data, a crucial step in the advancement of deep learning,…

计算机视觉与模式识别 · 计算机科学 2025-04-29 Mohamed Hassan , Mohammad Wasil , Sebastian Houben

Recently contrastive learning has shown significant progress in learning visual representations from unlabeled data. The core idea is training the backbone to be invariant to different augmentations of an instance. While most methods only…

计算机视觉与模式识别 · 计算机科学 2021-11-05 Xiaoyang Guo , Tianhao Zhao , Yutian Lin , Bo Du

Few-shot object detection (FSOD) aims to classify and detect few images of novel categories. Existing meta-learning methods insufficiently exploit features between support and query images owing to structural limitations. We propose a…

计算机视觉与模式识别 · 计算机科学 2022-12-15 Dongwoo Park , Jong-Min Lee

Self-supervised learning is emerging in fine-grained visual recognition with promising results. However, existing self-supervised learning methods are often susceptible to irrelevant patterns in self-supervised tasks and lack the capability…

计算机视觉与模式识别 · 计算机科学 2024-12-03 ShuaiHeng Li , Qing Cai , Fan Zhang , Menghuan Zhang , Yangyang Shu , Zhi Liu , Huafeng Li , Lingqiao Liu