中文
相关论文

相关论文: How Self-Supervised Learning Can be Used for Fine-…

200 篇论文

Remote sensing data has been widely used for various Earth Observation (EO) missions such as land use and cover classification, weather forecasting, agricultural management, and environmental monitoring. Most existing remote sensing…

计算机视觉与模式识别 · 计算机科学 2023-11-14 Xin Zhang , Liangxiu Han

Self-supervised learning (SSL), in particular contrastive learning, has made great progress in recent years. However, a common theme in these methods is that they inherit the learning paradigm from the supervised deep learning scenario.…

计算机视觉与模式识别 · 计算机科学 2021-03-26 Yun-Hao Cao , Jianxin Wu

Self-Supervised Learning (SSL) has gained traction for its ability to learn rich representations with low labeling costs, applicable across diverse downstream tasks. However, assessing the downstream-task performance remains challenging due…

声音 · 计算机科学 2025-10-07 Takashi Maekaku , Keita Goto , Jinchuan Tian , Yusuke Shinohara , Shinji Watanabe

We introduce S$^2$VS, a video similarity learning approach with self-supervision. Self-Supervised Learning (SSL) is typically used to train deep models on a proxy task so as to have strong transferability on target tasks after fine-tuning.…

计算机视觉与模式识别 · 计算机科学 2023-06-19 Giorgos Kordopatis-Zilos , Giorgos Tolias , Christos Tzelepis , Ioannis Kompatsiaris , Ioannis Patras , Symeon Papadopoulos

Human head pose estimation is an essential problem in facial analysis in recent years that has a lot of computer vision applications such as gaze estimation, virtual reality, and driver assistance. Because of the importance of the head pose…

计算机视觉与模式识别 · 计算机科学 2022-10-26 Chien Thai , Viet Tran , Minh Bui , Huong Ninh , Hai Tran

Self-supervised learning (SSL) has become the de facto training paradigm of large models where pre-training is followed by supervised fine-tuning using domain-specific data and labels. Hypothesizing that SSL models would learn more generic,…

In recent years, semi-supervised learning (SSL) has gained significant attention due to its ability to leverage both labeled and unlabeled data to improve model performance, especially when labeled data is scarce. However, most current SSL…

机器学习 · 计算机科学 2024-05-06 Marzi Heidari , Hanping Zhang , Yuhong Guo

Pseudo-labeling is a crucial technique in semi-supervised learning (SSL), where artificial labels are generated for unlabeled data by a trained model, allowing for the simultaneous training of labeled and unlabeled data in a supervised…

计算机视觉与模式识别 · 计算机科学 2023-08-16 Khanh-Binh Nguyen , Joon-Sung Yang

Computational pathology can lead to saving human lives, but models are annotation hungry and pathology images are notoriously expensive to annotate. Self-supervised learning has shown to be an effective method for utilizing unlabeled data,…

计算机视觉与模式识别 · 计算机科学 2023-04-19 Mingu Kang , Heon Song , Seonwook Park , Donggeun Yoo , Sérgio Pereira

With the development of deep learning, supervised learning methods perform well in remote sensing images (RSIs) scene classification. However, supervised learning requires a huge number of annotated data for training. When labeled samples…

计算机视觉与模式识别 · 计算机科学 2020-10-05 Chao Tao , Ji Qi , Weipeng Lu , Hao Wang , Haifeng Li

Accurate anomaly detection is critical in vision-based infrastructure inspection, where it helps prevent costly failures and enhances safety. Self-Supervised Learning (SSL) offers a promising approach by learning robust representations from…

计算机视觉与模式识别 · 计算机科学 2024-10-08 Daniel Otero , Rafael Mateus , Randall Balestriero

Self-supervised learning (SSL) has emerged as a powerful strategy for representation learning under limited annotation regimes, yet its effectiveness remains highly sensitive to many factors, especially the nature of the target task. In…

计算机视觉与模式识别 · 计算机科学 2026-01-27 Jorge Quesada , Ghassan AlRegib

We investigate whether self-supervised learning (SSL) can improve online reinforcement learning (RL) from pixels. We extend the contrastive reinforcement learning framework (e.g., CURL) that jointly optimizes SSL and RL losses and conduct…

机器学习 · 计算机科学 2023-01-18 Xiang Li , Jinghuan Shang , Srijan Das , Michael S. Ryoo

Semi-supervised learning has been well developed to help reduce the cost of manual labelling by exploiting a large quantity of unlabelled data. Especially in the application of land cover classification, pixel-level manual labelling in…

计算机视觉与模式识别 · 计算机科学 2023-06-01 Wanli Ma , Oktay Karakus , Paul L. Rosin

Semi-supervised learning (SSL) has attracted enormous attention due to its vast potential of mitigating the dependence on large labeled datasets. The latest methods (e.g., FixMatch) use a combination of consistency regularization and…

计算机视觉与模式识别 · 计算机科学 2023-03-21 Yuhao Chen , Xin Tan , Borui Zhao , Zhaowei Chen , Renjie Song , Jiajun Liang , Xuequan Lu

Integrating Federated Learning (FL) with self-supervised learning (SSL) enables privacy-preserving fine-tuning for speech tasks. However, federated environments exhibit significant heterogeneity: clients differ in computational capacity,…

音频与语音处理 · 电气工程与系统科学 2026-03-26 Xin Guo , Chunrui Zhao , Hong Jia , Ting Dang , Gongping Huang , Xianrui Zheng , Yan Gao

Although supervised learning has been highly successful in improving the state-of-the-art in the domain of image-based computer vision in the past, the margin of improvement has diminished significantly in recent years, indicating that a…

计算机视觉与模式识别 · 计算机科学 2023-05-24 Utku Ozbulak , Hyun Jung Lee , Beril Boga , Esla Timothy Anzaku , Homin Park , Arnout Van Messem , Wesley De Neve , Joris Vankerschaver

Few-shot image classification aims to classify unseen classes with limited labelled samples. Recent works benefit from the meta-learning process with episodic tasks and can fast adapt to class from training to testing. Due to the limited…

计算机视觉与模式识别 · 计算机科学 2021-02-24 Da Chen , Yuefeng Chen , Yuhong Li , Feng Mao , Yuan He , Hui Xue

Semi-supervised learning (SSL) has proven to be effective at leveraging large-scale unlabeled data to mitigate the dependency on labeled data in order to learn better models for visual recognition and classification tasks. However, recent…

计算机视觉与模式识别 · 计算机科学 2021-08-20 Hasib Zunair , Yan Gobeil , Samuel Mercier , A. Ben Hamza

Self-supervised learning (SSL) plays a central role in molecular representation learning. Yet, many recent innovations in masking-based pretraining are introduced as heuristics and lack principled evaluation, obscuring which design choices…

机器学习 · 计算机科学 2025-12-09 Jiannan Yang , Veronika Thost , Tengfei Ma