English
Related papers

Related papers: FLSL: Feature-level Self-supervised Learning

200 papers

Camouflaged object detection has attracted a lot of attention in computer vision. The main challenge lies in the high degree of similarity between camouflaged objects and their surroundings in the spatial domain, making identification…

Computer Vision and Pattern Recognition · Computer Science 2024-09-04 Yanguang Sun , Chunyan Xu , Jian Yang , Hanyu Xuan , Lei Luo

Self-supervised learning (SSL) holds promise in leveraging large amounts of unlabeled data. However, the success of popular SSL methods has limited on single-centric-object images like those in ImageNet and ignores the correlation among the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-15 Zhaowen Li , Yousong Zhu , Fan Yang , Wei Li , Chaoyang Zhao , Yingying Chen , Zhiyang Chen , Jiahao Xie , Liwei Wu , Rui Zhao , Ming Tang , Jinqiao Wang

Classifying fine-grained lesions is challenging due to minor and subtle differences in medical images. This is because learning features of fine-grained lesions with highly minor differences is very difficult in training deep neural…

Computer Vision and Pattern Recognition · Computer Science 2023-08-14 Wongi Park , Jongbin Ryu

We propose a semi-supervised learning approach for video classification, VideoSSL, using convolutional neural networks (CNN). Like other computer vision tasks, existing supervised video classification methods demand a large amount of…

Computer Vision and Pattern Recognition · Computer Science 2020-03-03 Longlong Jing , Toufiq Parag , Zhe Wu , Yingli Tian , Hongcheng Wang

Tensor-based multi-view clustering has recently received significant attention due to its exceptional ability to explore cross-view high-order correlations. However, most existing methods still encounter some limitations. (1) Most of them…

Computer Vision and Pattern Recognition · Computer Science 2024-11-13 Deng Xu , Chao Zhang , Zechao Li , Chunlin Chen , Huaxiong Li

Self-Supervised Learning (SSL) models have been successfully applied in various deep learning-based speech tasks, particularly those with a limited amount of data. However, the quality of SSL representations depends highly on the…

Computation and Language · Computer Science 2022-04-20 Dan Berrebbi , Jiatong Shi , Brian Yan , Osbel Lopez-Francisco , Jonathan D. Amith , Shinji Watanabe

Recognizing multiple objects in an image is challenging due to occlusions, and becomes even more so when the objects are small. While promising, existing multi-label image recognition models do not explicitly learn context-based…

Computer Vision and Pattern Recognition · Computer Science 2023-10-31 Hasib Zunair , A. Ben Hamza

Recent advances in self-supervised learning (SSL) using large models to learn visual representations from natural images are rapidly closing the gap between the results produced by fully supervised learning and those produced by SSL on…

Computer Vision and Pattern Recognition · Computer Science 2022-11-03 Weiyao Wang , Byung-Hak Kim , Varun Ganapathi

A deep clustering model conceptually consists of a feature extractor that maps data points to a latent space, and a clustering head that groups data points into clusters in the latent space. Although the two components used to be trained…

Computer Vision and Pattern Recognition · Computer Science 2022-07-28 Xingzhi Zhou , Nevin L. Zhang

Federated learning (FL) facilitates a privacy-preserving neural network training paradigm through collaboration between edge clients and a central server. One significant challenge is that the distributed data is not independently and…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Yu Qiao , Huy Q. Le , Mengchun Zhang , Apurba Adhikary , Chaoning Zhang , Choong Seon Hong

The rise of Large Language Models (LLMs) has boosted the use of Few-Shot Learning (FSL) methods in natural language processing, achieving acceptable performance even when working with limited training data. The goal of FSL is to effectively…

Supervised deep learning needs a large amount of labeled data to achieve high performance. However, in medical imaging analysis, each site may only have a limited amount of data and labels, which makes learning ineffective. Federated…

Image and Video Processing · Electrical Eng. & Systems 2022-04-26 Yawen Wu , Dewen Zeng , Zhepeng Wang , Yiyu Shi , Jingtong Hu

Many self-supervised learning (SSL) methods have been successful in learning semantically meaningful visual representations by solving pretext tasks. However, prior work in SSL focuses on tasks like object recognition or detection, which…

Computer Vision and Pattern Recognition · Computer Science 2021-08-13 Donghyun Kim , Kuniaki Saito , Samarth Mishra , Stan Sclaroff , Kate Saenko , Bryan A Plummer

This work focuses on tackling the challenging but realistic visual task of Incremental Few-Shot Learning (IFSL), which requires a model to continually learn novel classes from only a few examples while not forgetting the base classes on…

Computer Vision and Pattern Recognition · Computer Science 2022-04-08 Yiting Li , Haiyue Zhu , Xijia Feng , Zilong Cheng , Jun Ma , Cheng Xiang , Prahlad Vadakkepat , Tong Heng Lee

Most recent self-supervised learning (SSL) algorithms learn features by contrasting between instances of images or by clustering the images and then contrasting between the image clusters. We introduce a simple mean-shift algorithm that…

Computer Vision and Pattern Recognition · Computer Science 2021-09-13 Soroush Abbasi Koohpayegani , Ajinkya Tejankar , Hamed Pirsiavash

Vision Transformers (ViTs) excel in 3D medical segmentation but require massive annotated datasets. While Self-Supervised Learning (SSL) mitigates this using unlabeled data, it still faces strict privacy and logistical barriers.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Jiaqi Tang , Mengyan Zheng , Shu Zhang , Fandong Zhang , Qingchao Chen

Semi-supervised medical image segmentation (SSMIS) uses consistency learning to regularize model training, which alleviates the burden of pixel-wise manual annotations. However, it often suffers from error supervision from low-quality…

Computer Vision and Pattern Recognition · Computer Science 2024-12-18 Qingtao Pan , Wenhao Qiao , Jingjiao Lou , Bing Ji , Shuo Li

Federated semi-supervised learning (FSSL) has emerged as a powerful paradigm for collaboratively training machine learning models using distributed data with label deficiency. Advanced FSSL methods predominantly focus on training a single…

Machine Learning · Computer Science 2024-02-23 Yonggang Zhang , Zhiqin Yang , Xinmei Tian , Nannan Wang , Tongliang Liu , Bo Han

Semi-Supervised Learning (SSL) is important for reducing the annotation cost for medical image segmentation models. State-of-the-art SSL methods such as Mean Teacher, FixMatch and Cross Pseudo Supervision (CPS) are mainly based on…

Computer Vision and Pattern Recognition · Computer Science 2025-09-03 Weiren Zhao , Lanfeng Zhong , Xin Liao , Wenjun Liao , Sichuan Zhang , Shaoting Zhang , Guotai Wang

Federated learning (FL) has gained significant traction as a privacy-preserving algorithm, but the underlying resemblances of federated learning algorithms like Federated averaging (FedAvg) or Federated SGD (Fed SGD) to ensemble learning…

Computer Vision and Pattern Recognition · Computer Science 2023-08-28 Vinit Hegiste , Tatjana Legler , Martin Ruskowski