English
Related papers

Related papers: FLSL: Feature-level Self-supervised Learning

200 papers

Successive Subspace Learning (SSL) offers a light-weight unsupervised feature learning method based on inherent statistical properties of data units (e.g. image pixels and points in point cloud sets). It has shown promising results,…

Computer Vision and Pattern Recognition · Computer Science 2021-03-02 Mozhdeh Rouhsedaghat , Masoud Monajatipoor , Zohreh Azizi , C. -C. Jay Kuo

With the increasing computing power of edge devices, Federated Learning (FL) emerges to enable model training without privacy concerns. The majority of existing studies assume the data are fully labeled on the client side. In practice,…

Machine Learning · Computer Science 2022-05-31 Woojung Kim , Keondo Park , Kihyuk Sohn , Raphael Shu , Hyung-Sin Kim

Federated Split Learning (FSL) is a promising distributed learning paradigm in practice, which gathers the strengths of both Federated Learning (FL) and Split Learning (SL) paradigms, to ensure model privacy while diminishing the resource…

Computer Vision and Pattern Recognition · Computer Science 2024-04-22 Yifan Shi , Yuhui Zhang , Ziyue Huang , Xiaofeng Yang , Li Shen , Wei Chen , Xueqian Wang

Visual Object Tracking (VOT) can be seen as an extended task of Few-Shot Learning (FSL). While the concept of FSL is not new in tracking and has been previously applied by prior works, most of them are tailored to fit specific types of FSL…

Computer Vision and Pattern Recognition · Computer Science 2021-03-19 Jinghao Zhou , Bo Li , Peng Wang , Peixia Li , Weihao Gan , Wei Wu , Junjie Yan , Wanli Ouyang

Self-Supervised Learning (SSL) is a valuable and robust training methodology for contemporary Deep Neural Networks (DNNs), enabling unsupervised pretraining on a 'pretext task' that does not require ground-truth labels/annotation. This…

Computer Vision and Pattern Recognition · Computer Science 2024-12-30 Sotirios Konstantakos , Jorgen Cani , Ioannis Mademlis , Despina Ioanna Chalkiadaki , Yuki M. Asano , Efstratios Gavves , Georgios Th. Papadopoulos

Self-supervised learning (SSL) methods such as masked language modeling have shown massive performance gains by pretraining transformer models for a variety of natural language processing tasks. The follow-up research adapted similar…

Computer Vision and Pattern Recognition · Computer Science 2022-05-12 Gokul Karthik Kumar , Sahal Shaji Mullappilly , Abhishek Singh Gehlot

Semi-supervised learning (SSL) has been extensively studied to improve the generalization ability of deep neural networks for visual recognition. To involve the unlabelled data, most existing SSL methods are based on common density-based…

Computer Vision and Pattern Recognition · Computer Science 2020-03-31 Suichan Li , Bin Liu , Dongdong Chen , Qi Chu , Lu Yuan , Nenghai Yu

Federated Learning (FL) is currently the most widely adopted framework for collaborative training of (deep) machine learning models under privacy constraints. Albeit it's popularity, it has been observed that Federated Learning yields…

Machine Learning · Computer Science 2019-10-07 Felix Sattler , Klaus-Robert Müller , Wojciech Samek

Graph representation learning has emerged as a cornerstone for tasks like node classification and link prediction, yet prevailing self-supervised learning (SSL) methods face challenges such as computational inefficiency, reliance on…

Machine Learning · Computer Science 2025-09-04 Srinitish Srinivasan , Omkumar CU

Semi-supervised learning (SSL) is a promising machine learning paradigm to address the issue of label scarcity in medical imaging. SSL methods were originally developed in image classification. The state-of-the-art SSL methods in image…

Computer Vision and Pattern Recognition · Computer Science 2023-05-03 Mou-Cheng Xu , Yukun Zhou , Chen Jin , Marius De Groot , Neil P. Oxtoby , Daniel C. Alexander , Joseph Jacob

Unsupervised semantic segmentation aims to categorize each pixel in an image into a corresponding class without the use of annotated data. It is a widely researched area as obtaining labeled datasets is expensive. While previous works in…

Computer Vision and Pattern Recognition · Computer Science 2024-01-01 Yau Shing Jonathan Cheung , Xi Chen , Lihe Yang , Hengshuang Zhao

Deep supervised learning algorithms typically require a large volume of labeled data to achieve satisfactory performance. However, the process of collecting and labeling such data can be expensive and time-consuming. Self-supervised…

Machine Learning · Computer Science 2024-07-16 Jie Gui , Tuo Chen , Jing Zhang , Qiong Cao , Zhenan Sun , Hao Luo , Dacheng Tao

Existing domain adaptation (DA) and generalization (DG) methods in object detection enforce feature alignment in the visual space but face challenges like object appearance variability and scene complexity, which make it difficult to…

Computer Vision and Pattern Recognition · Computer Science 2023-09-26 Sina Malakouti , Adriana Kovashka

We present Variational Self-Supervised Learning (VSSL), a novel framework that combines variational inference with self-supervised learning to enable efficient, decoder-free representation learning. Unlike traditional VAEs that rely on…

Machine Learning · Computer Science 2025-05-02 Mehmet Can Yavuz , Berrin Yanikoglu

Federated Semi-supervised Learning (FSSL) combines techniques from both fields of federated and semi-supervised learning to improve the accuracy and performance of models in a distributed environment by using a small fraction of labeled…

Machine Learning · Computer Science 2023-11-27 Zehui Dong , Wenjing Liu , Siyuan Liu , Xingzhi Chen

Meta-learning offers a promising avenue for few-shot learning (FSL), enabling models to glean a generalizable feature embedding through episodic training on synthetic FSL tasks in a source domain. Yet, in practical scenarios where the…

Computer Vision and Pattern Recognition · Computer Science 2024-11-05 Fei Zhou , Peng Wang , Lei Zhang , Zhenghua Chen , Wei Wei , Chen Ding , Guosheng Lin , Yanning Zhang

This work aims at improving instance retrieval with self-supervision. We find that fine-tuning using the recently developed self-supervised (SSL) learning methods, such as SimCLR and MoCo, fails to improve the performance of instance…

Computer Vision and Pattern Recognition · Computer Science 2021-12-03 Zelu Deng , Yujie Zhong , Sheng Guo , Weilin Huang

Semi-supervised few-shot learning (SSFSL) formulates real-world applications like ''auto-annotation'', as it aims to learn a model over a few labeled and abundant unlabeled examples to annotate the unlabeled ones. Despite the availability…

Computer Vision and Pattern Recognition · Computer Science 2025-12-12 Tian Liu , Anwesha Basu , James Caverlee , Shu Kong

Multi-view clustering is a learning paradigm based on multi-view data. Since statistic properties of different views are diverse, even incompatible, few approaches implement multi-view clustering based on the concatenated features…

Machine Learning · Computer Science 2021-03-25 Qinghai Zheng , Jihua Zhu , Zhongyu Li , Shanmin Pang , Jun Wang , Yaochen Li

The growing popularity of robotic minimally invasive surgeries has made deep learning-based surgical training a key area of research. A thorough understanding of the surgical scene components is crucial, which semantic segmentation models…

Image and Video Processing · Electrical Eng. & Systems 2025-10-31 Muraam Abdel-Ghani , Mahmoud Ali , Mohamed Ali , Fatmaelzahraa Ahmed , Muhammad Arsalan , Abdulaziz Al-Ali , Shidin Balakrishnan