English
Related papers

Related papers: Virtual embeddings and self-consistency for self-s…

200 papers

Semi-supervised learning (SSL) has played an important role in leveraging unlabeled data when labeled data is limited. One of the most successful SSL approaches is based on consistency regularization, which encourages the model to produce…

Computer Vision and Pattern Recognition · Computer Science 2021-10-12 Trung Q. Tran , Mingu Kang , Daeyoung Kim

Data augmentation is a central component of joint embedding self-supervised learning (SSL). Approaches that work for natural images may not always be effective in medical imaging tasks. This study systematically investigated the impact of…

Image and Video Processing · Electrical Eng. & Systems 2025-06-12 Blake VanBerlo , Alexander Wong , Jesse Hoey , Robert Arntfield

Automated medical diagnosis through image-based neural networks has increased in popularity and matured over years. Nevertheless, it is confined by the scarcity of medical images and the expensive labor annotation costs. Self-Supervised…

Computer Vision and Pattern Recognition · Computer Science 2024-04-17 Luffina C. Huang , Darren J. Chiu , Manish Mehta

Self-supervised learning (SSL) has emerged as a crucial technique in image processing, encoding, and understanding, especially for developing today's vision foundation models that utilize large-scale datasets without annotations to enhance…

Computer Vision and Pattern Recognition · Computer Science 2025-01-08 Chuang Niu , Wenjun Xia , Hongming Shan , Ge Wang

Self Supervised learning (SSL) has demonstrated its effectiveness in feature learning from unlabeled data. Regarding this success, there have been some arguments on the role that mutual information plays within the SSL framework. Some works…

Computer Vision and Pattern Recognition · Computer Science 2024-12-04 Salman Mohamadi , Gianfranco Doretto , Donald A. Adjeroh

Some of the threats in the dynamic environment include the unpredictability of the motion of objects and interferences to the robotic grasp. In such conditions the traditional supervised and reinforcement learning approaches are ill suited…

Robotics · Computer Science 2024-10-18 Ankit Shaw

Supervised learning demands large amounts of precisely annotated data to achieve promising results. Such data curation is labor-intensive and imposes significant overhead regarding time and costs. Self-supervised learning (SSL) partially…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Thangarajah Akilan , Nusrat Jahan , Wandong Zhang

Deep learning-based semi-supervised learning (SSL) algorithms have led to promising results in medical images segmentation and can alleviate doctors' expensive annotations by leveraging unlabeled data. However, most of the existing SSL…

Computer Vision and Pattern Recognition · Computer Science 2023-05-09 Xiangde Luo , Jieneng Chen , Tao Song , Yinan Chen , Guotai Wang , Shaoting Zhang

Semi-Supervised Learning (SSL) has been proved to be an effective way to leverage both labeled and unlabeled data at the same time. Recent semi-supervised approaches focus on deep neural networks and have achieved promising results on…

Computer Vision and Pattern Recognition · Computer Science 2018-12-14 Hong-Yu Zhou , Avital Oliver , Jianxin Wu , Yefeng Zheng

Self-supervised learning (SSL) is a growing torrent that has recently transformed machine learning and its many real world applications, by learning on massive amounts of unlabeled data via self-generated supervisory signals. Unsupervised…

Machine Learning · Computer Science 2023-08-29 Leman Akoglu , Jaemin Yoo

Self-supervised learning (SSL) methods aim to exploit the abundance of unlabelled data for machine learning (ML), however the underlying principles are often method-specific. An SSL framework derived from biological first principles of…

Machine Learning · Computer Science 2023-08-03 Franz Scherr , Qinghai Guo , Timoleon Moraitis

Semi-Supervised Learning (SSL) and Unsupervised Domain Adaptation (UDA) enhance the model performance by exploiting information from labeled and unlabeled data. The clustering assumption has proven advantageous for learning with limited…

Computer Vision and Pattern Recognition · Computer Science 2025-07-21 Durgesh Singh , Ahcène Boubekki , Robert Jenssen , Michael Kampffmeyer

We present Self-Organizing Visual Prototypes (SOP), a new training technique for unsupervised visual feature learning. Unlike existing prototypical self-supervised learning (SSL) methods that rely on a single prototype to encode all…

Computer Vision and Pattern Recognition · Computer Science 2025-05-29 Thalles Silva , Helio Pedrini , Adín Ramírez Rivera

Few-shot image classification aims to classify unseen classes with limited labelled samples. Recent works benefit from the meta-learning process with episodic tasks and can fast adapt to class from training to testing. Due to the limited…

Computer Vision and Pattern Recognition · Computer Science 2021-02-24 Da Chen , Yuefeng Chen , Yuhong Li , Feng Mao , Yuan He , Hui Xue

Self-supervised learning (SSL) has had great success in both computer vision. Most of the current mainstream computer vision SSL frameworks are based on Siamese network architecture. These approaches often rely on cleverly crafted loss…

Machine Learning · Computer Science 2024-01-30 Daesoo Lee , Erlend Aune

We propose a novel paradigm of semi-supervised learning (SSL)--the semi-supervised multiple representation behavior learning (SSMRBL). SSMRBL aims to tackle the difficulty of learning a grammar for natural language parsing where the data…

Computation and Language · Computer Science 2019-10-22 Ruqian Lu , Shengluan Hou

Self-supervision has shown outstanding results for natural language processing, and more recently, for image recognition. Simultaneously, vision transformers and its variants have emerged as a promising and scalable alternative to…

Computer Vision and Pattern Recognition · Computer Science 2022-02-01 Prarthana Bhattacharyya , Chenge Li , Xiaonan Zhao , István Fehérvári , Jason Sun

Semi-supervised learning (SSL) has emerged as a promising paradigm for breast ultrasound (BUS) image segmentation, but it often suffers from unstable pseudo labels under extremely limited annotations, leading to inaccurate supervision and…

Computer Vision and Pattern Recognition · Computer Science 2026-03-09 Ruili Li , Jiayi Ding , Ruiyu Li , Yilun Jin , Shiwen Ge , Yuwen Zeng , Xiaoyong Zhang , Eichi Takaya , Jan Vrba , Noriyasu Homma

Supervised contrastive learning (SupCL) has emerged as a prominent approach in representation learning, leveraging both supervised and self-supervised losses. However, achieving an optimal balance between these losses is challenging;…

Machine Learning · Computer Science 2025-03-12 Chungpa Lee , Jeongheon Oh , Kibok Lee , Jy-yong Sohn

Self-supervised learned models have been found to be very effective for certain speech tasks such as automatic speech recognition, speaker identification, keyword spotting and others. While the features are undeniably useful in speech…

Audio and Speech Processing · Electrical Eng. & Systems 2024-03-05 Ravi Shankar , Ke Tan , Buye Xu , Anurag Kumar