English
Related papers

Related papers: Morph-SSL: Self-Supervision with Longitudinal Morp…

200 papers

Self-supervised learning (SSL) models have achieved considerable improvements in automatic speech recognition (ASR). In addition, ASR performance could be further improved if the model is dedicated to audio content information learning…

Audio and Speech Processing · Electrical Eng. & Systems 2022-12-08 Genshun Wan , Tan Liu , Hang Chen , Jia Pan , Cong Liu , Zhongfu Ye

Nowadays, supervised deep learning techniques yield the best state-of-the-art prediction performances for a wide variety of computer vision tasks. However, such supervised techniques generally require a large amount of manually labeled…

Computer Vision and Pattern Recognition · Computer Science 2020-06-09 Florent Chiaroni , Mohamed-Cherif Rahal , Nicolas Hueber , Frederic Dufaux

The success of deep learning has been witnessed as a promising technique for computer-aided biomedical image analysis, due to end-to-end learning framework and availability of large-scale labelled samples. However, in many cases of…

Computer Vision and Pattern Recognition · Computer Science 2019-08-02 Pengyi Zhang , Yunxin Zhong , Yulin Deng , Xiaoying Tang , Xiaoqiong Li

Self-supervised learning (SSL) has recently advanced through non-contrastive methods that couple an invariance term with variance, covariance, or redundancy-reduction penalties. While such objectives shape first- and second-order statistics…

Machine Learning · Computer Science 2026-05-18 Benyamin Ghojogh , M. Hadi Sepanj , Paul Fieguth

Self-supervised learning (SSL) has emerged as a powerful technique for learning rich representations from unlabeled data. The data representations are able to capture many underlying attributes of data, and be useful in downstream…

Machine Learning · Computer Science 2023-12-01 Weicheng Zhu , Sheng Liu , Carlos Fernandez-Granda , Narges Razavian

Relatively abundant availability of medical imaging data has provided significant support in the development and testing of Neural Network based image processing methods. Clinicians often face issues in selecting suitable image processing…

Image and Video Processing · Electrical Eng. & Systems 2021-09-10 Mayank Goswami

Self-supervised learning (SSL) has emerged as a powerful paradigm for medical image representation learning, particularly in settings with limited labeled data. However, existing SSL methods often rely on complex architectures,…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Azad Singh , Deepak Mishra

Self-supervised learning (SSL) methods targeting scene images have seen a rapid growth recently, and they mostly rely on either a dedicated dense matching mechanism or a costly unsupervised object discovery module. This paper shows that…

Computer Vision and Pattern Recognition · Computer Science 2023-10-02 Ke Zhu , Minghao Fu , Jianxin Wu

Over the last decade, supervised deep learning on manually annotated big data has been progressing significantly on computer vision tasks. But the application of deep learning in medical image analysis was limited by the scarcity of…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Wei-Chien Wang , Euijoon Ahn , Dagan Feng , Jinman Kim

Medical image segmentation is a fundamental yet challenging task due to the arduous process of acquiring large volumes of high-quality labeled data from experts. Contrastive learning offers a promising but still problematic solution to this…

Computer Vision and Pattern Recognition · Computer Science 2025-02-14 Shuang Zeng , Lei Zhu , Xinliang Zhang , Micky C Nnamdi , Wenqi Shi , J Ben Tamo , Qian Chen , Hangzhou He , Lujia Jin , Zifeng Tian , Qiushi Ren , Zhaoheng Xie , Yanye Lu

Vision Transformers (ViTs) excel in 3D medical segmentation but require massive annotated datasets. While Self-Supervised Learning (SSL) mitigates this using unlabeled data, it still faces strict privacy and logistical barriers.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Jiaqi Tang , Mengyan Zheng , Shu Zhang , Fandong Zhang , Qingchao Chen

Self-supervised learning (SSL) has enabled the development of vision foundation models for Earth Observation (EO), demonstrating strong transferability across diverse remote sensing tasks. While prior work has focused on network…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Thomas Kerdreux , Alexandre Tuel , Quentin Febvre , Alexis Mouche , Bertrand Chapron

Supervised deep learning models depend on massive labeled data. Unfortunately, it is time-consuming and labor-intensive to collect and annotate bitemporal samples containing desired changes. Transfer learning from pre-trained models is…

Computer Vision and Pattern Recognition · Computer Science 2022-09-13 Hao Chen , Wenyuan Li , Song Chen , Zhenwei Shi

3D deep learning is a growing field of interest due to the vast amount of information stored in 3D formats. Triangular meshes are an efficient representation for irregular, non-uniform 3D objects. However, meshes are often challenging to…

Computer Vision and Pattern Recognition · Computer Science 2022-12-23 Ayaan Haque , Hankyu Moon , Heng Hao , Sima Didari , Jae Oh Woo , Patrick Bangert

Self-supervised learning (SSL) enables label efficient training for machine learning models. This is essential for domains such as medical imaging, where labels are costly and time-consuming to curate. However, the most effective supervised…

Computer Vision and Pattern Recognition · Computer Science 2023-05-16 Cara Van Uden , Jeremy Irvin , Mars Huang , Nathan Dean , Jason Carr , Andrew Ng , Curtis Langlotz

Self-supervised learning (SSL) has delivered superior performance on a variety of downstream vision tasks. Two main-stream SSL frameworks have been proposed, i.e., Instance Discrimination (ID) and Masked Image Modeling (MIM). ID pulls…

Computer Vision and Pattern Recognition · Computer Science 2022-11-17 Chenxin Tao , Xizhou Zhu , Weijie Su , Gao Huang , Bin Li , Jie Zhou , Yu Qiao , Xiaogang Wang , Jifeng Dai

Self-supervised learning (SSL) pipelines differ in many design choices such as the architecture, augmentations, or pretraining data. Yet SSL is typically evaluated using a single metric: linear probing on ImageNet. This does not provide…

Machine Learning · Computer Science 2024-01-09 Yann Dubois , Tatsunori Hashimoto , Percy Liang

Self-supervised learning (SSL) is now a standard way to pretrain medical image models, but performance is still mostly judged by downstream accuracy. For safety-critical screening tasks such as diabetic retinopathy grading, this is not…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Muskaan Chopra , Lorenz Sparrenberg , Jan H. Terheyden , Rafet Sifa

Brain midline shift (MLS) is one of the most critical factors to be considered for clinical diagnosis and treatment decision-making for intracranial hemorrhage. Existing computational methods on MLS quantification not only require intensive…

Computer Vision and Pattern Recognition · Computer Science 2023-01-03 Shizhan Gong , Cheng Chen , Yuqi Gong , Nga Yan Chan , Wenao Ma , Calvin Hoi-Kwan Mak , Jill Abrigo , Qi Dou

Supervised learning demands large amounts of precisely annotated data to achieve promising results. Such data curation is labor-intensive and imposes significant overhead regarding time and costs. Self-supervised learning (SSL) partially…

Computer Vision and Pattern Recognition · Computer Science 2025-05-21 Thangarajah Akilan , Nusrat Jahan , Wandong Zhang