English
Related papers

Related papers: A Backbone Benchmarking Study on Self-supervised L…

200 papers

Semi-supervised learning (SSL) is a popular setting aiming to effectively utilize unlabelled data to improve model performance in downstream natural language processing (NLP) tasks. Currently, there are two popular approaches to make use of…

Computation and Language · Computer Science 2023-05-23 Zhengxiang Shi , Francesco Tonolini , Nikolaos Aletras , Emine Yilmaz , Gabriella Kazai , Yunlong Jiao

The proliferation of various data sources in urban and territorial environments has significantly facilitated the development of geospatial artificial intelligence (GeoAI) across a wide range of geospatial applications. However, geospatial…

Artificial Intelligence · Computer Science 2025-04-28 Yile Chen , Weiming Huang , Kaiqi Zhao , Yue Jiang , Gao Cong

Multi-task learning has proven to be effective in improving the performance of correlated tasks. Most of the existing methods use a backbone to extract initial features with independent branches for each task, and the exchange of…

Computer Vision and Pattern Recognition · Computer Science 2023-05-05 Diogo Nunes Goncalves , Jose Marcato Junior , Pedro Zamboni , Hemerson Pistori , Jonathan Li , Keiller Nogueira , Wesley Nunes Goncalves

Inspite the emerging importance of Speech Emotion Recognition (SER), the state-of-the-art accuracy is quite low and needs improvement to make commercial applications of SER viable. A key underlying reason for the low accuracy is the…

Sound · Computer Science 2020-03-24 Siddique Latif , Rajib Rana , Sara Khalifa , Raja Jurdak , Julien Epps , Björn W. Schuller

Self-supervised learning (SSL) has emerged as a powerful paradigm for medical image representation learning, particularly in settings with limited labeled data. However, existing SSL methods often rely on complex architectures,…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Azad Singh , Deepak Mishra

Deep learning in general domains has constantly been extended to domain-specific tasks requiring the recognition of fine-grained characteristics. However, real-world applications for fine-grained tasks suffer from two challenges: a high…

Computer Vision and Pattern Recognition · Computer Science 2023-03-27 Sungnyun Kim , Sangmin Bae , Se-Young Yun

Accurate facial estimation is crucial for realistic digital human animation, and ARKit blendshape coefficients offer an interpretable representation by mapping facial motions to semantic animation controls. However, learning high-quality…

Computer Vision and Pattern Recognition · Computer Science 2026-05-08 Zejian Kang , Xuanyang Xu , Wentao Yang , Kai Zheng , Yuanchen Fei , Hongyuan Zou , Hui Shan , Shuo Yang , Xiangru Huang

Deep supervised learning algorithms typically require a large volume of labeled data to achieve satisfactory performance. However, the process of collecting and labeling such data can be expensive and time-consuming. Self-supervised…

Machine Learning · Computer Science 2024-07-16 Jie Gui , Tuo Chen , Jing Zhang , Qiong Cao , Zhenan Sun , Hao Luo , Dacheng Tao

Recent advancements in self-supervised learning (SSL) made it possible to learn generalizable visual representations from unlabeled data. The performance of Deep Learning models fine-tuned on pretrained SSL representations is on par with…

Machine Learning · Computer Science 2021-09-21 Atharva Tendle , Mohammad Rashedul Hasan

While state-of-the-art contrastive Self-Supervised Learning (SSL) models produce results competitive with their supervised counterparts, they lack the ability to infer latent variables. In contrast, prescribed latent variable (LV) models…

Machine Learning · Computer Science 2021-12-01 Jason Ramapuram , Dan Busbridge , Xavier Suau , Russ Webb

A combinatory approach of two well-known fields: deep learning and semi supervised learning is presented, to tackle the land cover identification problem. The proposed methodology demonstrates the impact on the performance of deep learning…

Computer Vision and Pattern Recognition · Computer Science 2020-06-02 Eftychios Protopapadakis , Anastasios Doulamis , Nikolaos Doulamis , Evangelos Maltezos

Augmentation-based self-supervised learning methods have shown remarkable success in self-supervised visual representation learning, excelling in learning invariant features but often neglecting equivariant ones. This limitation reduces the…

Computer Vision and Pattern Recognition · Computer Science 2024-12-05 Qin Wang , Kai Krajsek , Hanno Scharr

Successive Subspace Learning (SSL) offers a light-weight unsupervised feature learning method based on inherent statistical properties of data units (e.g. image pixels and points in point cloud sets). It has shown promising results,…

Computer Vision and Pattern Recognition · Computer Science 2021-03-02 Mozhdeh Rouhsedaghat , Masoud Monajatipoor , Zohreh Azizi , C. -C. Jay Kuo

Self-Supervised Learning (SSL) using huge unlabeled data has been successfully explored for image and natural language processing. Recent works also investigated SSL from speech. They were notably successful to improve performance on…

Recent advances in self-supervised learning (SSL) have largely closed the gap with supervised ImageNet pretraining. Despite their success these methods have been primarily applied to unlabeled ImageNet images, and show marginal gains when…

Computer Vision and Pattern Recognition · Computer Science 2020-12-09 Ramprasaath R. Selvaraju , Karan Desai , Justin Johnson , Nikhil Naik

Face recognition in unconstrained environments is challenging due to variations in illumination, quality of sensing, motion blur and etc. An individual's face appearance can vary drastically under different conditions creating a gap between…

Computer Vision and Pattern Recognition · Computer Science 2020-11-30 S. W. Arachchilage , E. Izquierdo

Recently, self-supervised learning (SSL) has demonstrated strong performance in speaker recognition, even if the pre-training objective is designed for speech recognition. In this paper, we study which factor leads to the success of…

Computation and Language · Computer Science 2022-06-28 Sanyuan Chen , Yu Wu , Chengyi Wang , Shujie Liu , Zhuo Chen , Peidong Wang , Gang Liu , Jinyu Li , Jian Wu , Xiangzhan Yu , Furu Wei

Semi-supervised learning (SSL), which aims at leveraging a few labeled images and a large number of unlabeled images for network training, is beneficial for relieving the burden of data annotation in medical image segmentation. According to…

Image and Video Processing · Electrical Eng. & Systems 2022-02-15 Xinkai Zhao , Chaowei Fang , De-Jun Fan , Xutao Lin , Feng Gao , Guanbin Li

With the development of deep learning, Deep Metric Learning (DML) has achieved great improvements in face recognition. Specifically, the widely used softmax loss in the training process often bring large intra-class variations, and feature…

Computer Vision and Pattern Recognition · Computer Science 2018-05-02 Bowen Wu , Huaming Wu , Monica M. Y. Zhang

Self-Supervised Learning (SSL) for Vision Transformers (ViTs) has recently demonstrated considerable potential as a pre-training strategy for a variety of computer vision tasks, including image classification and segmentation, both in…

Computer Vision and Pattern Recognition · Computer Science 2025-09-22 Yannis Kaltampanidis , Alexandros Doumanoglou , Dimitrios Zarpalas
‹ Prev 1 4 5 6 7 8 10 Next ›