English
Related papers

Related papers: Self-Supervised Learning of Gait-Based Biomarkers

200 papers

Objective. Supervised learning paradigms are often limited by the amount of labeled data that is available. This phenomenon is particularly problematic in clinically-relevant data, such as electroencephalography (EEG), where labeling can be…

Machine Learning · Statistics 2020-08-03 Hubert Banville , Omar Chehab , Aapo Hyvärinen , Denis-Alexander Engemann , Alexandre Gramfort

In Self-Supervised Learning (SSL), various pretext tasks are designed for learning feature representations through contrastive loss. However, previous studies have shown that this loss is less tolerant to semantically similar samples due to…

Audio and Speech Processing · Electrical Eng. & Systems 2023-03-07 Shanshan Wang , Soumya Tripathy , Annamaria Mesaros

Self-supervised learning (SSL) has emerged as a powerful approach to learning representations, particularly in the field of computer vision. However, its application to dependent data, such as temporal and spatio-temporal domains, remains…

Machine Learning · Computer Science 2025-10-01 Alexander Marusov , Aleksandr Yugay , Alexey Zaytsev

The scarcity of annotated data has sparked significant interest in unsupervised pre-training methods that leverage medical reports as auxiliary signals for medical visual representation learning. However, existing research overlooks the…

Computer Vision and Pattern Recognition · Computer Science 2024-02-06 Zhe Li , Laurence T. Yang , Bocheng Ren , Xin Nie , Zhangyang Gao , Cheng Tan , Stan Z. Li

Quantifying the perceptual similarity of two images is a long-standing problem in low-level computer vision. The natural image domain commonly relies on supervised learning, e.g., a pre-trained VGG, to obtain a latent representation.…

This study explores the application of self-supervised learning (SSL) to the task of motion forecasting, an area that has not yet been extensively investigated despite the widespread success of SSL in computer vision and natural language…

Robotics · Computer Science 2023-08-22 Jie Cheng , Xiaodong Mei , Ming Liu

Trajectory similarity computation is fundamental functionality that is used for, e.g., clustering, prediction, and anomaly detection. However, existing learning-based methods exhibit three key limitations: (1) insufficient modeling of…

Computer Vision and Pattern Recognition · Computer Science 2025-12-18 Zhichen Lai , Hua Lu , Huan Li , Jialiang Li , Christian S. Jensen

Unsupervised learning has made substantial progress over the last few years, especially by means of contrastive self-supervised learning. The dominating dataset for benchmarking self-supervised learning has been ImageNet, for which recent…

Image and Video Processing · Electrical Eng. & Systems 2022-08-17 Karin Stacke , Jonas Unger , Claes Lundström , Gabriel Eilertsen

Pose-estimation methods enable extracting human motion from common videos in the structured form of 3D skeleton sequences. Despite great application opportunities, effective content-based access to such spatio-temporal motion data is a…

Computer Vision and Pattern Recognition · Computer Science 2024-07-03 Nicola Messina , Jan Sedmidubsky , Fabrizio Falchi , Tomáš Rebok

Self-supervised learning (SSL) has emerged as a powerful technique for improving the efficiency and effectiveness of deep learning models. Contrastive methods are a prominent family of SSL that extract similar representations of two…

Accurate and contrast-free Major Adverse Cardiac Events (MACE) prediction from Cine MRI sequences remains a critical challenge. Existing methods typically necessitate supervised learning based on human-refined masks in the ventricular…

Computer Vision and Pattern Recognition · Computer Science 2025-09-30 Haoyang Su , Shaohao Rui , Jinyi Xiang , Lianming Wu , Xiaosong Wang

Self-supervised learning (SSL) learns high-quality representations from large pools of unlabeled training data. As datasets grow larger, it becomes crucial to identify the examples that contribute the most to learning such representations.…

Machine Learning · Computer Science 2024-03-14 Siddharth Joshi , Baharan Mirzasoleiman

Learning representations for individual instances when only bag-level labels are available is a fundamental challenge in multiple instance learning (MIL). Recent works have shown promising results using contrastive self-supervised learning…

Computer Vision and Pattern Recognition · Computer Science 2023-07-13 Kangning Liu , Weicheng Zhu , Yiqiu Shen , Sheng Liu , Narges Razavian , Krzysztof J. Geras , Carlos Fernandez-Granda

Self-supervised learning (SSL) is a data-driven learning approach that utilizes the innate structure of the data to guide the learning process. In contrast to supervised learning, which depends on external labels, SSL utilizes the inherent…

Machine Learning · Computer Science 2025-04-09 Einari Vaaras , Manu Airaksinen , Okko Räsänen

In this work, we focus on the challenging task, neuro-disease classification, using functional magnetic resonance imaging (fMRI). In population graph-based disease analysis, graph convolutional neural networks (GCNs) have achieved…

Machine Learning · Computer Science 2022-11-29 Liang Peng , Nan Wang , Jie Xu , Xiaofeng Zhu , Xiaoxiao Li

Semi-supervised learning (SSL) uses unlabeled data during training to learn better models. Previous studies on SSL for medical image segmentation focused mostly on improving model generalization to unseen data. In some applications,…

Multi-modal contrastive learning (MMCL) has recently garnered considerable interest due to its superior performance in visual tasks, achieved by embedding multi-modal data, such as visual-language pairs. However, there still lack…

Computer Vision and Pattern Recognition · Computer Science 2023-06-08 Qi Zhang , Yifei Wang , Yisen Wang

Machine learning algorithms are improving rapidly, but annotating training data remains a bottleneck for many applications. In this paper, we show how real data can be used for self-supervised learning without any transformations by taking…

Machine Learning · Computer Science 2023-11-22 Dominique Nshimyimana , Vitor Fortes Rey , Paul Lukowic

We present a self-supervised learning (SSL) method suitable for semi-global tasks such as object detection and semantic segmentation. We enforce local consistency between self-learned features, representing corresponding image locations of…

Computer Vision and Pattern Recognition · Computer Science 2022-12-09 Ashraful Islam , Ben Lundell , Harpreet Sawhney , Sudipta Sinha , Peter Morales , Richard J. Radke

Self-supervised learning has proven to be an effective way to learn representations in domains where annotated labels are scarce, such as medical imaging. A widely adopted framework for this purpose is contrastive learning and it has been…

Computer Vision and Pattern Recognition · Computer Science 2024-02-23 Hugo Figueiras , Helena Aidos , Nuno Cruz Garcia