English
Related papers

Related papers: Self-supervised representation learning from 12-le…

200 papers

Learning rich visual representations using contrastive self-supervised learning has been extremely successful. However, it is still a major question whether we could use a similar approach to learn superior auditory representations. In this…

Sound · Computer Science 2020-10-20 Haider Al-Tahan , Yalda Mohsenzadeh

There has been an increased interest in applying deep neural networks to automatically interpret and analyze the 12-lead electrocardiogram (ECG). The current paradigms with machine learning methods are often limited by the amount of labeled…

Machine Learning · Statistics 2022-08-12 Jiacheng Zhu , Jielin Qiu , Zhuolin Yang , Douglas Weber , Michael A. Rosenberg , Emerson Liu , Bo Li , Ding Zhao

Recently, contrastive self-supervised learning, where the proximity of representations is determined based on the identities of samples, has made remarkable progress in unsupervised representation learning. SimSiam is a well-known example…

Computer Vision and Pattern Recognition · Computer Science 2023-05-24 Kyoungmin Han , Minsik Lee

Learning time-series representations when only unlabeled data or few labeled samples are available can be a challenging task. Recently, contrastive self-supervised learning has shown great improvement in extracting useful representations…

Machine Learning · Computer Science 2023-09-06 Emadeldeen Eldele , Mohamed Ragab , Zhenghua Chen , Min Wu , Chee-Keong Kwoh , Xiaoli Li , Cuntai Guan

The adoption of deep learning in ECG diagnosis is often hindered by the scarcity of large, well-labeled datasets in real-world scenarios, leading to the use of transfer learning to leverage features learned from larger datasets. Yet the…

Machine Learning · Computer Science 2024-06-28 Cuong V. Nguyen , Cuong D. Do

Self-supervised learning (SSL) methods have shown promise for medical imaging applications by learning meaningful visual representations, even when the amount of labeled data is limited. Here, we extend state-of-the-art contrastive learning…

Deep learning models have shown high accuracy in classifying electrocardiograms (ECGs), but their black box nature hinders clinical adoption due to a lack of trust and interpretability. To address this, we propose a novel three-stage…

Machine Learning · Computer Science 2025-12-09 Jose Geraldo Fernandes , Luiz Facury de Souza , Pedro Robles Dutenhefner , Gisele L. Pappa , Wagner Meira

We investigate a strategy for improving the efficiency of contrastive learning of visual representations by leveraging a small amount of supervised information during pre-training. We propose a semi-supervised loss, SuNCEt, based on…

Machine Learning · Computer Science 2020-12-03 Mahmoud Assran , Nicolas Ballas , Lluis Castrejon , Michael Rabbat

Recently, supervised methods, which often require substantial amounts of class labels, have achieved promising results for EEG representation learning. However, labeling EEG data is a challenging task. More recently, holistic…

Machine Learning · Computer Science 2022-02-14 Guangyi Zhang , Ali Etemad

Numerous studies are aimed at diagnosing heart diseases based on 12-lead electrocardiographic (ECG) records using deep learning methods. These studies usually use specific datasets that differ in size and parameters, such as patient…

Signal Processing · Electrical Eng. & Systems 2023-05-31 Aram Avetisyan , Shahane Tigranyan , Ariana Asatryan , Olga Mashkova , Sergey Skorik , Vladislav Ananev , Yury Markin

To improve performance in visual feature representation from photos or videos for practical applications, we generally require large-scale human-annotated labeled data while training deep neural networks. However, the cost of gathering and…

Computer Vision and Pattern Recognition · Computer Science 2022-10-10 Zhenyuan Lu

Cardiovascular diseases are a leading cause of death and disability worldwide. Electrocardiogram (ECG) is critical for diagnosing and monitoring cardiac health, but obtaining large-scale annotated ECG datasets is labor-intensive and…

Signal Processing · Electrical Eng. & Systems 2025-09-22 Mingsheng Cai , Jiuming Jiang , Wenhao Huang , Che Liu , Rossella Arcucci

In recent years, semi-supervised learning (SSL) has shown tremendous success in leveraging unlabeled data to improve the performance of deep learning models, which significantly reduces the demand for large amounts of labeled data. Many SSL…

Machine Learning · Computer Science 2020-06-02 Song-Bo Yang , Tian-li Yu

In future 6G cellular networks, a joint communication and sensing protocol will allow the network to perceive the environment, opening the door for many new applications atop a unified communication-perception infrastructure. However,…

Networking and Internet Architecture · Computer Science 2022-02-25 Mohammed Alloulah , Akash Deep Singh , Maximilian Arnold

Emotion recognition models using audio input data can enable the development of interactive systems with applications in mental healthcare, marketing, gaming, and social media analysis. While the field of affective computing using audio…

Sound · Computer Science 2023-07-25 Peranut Nimitsurachat , Peter Washington

Unsupervised learning has made substantial progress over the last few years, especially by means of contrastive self-supervised learning. The dominating dataset for benchmarking self-supervised learning has been ImageNet, for which recent…

Image and Video Processing · Electrical Eng. & Systems 2022-08-17 Karin Stacke , Jonas Unger , Claes Lundström , Gabriel Eilertsen

Self-supervised pretraining followed by supervised fine-tuning has seen success in image recognition, especially when labeled examples are scarce, but has received limited attention in medical image analysis. This paper studies the…

Self-supervised learning holds promise in leveraging large numbers of unlabeled data. However, its success heavily relies on the highly-curated dataset, e.g., ImageNet, which still needs human cleaning. Directly learning representations…

Computer Vision and Pattern Recognition · Computer Science 2023-02-24 Meilin Chen , Yizhou Wang , Shixiang Tang , Feng Zhu , Haiyang Yang , Lei Bai , Rui Zhao , Donglian Qi , Wanli Ouyang

Accurate prediction of cardiovascular diseases remains imperative for early diagnosis and intervention, necessitating robust and precise predictive models. Recently, there has been a growing interest in multi-modal learning for uncovering…

Computer Vision and Pattern Recognition · Computer Science 2024-11-12 Francesco Girlanda , Olga Demler , Bjoern Menze , Neda Davoudi

Deep neural network-based classifiers trained with the categorical cross-entropy (CCE) loss are sensitive to label noise in the training data. One common type of method that can mitigate the impact of label noise can be viewed as supervised…

Computer Vision and Pattern Recognition · Computer Science 2021-04-20 Aritra Ghosh , Andrew Lan