English
Related papers

Related papers: Beat-ssl: Capturing Local ECG Morphology through H…

200 papers

Recently, deep end-to-end learning has been studied for intent classification in Spoken Language Understanding (SLU). However, end-to-end models require a large amount of speech data with intent labels, and highly optimized models are…

Computation and Language · Computer Science 2024-05-27 Suyoung Kim , Jiyeon Hwang , Ho-Young Jung

A key challenge for Emotion Recognition in Conversations (ERC) is to distinguish semantically similar emotions. Some works utilise Supervised Contrastive Learning (SCL) which uses categorical emotion labels as supervision signals and…

Computation and Language · Computer Science 2023-02-10 Kailai Yang , Tianlin Zhang , Hassan Alhuzali , Sophia Ananiadou

Analysis of cardiac ultrasound images is commonly performed in routine clinical practice for quantification of cardiac function. Its increasing automation frequently employs deep learning networks that are trained to predict disease or…

Computer Vision and Pattern Recognition · Computer Science 2021-08-09 Agisilaos Chartsias , Shan Gao , Angela Mumith , Jorge Oliveira , Kanwal Bhatia , Bernhard Kainz , Arian Beqiri

Electrocardiogram (ECG) is essential for the clinical diagnosis of arrhythmias and other heart diseases, but deep learning methods based on ECG often face limitations due to the need for high-quality annotations. Although previous ECG…

Machine Learning · Computer Science 2025-02-18 Jiarui Jin , Haoyu Wang , Hongyan Li , Jun Li , Jiahui Pan , Shenda Hong

Contrastive learning is a family of self-supervised methods where a model is trained to solve a classification task constructed from unlabeled data. It has recently emerged as one of the leading learning paradigms in the absence of labels…

Machine Learning · Statistics 2021-03-05 Bingbin Liu , Pradeep Ravikumar , Andrej Risteski

Image segmentation relies on large annotated datasets, which are expensive and slow to produce. Silver-standard (AI-generated) labels are easier to obtain, but they risk introducing bias. Self-supervised learning, needing only images, has…

Computer Vision and Pattern Recognition · Computer Science 2026-03-19 Marceau Lafargue-Hauret , Raghav Mehta , Fabio De Sousa Ribeiro , Mélanie Roschewitz , Ben Glocker

Contrastive learning (CL) aims to learn useful representation without relying on expert annotations in the context of medical image segmentation. Existing approaches mainly contrast a single positive vector (i.e., an augmentation of the…

Computer Vision and Pattern Recognition · Computer Science 2022-03-08 Chenyu You , Ruihan Zhao , Lawrence Staib , James S. Duncan

Electrocardiograms (ECGs) are non-invasive diagnostic tools crucial for detecting cardiac arrhythmic diseases in clinical practice. While ECG Self-supervised Learning (eSSL) methods show promise in representation learning from unannotated…

Signal Processing · Electrical Eng. & Systems 2024-07-03 Che Liu , Zhongwei Wan , Cheng Ouyang , Anand Shah , Wenjia Bai , Rossella Arcucci

Contrastive learning (CL) has achieved astonishing progress in computer vision, speech, and natural language processing fields recently with self-supervised learning. However, CL approach to the supervised setting is not fully explored,…

Computation and Language · Computer Science 2022-05-23 Zhenyu Zhang , Yuming Zhao , Meng Chen , Xiaodong He

Multimodal acoustic event classification plays a key role in audio-visual systems. Although combining audio and visual signals improves recognition, it is still difficult to align them over time and to reduce the effect of noise across…

Sound · Computer Science 2025-09-19 Yuanjian Chen , Yang Xiao , Jinjie Huang

Adversarial training (AT) for robust representation learning and self-supervised learning (SSL) for unsupervised representation learning are two active research fields. Integrating AT into SSL, multiple prior works have accomplished a…

Computer Vision and Pattern Recognition · Computer Science 2022-07-25 Chaoning Zhang , Kang Zhang , Chenshuang Zhang , Axi Niu , Jiu Feng , Chang D. Yoo , In So Kweon

Electrocardiogram (ECG) interpretation requires specialized expertise, often involving synthesizing insights from ECG signals with complex clinical queries posed in natural language. The scarcity of labeled ECG data coupled with the diverse…

Machine Learning · Computer Science 2025-05-09 Jialu Tang , Tong Xia , Yuan Lu , Cecilia Mascolo , Aaqib Saeed

Contrastive learning yields impressive results for self-supervision in computer vision. The approach relies on the creation of positive pairs, something which is often achieved through augmentations. However, for multivariate time series…

Signal Processing · Electrical Eng. & Systems 2026-05-25 Thea Brüsch , Mikkel N. Schmidt , Tommy S. Alstrøm

Continual Learning (CL) methods aim to learn from a sequence of tasks while avoiding the challenge of forgetting previous knowledge. We present DREAM-CL, a novel CL method for ECG arrhythmia detection that introduces dynamic prototype…

Machine Learning · Computer Science 2026-01-19 Sana Rahmani , Reetam Chatterjee , Ali Etemad , Javad Hashemi

Sign language recognition (SLR) plays a vital role in facilitating communication for the hearing-impaired community. SLR is a weakly supervised task where entire videos are annotated with glosses, making it challenging to identify the…

Computer Vision and Pattern Recognition · Computer Science 2024-01-23 Hao Chen , Jiaze Wang , Ziyu Guo , Jinpeng Li , Donghao Zhou , Bian Wu , Chenyong Guan , Guangyong Chen , Pheng-Ann Heng

Contrastive learning has been proved to be a promising technique for image-level representation learning from unlabeled data. Many existing works have demonstrated improved results by applying contrastive learning in classification and…

Image and Video Processing · Electrical Eng. & Systems 2021-09-20 Dewen Zeng , John N. Kheir , Peng Zeng , Yiyu Shi

Deep learning has demonstrated significant improvements in medical image segmentation using a sufficiently large amount of training data with manual labels. Acquiring well-representative labels requires expert knowledge and exhaustive…

Computer Vision and Pattern Recognition · Computer Science 2021-06-15 Jinxi Xiang , Zhuowei Li , Wenji Wang , Qing Xia , Shaoting Zhang

We present a self-supervised learning (SSL) method suitable for semi-global tasks such as object detection and semantic segmentation. We enforce local consistency between self-learned features, representing corresponding image locations of…

Computer Vision and Pattern Recognition · Computer Science 2022-12-09 Ashraful Islam , Ben Lundell , Harpreet Sawhney , Sudipta Sinha , Peter Morales , Richard J. Radke

Whole-heart segmentation from CT and MRI scans is crucial for cardiovascular disease analysis, yet existing methods struggle with modality-specific biases and the need for extensive labeled datasets. To address these challenges, we propose…

Image and Video Processing · Electrical Eng. & Systems 2025-03-26 Abdul Qayyum , Moona Mazher , Devran Ugurlu , Jose Alonso Solis Lemus , Cristobal Rodero , Steven A Niederer

Self-supervised learning (SSL) methods are popular since they can address situations with limited annotated data by directly utilising the underlying data distribution. However, the adoption of such methods is not explored enough in…

Image and Video Processing · Electrical Eng. & Systems 2024-08-01 Joseph Geo Benjamin , Mothilal Asokan , Amna Alhosani , Hussain Alasmawi , Werner Gerhard Diehl , Leanne Bricker , Karthik Nandakumar , Mohammad Yaqub