English
Related papers

Related papers: Frozen Language Model Helps ECG Zero-Shot Learning

200 papers

Unsupervised pre-training is now the predominant approach for both text and speech understanding. Self-attention models pre-trained on large amounts of unannotated data have been hugely successful when fine-tuned on downstream tasks from a…

Computation and Language · Computer Science 2021-10-22 Ankur Bapna , Yu-an Chung , Nan Wu , Anmol Gulati , Ye Jia , Jonathan H. Clark , Melvin Johnson , Jason Riesa , Alexis Conneau , Yu Zhang

Electrocardiography (ECG) offers critical cardiovascular insights, such as identifying arrhythmias and myocardial ischemia, but enabling automated systems to answer complex clinical questions directly from ECG signals (ECG-QA) remains a…

Signal Processing · Electrical Eng. & Systems 2025-05-13 Hung Manh Pham , Jialu Tang , Aaqib Saeed , Dong Ma

The performances of commonly used electrocardiogram (ECG) diagnosis models have recently improved with the introduction of deep learning (DL). However, the impact of various combinations of multiple DL components and/or the role of data…

Signal Processing · Electrical Eng. & Systems 2022-08-02 Jae-Won Choi , Dae-Yong Hong , Chan Jung , Eugene Hwang , Sung-Hyuk Park , Seung-Young Roh

We present an electrocardiogram (ECG) -based emotion recognition system using self-supervised learning. Our proposed architecture consists of two main networks, a signal transformation recognition network and an emotion recognition network.…

Machine Learning · Computer Science 2020-04-14 Pritam Sarkar , Ali Etemad

Zero-shot neural machine translation is an attractive goal because of the high cost of obtaining data and building translation systems for new translation directions. However, previous papers have reported mixed success in zero-shot…

Computation and Language · Computer Science 2020-11-04 Annette Rios , Mathias Müller , Rico Sennrich

ECG heartbeat classification plays a vital role in diagnosis of cardiac arrhythmia. The goal of the Physionet/CinC 2021 challenge was to accurately classify clinical diagnosis based on 12, 6, 4, 3 or 2-lead ECG recordings in order to aid…

Physiological signals such as electrocardiograms (ECG) and electroencephalograms (EEG) provide complementary insights into human health and cognition, yet multi-modal integration is challenging due to limited multi-modal labeled data, and…

Myocardial infarction is a major cause of death globally, and accurate early diagnosis from electrocardiograms (ECGs) remains a clinical priority. Deep learning models have shown promise for automated ECG interpretation, but require large…

Image and Video Processing · Electrical Eng. & Systems 2025-07-01 Lachin Naghashyar

The massive growth of self-supervised learning (SSL) has been witnessed in language, vision, speech, and audio domains over the past few years. While discrete label prediction is widely adopted for other modalities, the state-of-the-art…

Audio and Speech Processing · Electrical Eng. & Systems 2022-12-20 Sanyuan Chen , Yu Wu , Chengyi Wang , Shujie Liu , Daniel Tompkins , Zhuo Chen , Furu Wei

Electrocardiogram (ECG) analysis is foundational for cardiovascular disease diagnosis, yet the performance of deep learning models is often constrained by limited access to annotated data. Self-supervised contrastive learning has emerged as…

Machine Learning · Computer Science 2025-08-22 Yi Yuan , Joseph Van Duyn , Runze Yan , Zhuoyi Huang , Sulaiman Vesal , Sergey Plis , Xiao Hu , Gloria Hyunjung Kwak , Ran Xiao , Alex Fedorov

Audio self-supervised learning (SSL) pre-training, which aims to learn good representations from unlabeled audio, has made remarkable progress. However, the extensive computational demands during pre-training pose a significant barrier to…

Audio and Speech Processing · Electrical Eng. & Systems 2024-01-09 Wenxi Chen , Yuzhe Liang , Ziyang Ma , Zhisheng Zheng , Xie Chen

Investigation on the electrocardiogram (ECG) signals is an essential way to diagnose heart disease since the ECG process is noninvasive and easy to use. This work presents a supraventricular arrhythmia prediction model consisting of a few…

Signal Processing · Electrical Eng. & Systems 2021-12-28 Pampa Howladar , Manodipan Sahoo

Medical image segmentation has achieved remarkable success through the continuous advancement of UNet-based and Transformer-based foundation backbones. However, clinical diagnosis in the real world often requires integrating domain…

Computer Vision and Pattern Recognition · Computer Science 2025-04-11 Siyuan Dai , Kai Ye , Guodong Liu , Haoteng Tang , Liang Zhan

With the progress of sensor technology in wearables, the collection and analysis of PPG signals are gaining more interest. Using Machine Learning, the cardiac rhythm corresponding to PPG signals can be used to predict different tasks such…

Signal Processing · Electrical Eng. & Systems 2022-12-20 Ramin Ghorbani , Marcel J. T. Reinders , David M. J. Tax

An electrocardiogram (ECG) is vital for identifying cardiac diseases, offering crucial insights for diagnosing heart conditions and informing potentially life-saving treatments. However, like other types of medical data, ECGs are subject to…

Signal Processing · Electrical Eng. & Systems 2024-07-17 Sergey Skorik , Aram Avetisyan

Heart failure (HF) poses a significant public health challenge, with a rising global mortality rate. Early detection and prevention of HF could significantly reduce its impact. We introduce a novel methodology for predicting HF risk using…

Quantitative Methods · Quantitative Biology 2025-06-19 Chen Chen , Lei Li , Marcel Beetz , Abhirup Banerjee , Ramneek Gupta , Vicente Grau

Medical professionals frequently work in a data constrained setting to provide insights across a unique demographic. A few medical observations, for instance, informs the diagnosis and treatment of a patient. This suggests a unique setting…

Computation and Language · Computer Science 2022-12-06 Pankaj Sharma , Imran Qureshi , Minh Tran

Emotion recognition in conversations (ERC) is a rapidly evolving task within the natural language processing community, which aims to detect the emotions expressed by speakers during a conversation. Recently, a growing number of ERC methods…

Computation and Language · Computer Science 2023-12-12 Tao Shi , Xiao Liang , Yaoyuan Liang , Xinyi Tong , Shao-Lun Huang

The past few years have witnessed a remarkable advance in deep learning for EEG-based sleep stage classification (SSC). However, the success of these models is attributed to possessing a massive amount of labeled data for training, limiting…

Signal Processing · Electrical Eng. & Systems 2022-10-14 Emadeldeen Eldele , Mohamed Ragab , Zhenghua Chen , Min Wu , Chee-Keong Kwoh , Xiaoli Li

Conventional methods in semi-supervised learning (SSL) often face challenges related to limited data utilization, mainly due to their reliance on threshold-based techniques for selecting high-confidence unlabeled data during training.…

Computer Vision and Pattern Recognition · Computer Science 2024-05-13 Wenjin Zhang , Keyi Li , Sen Yang , Chenyang Gao , Wanzhao Yang , Sifan Yuan , Ivan Marsic