English
Related papers

Related papers: Zero-Shot ECG Classification with Multimodal Learn…

200 papers

Heart disease is the number one killer, and ECGs can assist in the early diagnosis and prevention of deadly outcomes. Accurate ECG interpretation is critical in detecting heart diseases; however, they are often misinterpreted due to a lack…

Machine Learning · Computer Science 2021-10-29 Dharma KC , Chicheng Zhang , Chris Gniady , Parth Sandeep Agarwal , Sushil Sharma

Integrating physiological signals such as electroencephalogram (EEG), with other data such as interview audio, may offer valuable multimodal insights into psychological states or neurological disorders. Recent advancements with Large…

Human-Computer Interaction · Computer Science 2024-08-15 Yongquan Hu , Shuning Zhang , Ting Dang , Hong Jia , Flora D. Salim , Wen Hu , Aaron J. Quigley

The analysis of electrocardiogram (ECG) signals can be time consuming as it is performed manually by cardiologists. Therefore, automation through machine learning (ML) classification is being increasingly proposed which would allow ML…

Machine Learning · Computer Science 2022-05-10 Shourya Verma

The electrocardiogram (ECG) is a key diagnostic tool in cardiovascular health. Single-lead ECG recording is integrated into both clinical-grade and consumer wearables. While self-supervised pretraining of foundation models on unlabeled ECGs…

Machine Learning · Computer Science 2025-12-03 Yuxuan Shu , Peter H. Charlton , Fahim Kawsar , Jussi Hernesniemi , Mohammad Malekzadeh

Electrocardiograms (ECG), which record the electrophysiological activity of the heart, have become a crucial tool for diagnosing these diseases. In recent years, the application of deep learning techniques has significantly improved the…

Signal Processing · Electrical Eng. & Systems 2024-06-26 Wei Huang , Ning Wang , Panpan Feng , Haiyan Wang , Zongmin Wang , Bing Zhou

Electroencephalogram (EEG) is a non-invasive technique to record bioelectrical signals. Integrating supervised deep learning techniques with EEG signals has recently facilitated automatic analysis across diverse EEG-based tasks. However,…

Signal Processing · Electrical Eng. & Systems 2024-01-12 Weining Weng , Yang Gu , Shuai Guo , Yuan Ma , Zhaohua Yang , Yuchen Liu , Yiqiang Chen

An electrocardiogram (ECG) is a widely used, cost-effective tool for detecting electrical abnormalities in the heart. However, it cannot directly measure functional parameters, such as ventricular volumes and ejection fraction, which are…

Image and Video Processing · Electrical Eng. & Systems 2025-06-27 Alexander Selivanov , Philip Müller , Özgün Turgut , Nil Stolt-Ansó , Daniel Rückert

A language is made up of an infinite/finite number of sentences, which in turn is composed of a number of words. The Electrocardiogram (ECG) is the most popular noninvasive medical tool for studying heart function and diagnosing various…

Signal Processing · Electrical Eng. & Systems 2024-07-17 Prapti Ganguly , Wazib Ansar , Amlan Chakrabarti

Electrocardiography (ECG) offers critical cardiovascular insights, such as identifying arrhythmias and myocardial ischemia, but enabling automated systems to answer complex clinical questions directly from ECG signals (ECG-QA) remains a…

Signal Processing · Electrical Eng. & Systems 2025-05-13 Hung Manh Pham , Jialu Tang , Aaqib Saeed , Dong Ma

Electrocardiogram (ECG) detection and delineation are key steps for numerous tasks in clinical practice, as ECG is the most performed non-invasive test for assessing cardiac condition. State-of-the-art algorithms employ digital signal…

Machine Learning · Computer Science 2020-05-12 Guillermo Jimenez-Perez , Alejandro Alcaine , Oscar Camara

Machine learning (ML) applied to routine patient monitoring within intensive care units (ICUs) has the potential to improve care by providing clinicians with novel insights into each patient's health and expected response to interventions.…

Signal Processing · Electrical Eng. & Systems 2024-06-26 Thomas Kite , Uzair Tahamid Siam , Brian Ayers , Nicholas Houstis , Aaron D Aguirre

Electrocardiogram (ECG) is a widely used tool for assessing cardiac function due to its low cost and accessibility. Emergent research shows that ECGs can help make predictions on key outcomes traditionally derived from more complex…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Yuan Gao , Sangwook Kim , Chris McIntosh

Emotional Recognition in Conversation (ERC) is valuable for diagnosing health conditions such as autism and depression, and for understanding the emotions of individuals who struggle to express their feelings. Current ERC methods primarily…

Human-Computer Interaction · Computer Science 2026-05-06 Zijian Kang , Yueyang Li , Shengyu Gong , Weiming Zeng , Hongjie Yan , Lingbin Bian , Zhiguo Zhang , Wai Ting Siok , Nizhuan Wang

Early detection of cardiovascular diseases is crucial for effective treatment and an electrocardiogram (ECG) is pivotal for diagnosis. The accuracy of Deep Learning based methods for ECG signal classification has progressed in recent years…

Signal Processing · Electrical Eng. & Systems 2022-04-12 Likith Reddy , Vivek Talwar , Shanmukh Alle , Raju. S. Bapi , U. Deva Priyakumar

Electrocardiogram (ECG) arrhythmia classification remains challenging due to signal variability, noise, limited labeled data, and the difficulty in achieving both accuracy and efficiency in models. While self-supervised learning reduces…

Machine Learning · Computer Science 2026-05-14 Mahsa Gazeran , Sayvan Soleymanbaigi , Fatemeh Daneshfar , Amjad Seyedi , Fardin Akhlaghian Tab

Multimodal language modeling has enabled breakthroughs for representation learning, yet remains unexplored in the realm of functional brain data for clinical phenotyping. This paper pioneers EEG-language models (ELMs) trained on clinical…

Signal Processing · Electrical Eng. & Systems 2025-08-12 Sam Gijsen , Kerstin Ritter

While recent multimodal large language models (MLLMs) have advanced automated ECG interpretation, they still face two key limitations: (1) insufficient multimodal synergy between time series signals and visual ECG representations, and (2)…

Computation and Language · Computer Science 2025-10-21 Xiang Lan , Feng Wu , Kai He , Qinghao Zhao , Shenda Hong , Mengling Feng

Recent advances in large language models (LLMs) have enabled the development of multimodal medical AI. While models such as MedGemini achieve high accuracy on VQA tasks like USMLE MM, their performance on ECG based tasks remains limited,…

Machine Learning · Computer Science 2026-02-12 Junichiro Takahashi , Masataka Sato , Satoshi Kodeta , Norihiko Takeda

The integration of multimodal Electronic Health Records (EHR) data has significantly advanced clinical predictive capabilities. Existing models, which utilize clinical notes and multivariate time-series EHR data, often fall short of…

Computation and Language · Computer Science 2025-02-27 Yinghao Zhu , Changyu Ren , Zixiang Wang , Xiaochen Zheng , Shiyun Xie , Junlan Feng , Xi Zhu , Zhoujun Li , Liantao Ma , Chengwei Pan

Extracting information from the electrocardiography (ECG) signal is an essential step in the design of digital health technologies in cardiology. In recent years, several machine learning (ML) algorithms for automatic extraction of…

Signal Processing · Electrical Eng. & Systems 2023-05-18 Adrian Atienza , Jakob Bardram , Sadasivan Puthusserypady