English
Related papers

Related papers: Teach Multimodal LLMs to Comprehend Electrocardiog…

200 papers

Electrocardiogram (ECG) interpretation requires specialized expertise, often involving synthesizing insights from ECG signals with complex clinical queries posed in natural language. The scarcity of labeled ECG data coupled with the diverse…

Machine Learning · Computer Science 2025-05-09 Jialu Tang , Tong Xia , Yuan Lu , Cecilia Mascolo , Aaqib Saeed

Electrocardiogram (ECG) interpretation is a cornerstone of cardiac diagnostics. This paper explores a practical approach to enhance ECG image interpretation using the multimodal LLaMA 3.2 model. We used a parameter-efficient fine-tuning…

Computer Vision and Pattern Recognition · Computer Science 2025-02-03 Nandakishor M , Anjali M

Automated interpretation of electrocardiograms (ECG) has garnered significant attention with the advancements in machine learning methodologies. Despite the growing interest, most current studies focus solely on classification or regression…

Signal Processing · Electrical Eng. & Systems 2023-11-07 Jielin Qiu , Jiacheng Zhu , Shiqi Liu , William Han , Jingqi Zhang , Chaojing Duan , Michael Rosenberg , Emerson Liu , Douglas Weber , Ding Zhao

Recent advances have increasingly applied large language models (LLMs) to electrocardiogram (ECG) interpretation, giving rise to Electrocardiogram-Language Models (ELMs). Conditioned on an ECG and a textual query, an ELM autoregressively…

Artificial Intelligence · Computer Science 2025-05-27 William Han , Chaojing Duan , Zhepeng Cen , Yihang Yao , Xiaoyu Song , Atharva Mhaskar , Dylan Leong , Michael A. Rosenberg , Emerson Liu , Ding Zhao

Electrocardiography (ECG) serves as an indispensable diagnostic tool in clinical practice, yet existing multimodal large language models (MLLMs) remain unreliable for ECG interpretation, often producing plausible but clinically incorrect…

Computation and Language · Computer Science 2026-05-26 Jiarui Jin , Haoyu Wang , Xingliang Wu , Xiaocheng Fang , Xiang Lan , Zihan Wang , Deyun Zhang , Bo Liu , Yingying Zhang , Xian Wu , Hongyan Li , Shenda Hong

While Multimodal Large Language Models (MLLMs) show promising performance in automated electrocardiogram interpretation, it remains unclear whether they genuinely perform actual step-by-step reasoning or just rely on superficial visual…

Machine Learning · Computer Science 2026-03-17 Jungwoo Oh , Hyunseung Chung , Junhee Lee , Min-Gyu Kim , Hangyul Yoon , Ki Seong Lee , Youngchae Lee , Muhan Yeo , Edward Choi

Electrocardiogram (ECG) is the primary non-invasive diagnostic tool for monitoring cardiac conditions and is crucial in assisting clinicians. Recent studies have concentrated on classifying cardiac conditions using ECG data but have…

Computation and Language · Computer Science 2025-07-09 Zhongwei Wan , Che Liu , Xin Wang , Chaofan Tao , Hui Shen , Jing Xiong , Rossella Arcucci , Huaxiu Yao , Mi Zhang

Although electrocardiograms (ECG) play a dominant role in cardiovascular diagnosis and treatment, their intrinsic data forms and representational patterns pose significant challenges for medical multimodal large language models (Med-MLLMs)…

Electrocardiogram (ECG) monitoring is one of the most powerful technique of cardiovascular disease (CVD) early identification, and the introduction of intelligent wearable ECG devices has enabled daily monitoring. However, due to the need…

Signal Processing · Electrical Eng. & Systems 2024-03-08 Hongxiang Gao , Xingyao Wang , Zhenghua Chen , Min Wu , Jianqing Li , Chengyu Liu

Electrocardiograms (ECGs) are non-invasive diagnostic tools crucial for detecting cardiac arrhythmic diseases in clinical practice. While ECG Self-supervised Learning (eSSL) methods show promise in representation learning from unannotated…

Signal Processing · Electrical Eng. & Systems 2024-07-03 Che Liu , Zhongwei Wan , Cheng Ouyang , Anand Shah , Wenjia Bai , Rossella Arcucci

While recent multimodal large language models (MLLMs) have advanced automated ECG interpretation, they still face two key limitations: (1) insufficient multimodal synergy between time series signals and visual ECG representations, and (2)…

Computation and Language · Computer Science 2025-10-21 Xiang Lan , Feng Wu , Kai He , Qinghao Zhao , Shenda Hong , Mengling Feng

The advent of multimodal large language models (MLLMs) has sparked interest in their application to electrocardiogram (ECG) analysis. However, existing ECG-focused MLLMs primarily focus on report generation tasks, often limited to single…

Computation and Language · Computer Science 2025-11-13 Haitao Li , Ziyu Li , Yiheng Mao , Ziyi Liu , Zhoujian Sun , Zhengxing Huang

Electroencephalography (EEG) interpretation using multimodal large language models (MLLMs) offers a novel approach for analyzing brain signals. However, the complex nature of brain activity introduces critical challenges: EEG signals…

Signal Processing · Electrical Eng. & Systems 2025-10-02 Ziyi Zeng , Zhenyang Cai , Yixi Cai , Xidong Wang , Junying Chen , Rongsheng Wang , Yipeng Liu , Siqi Cai , Benyou Wang , Zhiguo Zhang , Haizhou Li

Recent advancements in Large Language Models (LLMs) have drawn increasing attention since the learned embeddings pretrained on large-scale datasets have shown powerful ability in various downstream applications. However, whether the learned…

Computation and Language · Computer Science 2023-02-07 Jielin Qiu , William Han , Jiacheng Zhu , Mengdi Xu , Michael Rosenberg , Emerson Liu , Douglas Weber , Ding Zhao

Electrocardiography (ECG) offers critical cardiovascular insights, such as identifying arrhythmias and myocardial ischemia, but enabling automated systems to answer complex clinical questions directly from ECG signals (ECG-QA) remains a…

Signal Processing · Electrical Eng. & Systems 2025-05-13 Hung Manh Pham , Jialu Tang , Aaqib Saeed , Dong Ma

The electrocardiogram (ECG) is the gold standard for non-invasive diagnosis of cardiac pathologies and is a fundamental pillar of cardiovascular medicine. Recent progress in deep learning has led to the development of robust automated…

Electrocardiogram (ECG) analysis plays a vital role in the early detection, monitoring, and management of various cardiovascular conditions. While existing models have achieved notable success in ECG interpretation, they fail to leverage…

Machine Learning · Computer Science 2026-03-05 Yuhao Xu , Xiaoda Wang , Jiaying Lu , Sirui Ding , Defu Cao , Huaxiu Yao , Yan Liu , Xiao Hu , Carl Yang

Electrocardiography (ECG) plays a central role in cardiovascular diagnostics, yet existing automated approaches often struggle to generalize across clinical tasks and offer limited support for open-ended reasoning. We present HeartLLM, a…

Artificial Intelligence · Computer Science 2026-01-27 Jinning Yang , Wenjie Sun , Wen Shi

The rapid advancements in Artificial Intelligence, specifically Machine Learning (ML) and Deep Learning (DL), have opened new prospects in medical sciences for improved diagnosis, prognosis, and treatment of severe health conditions. This…

Machine Learning · Computer Science 2024-12-11 Atit Pokharel , Shashank Dahal , Pratik Sapkota , Bhupendra Bimal Chhetri

Electrocardiograms (ECGs) are among the most widely used diagnostic tools for cardiovascular diseases, and a large amount of ECG data worldwide appears only in image form. However, most existing automated ECG analysis methods rely on access…

Machine Learning · Computer Science 2026-04-03 Hung Manh Pham , Jialu Tang , Aaqib Saeed , Dong Ma , Bin Zhu , Pan Zhou
‹ Prev 1 2 3 10 Next ›