English
Related papers

Related papers: Teach Multimodal LLMs to Comprehend Electrocardiog…

200 papers

Electrocardiography (ECG) is a low-cost, widely used modality for diagnosing electrical abnormalities like atrial fibrillation by capturing the heart's electrical activity. However, it cannot directly measure cardiac morphological…

Machine Learning · Computer Science 2026-03-10 Michelle Espranita Liman , Özgün Turgut , Alexander Müller , Eimo Martens , Daniel Rueckert , Philip Müller

High-fidelity ECG interpretation is increasingly reliant on massive foundation models, yet their deployment in clinical edge-care remains hindered by extreme computational demands. While knowledge distillation (KD) is a promising solution,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-29 Dang Hong Nguyen , Nhi Ngoc-Yen Nguyen , Huy-Hieu Pham

Emotional Recognition in Conversation (ERC) is valuable for diagnosing health conditions such as autism and depression, and for understanding the emotions of individuals who struggle to express their feelings. Current ERC methods primarily…

Human-Computer Interaction · Computer Science 2026-05-06 Zijian Kang , Yueyang Li , Shengyu Gong , Weiming Zeng , Hongjie Yan , Lingbin Bian , Zhiguo Zhang , Wai Ting Siok , Nizhuan Wang

Electrocardiogram (ECG) signal is one of the most effective sources of information mainly employed for the diagnosis and prediction of cardiovascular diseases (CVDs) connected with the abnormalities in heart rhythm. Clearly, single modality…

Signal Processing · Electrical Eng. & Systems 2022-10-13 Thinh Phan , Duc Le , Patel Brijesh , Donald Adjeroh , Jingxian Wu , Morten Olgaard Jensen , Ngan Le

Label ambiguity is an inherent problem in real-world electrocardiogram (ECG) diagnosis, arising from overlapping conditions and diagnostic disagreement. However, current ECG models are trained under the assumption of clean and non-ambiguous…

Machine Learning · Computer Science 2025-12-15 Sana Rahmani , Javad Hashemi , Ali Etemad

Unvoiced electromyography (EMG) is an effective communication tool for individuals unable to produce vocal speech. However, most prior methods rely on paired voiced and unvoiced EMG signals, along with speech data, for EMG-to-text…

Computation and Language · Computer Science 2025-06-03 Payal Mohapatra , Akash Pandey , Xiaoyuan Zhang , Qi Zhu

Cardiovascular diseases (CVDs) remain the leading cause of mortality worldwide, highlighting the critical need for efficient and accurate diagnostic tools. Electrocardiograms (ECGs) are indispensable in diagnosing various heart conditions;…

Signal Processing · Electrical Eng. & Systems 2025-04-24 Lei Kang , Xuanshuo Fu , Javier Vazquez-Corral , Ernest Valveny , Dimosthenis Karatzas

Multi-modal large language models (MLLMs) have demonstrated remarkable success in vision and visual-language tasks within the natural image domain. Owing to the significant diversities between the natural and remote sensing (RS) images, the…

Computer Vision and Pattern Recognition · Computer Science 2024-03-11 Wei Zhang , Miaoxin Cai , Tong Zhang , Yin Zhuang , Xuerui Mao

Electrocardiography (ECG) is the clinical gold standard for cardiovascular disease (CVD) assessment, yet continuous monitoring is constrained by the need for dedicated hardware and trained personnel. Photoplethysmography (PPG) is ubiquitous…

Machine Learning · Computer Science 2026-01-22 Xiaocheng Fang , Jiarui Jin , Haoyu Wang , Che Liu , Jieyi Cai , Yujie Xiao , Guangkun Nie , Bo Liu , Shun Huang , Hongyan Li , Shenda Hong

Continuous monitoring of cardiac activity is paramount to understanding the functioning of the heart in addition to identifying precursors to conditions such as Atrial Fibrillation. Through continuous cardiac monitoring, early indications…

Machine Learning · Computer Science 2020-10-13 Prithvi Suresh , Naveen Narayanan , Chakilam Vijay Pranav , Vineeth Vijayaraghavan

In the evolving landscape of ECG signal analysis, the challenge of limited transparency in machine learning models remains a significant barrier to their effective integration into clinical practice. This study addresses this issue by…

Signal Processing · Electrical Eng. & Systems 2024-12-09 Toygar Tanyel , Sezgin Atmaca , Kaan Gökçe , M. Yiğit Balık , Arda Güler , Emre Aslanger , İlkay Öksüz

In real-world clinical practice, electrocardiograms (ECGs) are often captured and shared as photographs. However, publicly available ECG data, and thus most related research, relies on digital signals. This has led to a disconnect in which…

Computer Vision and Pattern Recognition · Computer Science 2025-12-25 Xiaoyu Wang , Ramesh Nadarajah , Zhiqiang Zhang , David Wong

Recently, Multimodal Large Language Models (MLLMs) have sparked great research interests owing to their exceptional content-reasoning and instruction-following capabilities. To effectively instruct an MLLM, in addition to conventional…

Computer Vision and Pattern Recognition · Computer Science 2024-09-27 Jiacheng Zhang , Yang Jiao , Shaoxiang Chen , Jingjing Chen , Yu-Gang Jiang

Domain-adapted open-weight large language models (LLMs) offer promising healthcare applications, from queryable knowledge bases to multimodal assistants, with the crucial advantage of local deployment for privacy preservation. However,…

Computation and Language · Computer Science 2025-10-22 Lara Ahrens , Wilhelm Haverkamp , Nils Strodthoff

Accurate peak detection across diverse cardiac physiological signals, including the Electrocardiogram (ECG), Photoplethysmogram (PPG), Ballistocardiogram (BCG), and Bodyseismography (BSG), is fundamental for cardiovascular monitoring but is…

Cardiovascular diseases (CVDs) are a group of heart and blood vessel disorders that is one of the most serious dangers to human health, and the number of such patients is still growing. Early and accurate detection plays a key role in…

Computer Vision and Pattern Recognition · Computer Science 2026-02-17 Khiem H. Le , Hieu H. Pham , Thao BT. Nguyen , Tu A. Nguyen , Tien N. Thanh , Cuong D. Do

Echocardiography (ECHO) is essential for cardiac assessments, but its video quality and interpretation heavily relies on manual expertise, leading to inconsistent results from clinical and portable devices. ECHO video generation offers a…

Image and Video Processing · Electrical Eng. & Systems 2024-10-15 Yiwei Li , Sekeun Kim , Zihao Wu , Hanqi Jiang , Yi Pan , Pengfei Jin , Sifan Song , Yucheng Shi , Tianming Liu , Quanzheng Li , Xiang Li

Analyzing electrocardiography (ECG) data is essential for diagnosing and monitoring various heart diseases. The clinical adoption of automated methods requires accurate confidence measurements, which are largely absent from existing…

The performances of commonly used electrocardiogram (ECG) diagnosis models have recently improved with the introduction of deep learning (DL). However, the impact of various combinations of multiple DL components and/or the role of data…

Signal Processing · Electrical Eng. & Systems 2022-08-02 Jae-Won Choi , Dae-Yong Hong , Chan Jung , Eugene Hwang , Sung-Hyuk Park , Seung-Young Roh

This paper presents a computational solution that enables continuous cardiac monitoring through cross-modality inference of electrocardiogram (ECG). While some smartwatches now allow users to obtain a 30-second ECG test by tapping a…

Signal Processing · Electrical Eng. & Systems 2024-05-20 Yuenan Li , Xin Tian , Qiang Zhu , Min Wu