English
Related papers

Related papers: GEMTrans: A General, Echocardiography-based, Multi…

200 papers

Echocardiography is crucial for cardiovascular disease detection but relies heavily on experienced sonographers. Echocardiography probe guidance systems, which provide real-time movement instructions for acquiring standard plane images,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-18 Yang Yue , Yulin Wang , Haojun Jiang , Pan Liu , Shiji Song , Gao Huang

Electrocardiogram (ECG) monitoring is one of the most powerful technique of cardiovascular disease (CVD) early identification, and the introduction of intelligent wearable ECG devices has enabled daily monitoring. However, due to the need…

Signal Processing · Electrical Eng. & Systems 2024-03-08 Hongxiang Gao , Xingyao Wang , Zhenghua Chen , Min Wu , Jianqing Li , Chengyu Liu

Cardiovascular disease is a large worldwide healthcare issue; symptoms often present suddenly with minimal warning. The electrocardiogram (ECG) is a fast, simple and reliable method of evaluating the health of the heart, by measuring…

Signal Processing · Electrical Eng. & Systems 2022-01-15 Yola Jones , Fani Deligianni , Jeff Dalton

Electrocardiogram (ECG) analysis plays a vital role in the early detection, monitoring, and management of various cardiovascular conditions. While existing models have achieved notable success in ECG interpretation, they fail to leverage…

Machine Learning · Computer Science 2026-03-05 Yuhao Xu , Xiaoda Wang , Jiaying Lu , Sirui Ding , Defu Cao , Huaxiu Yao , Yan Liu , Xiao Hu , Carl Yang

Echocardiography (ECHO) video is widely used for cardiac examination. In clinical, this procedure heavily relies on operator experience, which needs years of training and maybe the assistance of deep learning-based systems for enhanced…

Computer Vision and Pattern Recognition · Computer Science 2024-07-08 Xinrui Zhou , Yuhao Huang , Wufeng Xue , Haoran Dou , Jun Cheng , Han Zhou , Dong Ni

Cardiovascular diseases stand as the primary global cause of mortality. Among the various imaging techniques available for visualising the heart and evaluating its function, echocardiograms emerge as the preferred choice due to their safety…

Image and Video Processing · Electrical Eng. & Systems 2023-11-22 Adil Dahlan , Cyril Zakka , Abhinav Kumar , Laura Tang , Rohan Shad , Robyn Fong , William Hiesinger

Multimodal deep learning foundation models can learn the relationship between images and text. In the context of medical imaging, mapping images to language concepts reflects the clinical task of diagnostic image interpretation, however…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Matthew Christensen , Milos Vukadinovic , Neal Yuan , David Ouyang

Echocardiography is the most widely used imaging to monitor cardiac functions, serving as the first line in early detection of myocardial ischemia and infarction. However, echocardiography often suffers from several artifacts including…

Image and Video Processing · Electrical Eng. & Systems 2024-12-10 Ilke Adalioglu , Serkan Kiranyaz , Mete Ahishali , Aysen Degerli , Tahir Hamid , Rahmat Ghaffar , Ridha Hamila , Moncef Gabbouj

Left ventricular ejection fraction (LVEF) assessment depends on echocardiography, limiting access in primary care and resource-constrained settings. We developed a multimodal machine-learning framework that combines engineered 12-lead ECG…

Machine Learning · Computer Science 2026-04-30 Catherine Ning , Yu Ma , Cindy Beini Wang , Sean McMahon , Joseph Radojevic , Steven Zweibel , Dimitris Bertsimas

Cardiac ultrasound (US) scanning is a commonly used techniques in cardiology to diagnose the health of the heart and its proper functioning. Therefore, it is necessary to consider ways to automate these tasks and assist medical…

Electrocardiogram (ECG) interpretation requires specialized expertise, often involving synthesizing insights from ECG signals with complex clinical queries posed in natural language. The scarcity of labeled ECG data coupled with the diverse…

Machine Learning · Computer Science 2025-05-09 Jialu Tang , Tong Xia , Yuan Lu , Cecilia Mascolo , Aaqib Saeed

While Multimodal Large Language Models (MLLMs) show promising performance in automated electrocardiogram interpretation, it remains unclear whether they genuinely perform actual step-by-step reasoning or just rely on superficial visual…

Machine Learning · Computer Science 2026-03-17 Jungwoo Oh , Hyunseung Chung , Junhee Lee , Min-Gyu Kim , Hangyul Yoon , Ki Seong Lee , Youngchae Lee , Muhan Yeo , Edward Choi

Learning spatiotemporal features is an important task for efficient video understanding especially in medical images such as echocardiograms. Convolutional neural networks (CNNs) and more recent vision transformers (ViTs) are the most…

Computer Vision and Pattern Recognition · Computer Science 2022-09-12 Rand Muhtaseb , Mohammad Yaqub

Electrocardiography (ECG) serves as an indispensable diagnostic tool in clinical practice, yet existing multimodal large language models (MLLMs) remain unreliable for ECG interpretation, often producing plausible but clinically incorrect…

Computation and Language · Computer Science 2026-05-26 Jiarui Jin , Haoyu Wang , Xingliang Wu , Xiaocheng Fang , Xiang Lan , Zihan Wang , Deyun Zhang , Bo Liu , Yingying Zhang , Xian Wu , Hongyan Li , Shenda Hong

Conventional task-specific electrocardiogram (ECG) analysis models require large annotated datasets to train. Foundation models mitigate this burden by leveraging self-supervised pretraining; however, the scarcity of open-weight ECG…

Machine Learning · Computer Science 2025-06-02 Kaden McKeen , Sameer Masood , Augustin Toma , Barry Rubin , Bo Wang

Electrocardiography (ECG) analysis is crucial for cardiac diagnosis, yet existing foundation models often fail to capture the periodicity and diverse features required for varied clinical tasks. We propose ECG-MoE, a hybrid architecture…

Artificial Intelligence · Computer Science 2026-03-06 Yuhao Xu , Xiaoda Wang , Yi Wu , Wei Jin , Xiao Hu , Carl Yang

Echocardiography is a cornerstone for managing heart failure (HF), with Left Ventricular Ejection Fraction (LVEF) being a critical metric for guiding therapy. However, manual LVEF assessment suffers from high inter-observer variability,…

Image and Video Processing · Electrical Eng. & Systems 2026-05-26 Jyun-Ping Kao , Jiaxin Yang , C. -C. Jay Kuo , Jonghye Woo

Synthetic data generation represents a significant advancement in boosting the performance of machine learning (ML) models, particularly in fields where data acquisition is challenging, such as echocardiography. The acquisition and labeling…

Machine Learning · Computer Science 2025-08-28 Nima Kondori , Hanwen Liang , Hooman Vaseli , Bingyu Xie , Christina Luong , Purang Abolmaesumi , Teresa Tsang , Renjie Liao

The electrocardiogram (ECG) is an essential non-invasive diagnostic tool for assessing cardiac conditions. Existing automatic interpretation methods suffer from limited generalizability, focusing on a narrow range of cardiac conditions, and…

Image and Video Processing · Electrical Eng. & Systems 2024-10-28 Ruoqi Liu , Yuelin Bai , Xiang Yue , Ping Zhang

Recent advances have increasingly applied large language models (LLMs) to electrocardiogram (ECG) interpretation, giving rise to Electrocardiogram-Language Models (ELMs). Conditioned on an ECG and a textual query, an ELM autoregressively…

Artificial Intelligence · Computer Science 2025-05-27 William Han , Chaojing Duan , Zhepeng Cen , Yihang Yao , Xiaoyu Song , Atharva Mhaskar , Dylan Leong , Michael A. Rosenberg , Emerson Liu , Ding Zhao