English
Related papers

Related papers: EchoFM: Foundation Model for Generalizable Echocar…

200 papers

In echocardiography (echo), an electrocardiogram (ECG) is conventionally used to temporally align different cardiac views for assessing critical measurements. However, in emergencies or point-of-care situations, acquiring an ECG is often…

Computer Vision and Pattern Recognition · Computer Science 2021-02-05 Fatemeh Taheri Dezaki , Christina Luong , Tom Ginsberg , Robert Rohling , Ken Gin , Purang Abolmaesumi , Teresa Tsang

Foundation models have demonstrated remarkable potential in medical domain. However, their application to complex cardiovascular diagnostics remains underexplored. In this paper, we present Cardiac-CLIP, a multi-modal foundation model…

Echocardiography video is a primary modality for diagnosing heart diseases, but the limited data poses challenges for both clinical teaching and machine learning training. Recently, video generative models have emerged as a promising…

Image and Video Processing · Electrical Eng. & Systems 2024-08-01 Junxuan Yu , Rusi Chen , Yongsong Zhou , Yanlin Chen , Yaofei Duan , Yuhao Huang , Han Zhou , Tan Tao , Xin Yang , Dong Ni

Electroencephalography foundation models (EEG-FMs) have advanced brain signal analysis, but the lack of standardized evaluation benchmarks impedes model comparison and scientific progress. Current evaluations rely on inconsistent protocols…

Signal Processing · Electrical Eng. & Systems 2026-02-16 Wei Xiong , Jiangtong Li , Jie Li , Kun Zhu , Changjun Jiang

Echocardiography is widely used for assessing cardiac function, where clinically meaningful parameters such as left-ventricular ejection fraction (EF) play a central role in diagnosis and management. Generative models capable of…

Image and Video Processing · Electrical Eng. & Systems 2026-03-17 Emmanuel Oladokun , Sarina Thomas , Jurica Šprem , Vicente Grau

Electroencephalography (EEG) analysis stands at the forefront of neuroscience and artificial intelligence research, where foundation models are reshaping the traditional EEG analysis paradigm by leveraging their powerful representational…

Human-Computer Interaction · Computer Science 2025-08-25 Hongqi Li , Yitong Chen , Yujuan Wang , Weihang Ni , Haodong Zhang

Electrocardiogram (ECG) is a widely used tool for assessing cardiac function due to its low cost and accessibility. Emergent research shows that ECGs can help make predictions on key outcomes traditionally derived from more complex…

Computer Vision and Pattern Recognition · Computer Science 2025-10-01 Yuan Gao , Sangwook Kim , Chris McIntosh

Artificial intelligence (AI) has demonstrated significant potential in ECG analysis and cardiovascular disease assessment. Recently, foundation models have played a remarkable role in advancing medical AI. The development of an ECG…

Machine Learning · Computer Science 2025-08-05 Jun Li , Aaron Aguirre , Junior Moura , Che Liu , Lanhai Zhong , Chenxi Sun , Gari Clifford , Brandon Westover , Shenda Hong

We evaluate the video understanding capabilities of existing foundation models (FMs) using a carefully designed experiment protocol consisting of three hallmark tasks (action recognition,temporal localization, and spatiotemporal…

In clinical practice of echocardiography examinations, multiple planes containing the heart structures of different view are usually required in screening, diagnosis and treatment of cardiac disease. AI models for echocardiography have to…

Computer Vision and Pattern Recognition · Computer Science 2025-04-10 Jiongtong Hu , Wei Zhuo , Jun Cheng , Yingying Liu , Wufeng Xue , Dong Ni

Foundation models (FMs) are changing the way medical images are analyzed by learning from large collections of unlabeled data. Instead of relying on manually annotated examples, FMs are pre-trained to learn general-purpose visual features…

Electroencephalography provides a non-invasive window into brain activity, offering valuable insights for neurological research, brain-computer interfaces, and clinical diagnostics. However, the development of robust machine learning models…

Signal Processing · Electrical Eng. & Systems 2025-02-26 Chi-Sheng Chen , Ying-Jung Chen , Aidan Hung-Wen Tsai

Cryo-electron microscopy (cryo-EM) is a powerful technique in structural biology and drug discovery, enabling the study of biomolecules at high resolution. Significant advancements by structural biologists using cryo-EM have led to the…

Biomolecules · Quantitative Biology 2024-12-05 Yi Zhou , Yilai Li , Jing Yuan , Quanquan Gu

Video Foundation Models (ViFMs) aim to learn a general-purpose representation for various video understanding tasks. Leveraging large-scale datasets and powerful models, ViFMs achieve this by capturing robust and generic features from video…

Computer Vision and Pattern Recognition · Computer Science 2024-05-08 Neelu Madan , Andreas Moegelmose , Rajat Modi , Yogesh S. Rawat , Thomas B. Moeslund

Echocardiography is a vital non-invasive modality for cardiac assessment, with left ventricular ejection fraction (LVEF) serving as a key indicator of heart function. Existing LVEF estimation methods depend on large-scale annotated video…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Yao Du , Jiarong Guo , Xiaomeng Li

Foundation models are becoming increasingly effective in the medical domain, offering pre-trained models on large datasets that can be readily adapted for downstream tasks. Despite progress, fetal ultrasound images remain a challenging…

Foundation models or pre-trained models have substantially improved the performance of various language, vision, and vision-language understanding tasks. However, existing foundation models can only perform the best in one type of tasks,…

Computer Vision and Pattern Recognition · Computer Science 2023-10-18 Xinsong Zhang , Yan Zeng , Jipeng Zhang , Hang Li

Electrocardiography (ECG) is a low-cost, widely used modality for diagnosing electrical abnormalities like atrial fibrillation by capturing the heart's electrical activity. However, it cannot directly measure cardiac morphological…

Machine Learning · Computer Science 2026-03-10 Michelle Espranita Liman , Özgün Turgut , Alexander Müller , Eimo Martens , Daniel Rueckert , Philip Müller

Electroencephalogram (EEG) signals play a crucial role in understanding brain activity and diagnosing neurological diseases. Because supervised EEG encoders are unable to learn robust EEG patterns and rely too heavily on expensive signal…

Machine Learning · Computer Science 2025-09-23 Junhong Lai , Jiyu Wei , Lin Yao , Yueming Wang

Echocardiography (ECHO) is essential for cardiac assessments, but its video quality and interpretation heavily relies on manual expertise, leading to inconsistent results from clinical and portable devices. ECHO video generation offers a…

Image and Video Processing · Electrical Eng. & Systems 2024-10-15 Yiwei Li , Sekeun Kim , Zihao Wu , Hanqi Jiang , Yi Pan , Pengfei Jin , Sifan Song , Yucheng Shi , Tianming Liu , Quanzheng Li , Xiang Li