English
Related papers

Related papers: Multimodal Foundation Models For Echocardiogram In…

200 papers

Automated interpretation of electrocardiograms (ECG) has garnered significant attention with the advancements in machine learning methodologies. Despite the growing interest, most current studies focus solely on classification or regression…

Signal Processing · Electrical Eng. & Systems 2023-11-07 Jielin Qiu , Jiacheng Zhu , Shiqi Liu , William Han , Jingqi Zhang , Chaojing Duan , Michael Rosenberg , Emerson Liu , Douglas Weber , Ding Zhao

Training specific deep learning models for particular tasks is common across various domains within seismology. However, this approach encounters two limitations: inadequate labeled data for certain tasks and limited generalization across…

Geophysics · Physics 2023-09-06 Xu Si , Xinming Wu , Hanlin Sheng , Jun Zhu , Zefeng Li

Cardiac amyloidosis, a rare and highly morbid condition, presents significant challenges for detection through echocardiography. Recently, there has been a surge in proposing machine-learning algorithms to identify cardiac amyloidosis, with…

Image and Video Processing · Electrical Eng. & Systems 2024-06-10 Zishun Feng , Joseph A. Sivak , Ashok K. Krishnamurthy

Contrastive pretraining of image-text foundation models, such as CLIP, demonstrated excellent zero-shot performance and improved robustness on a wide range of downstream tasks. However, these models utilize large transformer-based encoders…

Computer Vision and Pattern Recognition · Computer Science 2024-04-02 Pavan Kumar Anasosalu Vasu , Hadi Pouransari , Fartash Faghri , Raviteja Vemulapalli , Oncel Tuzel

Foundation models hold promise for specialized medical imaging tasks, though their effectiveness in breast imaging remains underexplored. This study leverages BiomedCLIP as a foundation model to address challenges in model generalization.…

Foundation models are reshaping medical imaging, yet their application in echocardiography remains limited, hindered by a heavy reliance on private datasets that prevent reproducible comparison. Echocardiography poses unique challenges,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Darya Taratynova , Ahmed Aly , Numan Saeed , Mohammad Yaqub

Cardiovascular diseases stand as the primary global cause of mortality. Among the various imaging techniques available for visualising the heart and evaluating its function, echocardiograms emerge as the preferred choice due to their safety…

Image and Video Processing · Electrical Eng. & Systems 2023-11-22 Adil Dahlan , Cyril Zakka , Abhinav Kumar , Laura Tang , Rohan Shad , Robyn Fong , William Hiesinger

Although the heart has complex three-dimensional (3D) anatomy, conventional medical imaging with cardiac ultrasound relies on a series of 2D videos showing individual cardiac structures. 3D echocardiography is a developing modality that now…

Computer Vision and Pattern Recognition · Computer Science 2025-11-24 Milos Vukadinovic , Hirotaka Ieki , Yuki Sahashi , David Ouyang , Bryan He

Artificial intelligence (AI) that can effectively learn ultrasound representations by integrating multi-source data holds significant promise for advancing clinical care. However, the scarcity of large labeled datasets in real-world…

Recent advances in vision-language models have enabled rich semantic understanding across modalities. However, these encoding methods lack the ability to interpret or reason about the moral dimensions of content-a crucial aspect of human…

Computer Vision and Pattern Recognition · Computer Science 2025-10-31 Ana Carolina Condez , Diogo Tavares , João Magalhães

Deep learning methods have demonstrated promising results in predicting BI-RADS scores from mammography images. However, the interpretation of these images can vary, leading to discrepancies even among radiologists. Given the inherent…

Computer Vision and Pattern Recognition · Computer Science 2026-05-20 Halil Ibrahim Gulluk , Olivier Gevaert

Vision-language pretraining models have achieved great success in supporting multimedia applications by understanding the alignments between images and text. While existing vision-language pretraining models primarily focus on understanding…

Computer Vision and Pattern Recognition · Computer Science 2024-04-29 Fuxiao Liu , Hao Tan , Chris Tensmeyer

Cardiac biosignals, such as electrocardiograms (ECG) and photoplethysmograms (PPG), are of paramount importance for the diagnosis, prevention, and management of cardiovascular diseases, and have been extensively used in a variety of…

Electrocardiography (ECG) is central to cardiovascular care, but conventional AI models are often restricted to common arrhythmias and may generalize poorly across populations or clinically subtle diseases. We developed ECG Contrastive…

Foundation models for echocardiography often struggle to disentangle anatomical signal from the stochastic speckle and acquisition artifacts inherent to ultrasound. We present EchoJEPA, a foundation model trained on 18 million…

Medical image analysis increasingly relies on the integration of multiple imaging modalities to capture complementary anatomical and functional information, enabling more accurate diagnosis and treatment planning. Achieving aligned feature…

Image and Video Processing · Electrical Eng. & Systems 2025-09-04 Yunhao Liu , Suyang Xi , Shiqi Liu , Hong Ding , Chicheng Jin , Chong Zhong , Junjun He , Catherine C. Liu , Yiqing Shen

Echocardiography (echo) is an ultrasound imaging modality that is widely used for various cardiovascular diagnosis tasks. Due to inter-observer variability in echo-based diagnosis, which arises from the variability in echo image acquisition…

Computer Vision and Pattern Recognition · Computer Science 2023-08-28 Masoud Mokhtari , Neda Ahmadi , Teresa S. M. Tsang , Purang Abolmaesumi , Renjie Liao

We introduce eCLIP, an enhanced version of the CLIP model that integrates expert annotations in the form of radiologist eye-gaze heatmaps. It tackles key challenges in contrastive multi-modal medical imaging analysis, notably data scarcity…

Computer Vision and Pattern Recognition · Computer Science 2024-07-16 Yogesh Kumar , Pekka Marttinen

In the process of patient diagnosis, non-invasive measurements are widely used due to their low risks and quick results. Electrocardiogram (ECG), as a non-invasive method to collect heart activities, is used to diagnose cardiac conditions.…

Machine Learning · Computer Science 2025-12-11 Yuhao Xu , Jiaying Lu , Sirui Ding , Defu Cao , Xiao Hu , Carl Yang

Most existing semantic communication (SemCom) systems use deep joint source-channel coding (DeepJSCC) to encode task-specific semantics in a goal-oriented manner. However, their reliance on predefined tasks and datasets significantly limits…

Signal Processing · Electrical Eng. & Systems 2025-05-30 Jiangjing Hu , Haotian Wu , Wenjing Zhang , Fengyu Wang , Wenjun Xu , Hui Gao , Deniz Gündüz