中文
相关论文

相关论文: Multimodal Foundation Models For Echocardiogram In…

200 篇论文

Automated interpretation of electrocardiograms (ECG) has garnered significant attention with the advancements in machine learning methodologies. Despite the growing interest, most current studies focus solely on classification or regression…

信号处理 · 电气工程与系统科学 2023-11-07 Jielin Qiu , Jiacheng Zhu , Shiqi Liu , William Han , Jingqi Zhang , Chaojing Duan , Michael Rosenberg , Emerson Liu , Douglas Weber , Ding Zhao

Training specific deep learning models for particular tasks is common across various domains within seismology. However, this approach encounters two limitations: inadequate labeled data for certain tasks and limited generalization across…

地球物理 · 物理学 2023-09-06 Xu Si , Xinming Wu , Hanlin Sheng , Jun Zhu , Zefeng Li

Cardiac amyloidosis, a rare and highly morbid condition, presents significant challenges for detection through echocardiography. Recently, there has been a surge in proposing machine-learning algorithms to identify cardiac amyloidosis, with…

图像与视频处理 · 电气工程与系统科学 2024-06-10 Zishun Feng , Joseph A. Sivak , Ashok K. Krishnamurthy

Contrastive pretraining of image-text foundation models, such as CLIP, demonstrated excellent zero-shot performance and improved robustness on a wide range of downstream tasks. However, these models utilize large transformer-based encoders…

计算机视觉与模式识别 · 计算机科学 2024-04-02 Pavan Kumar Anasosalu Vasu , Hadi Pouransari , Fartash Faghri , Raviteja Vemulapalli , Oncel Tuzel

Foundation models hold promise for specialized medical imaging tasks, though their effectiveness in breast imaging remains underexplored. This study leverages BiomedCLIP as a foundation model to address challenges in model generalization.…

Foundation models are reshaping medical imaging, yet their application in echocardiography remains limited, hindered by a heavy reliance on private datasets that prevent reproducible comparison. Echocardiography poses unique challenges,…

计算机视觉与模式识别 · 计算机科学 2026-05-21 Darya Taratynova , Ahmed Aly , Numan Saeed , Mohammad Yaqub

Cardiovascular diseases stand as the primary global cause of mortality. Among the various imaging techniques available for visualising the heart and evaluating its function, echocardiograms emerge as the preferred choice due to their safety…

图像与视频处理 · 电气工程与系统科学 2023-11-22 Adil Dahlan , Cyril Zakka , Abhinav Kumar , Laura Tang , Rohan Shad , Robyn Fong , William Hiesinger

Although the heart has complex three-dimensional (3D) anatomy, conventional medical imaging with cardiac ultrasound relies on a series of 2D videos showing individual cardiac structures. 3D echocardiography is a developing modality that now…

计算机视觉与模式识别 · 计算机科学 2025-11-24 Milos Vukadinovic , Hirotaka Ieki , Yuki Sahashi , David Ouyang , Bryan He

Artificial intelligence (AI) that can effectively learn ultrasound representations by integrating multi-source data holds significant promise for advancing clinical care. However, the scarcity of large labeled datasets in real-world…

Recent advances in vision-language models have enabled rich semantic understanding across modalities. However, these encoding methods lack the ability to interpret or reason about the moral dimensions of content-a crucial aspect of human…

计算机视觉与模式识别 · 计算机科学 2025-10-31 Ana Carolina Condez , Diogo Tavares , João Magalhães

Deep learning methods have demonstrated promising results in predicting BI-RADS scores from mammography images. However, the interpretation of these images can vary, leading to discrepancies even among radiologists. Given the inherent…

计算机视觉与模式识别 · 计算机科学 2026-05-20 Halil Ibrahim Gulluk , Olivier Gevaert

Vision-language pretraining models have achieved great success in supporting multimedia applications by understanding the alignments between images and text. While existing vision-language pretraining models primarily focus on understanding…

计算机视觉与模式识别 · 计算机科学 2024-04-29 Fuxiao Liu , Hao Tan , Chris Tensmeyer

Cardiac biosignals, such as electrocardiograms (ECG) and photoplethysmograms (PPG), are of paramount importance for the diagnosis, prevention, and management of cardiovascular diseases, and have been extensively used in a variety of…

Electrocardiography (ECG) is central to cardiovascular care, but conventional AI models are often restricted to common arrhythmias and may generalize poorly across populations or clinically subtle diseases. We developed ECG Contrastive…

Foundation models for echocardiography often struggle to disentangle anatomical signal from the stochastic speckle and acquisition artifacts inherent to ultrasound. We present EchoJEPA, a foundation model trained on 18 million…

Medical image analysis increasingly relies on the integration of multiple imaging modalities to capture complementary anatomical and functional information, enabling more accurate diagnosis and treatment planning. Achieving aligned feature…

图像与视频处理 · 电气工程与系统科学 2025-09-04 Yunhao Liu , Suyang Xi , Shiqi Liu , Hong Ding , Chicheng Jin , Chong Zhong , Junjun He , Catherine C. Liu , Yiqing Shen

Echocardiography (echo) is an ultrasound imaging modality that is widely used for various cardiovascular diagnosis tasks. Due to inter-observer variability in echo-based diagnosis, which arises from the variability in echo image acquisition…

计算机视觉与模式识别 · 计算机科学 2023-08-28 Masoud Mokhtari , Neda Ahmadi , Teresa S. M. Tsang , Purang Abolmaesumi , Renjie Liao

We introduce eCLIP, an enhanced version of the CLIP model that integrates expert annotations in the form of radiologist eye-gaze heatmaps. It tackles key challenges in contrastive multi-modal medical imaging analysis, notably data scarcity…

计算机视觉与模式识别 · 计算机科学 2024-07-16 Yogesh Kumar , Pekka Marttinen

In the process of patient diagnosis, non-invasive measurements are widely used due to their low risks and quick results. Electrocardiogram (ECG), as a non-invasive method to collect heart activities, is used to diagnose cardiac conditions.…

机器学习 · 计算机科学 2025-12-11 Yuhao Xu , Jiaying Lu , Sirui Ding , Defu Cao , Xiao Hu , Carl Yang

Most existing semantic communication (SemCom) systems use deep joint source-channel coding (DeepJSCC) to encode task-specific semantics in a goal-oriented manner. However, their reliance on predefined tasks and datasets significantly limits…

信号处理 · 电气工程与系统科学 2025-05-30 Jiangjing Hu , Haotian Wu , Wenjing Zhang , Fengyu Wang , Wenjun Xu , Hui Gao , Deniz Gündüz