English
Related papers

Related papers: EchoVLM: Measurement-Grounded Multimodal Learning …

200 papers

Multimodal deep learning foundation models can learn the relationship between images and text. In the context of medical imaging, mapping images to language concepts reflects the clinical task of diagnostic image interpretation, however…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Matthew Christensen , Milos Vukadinovic , Neal Yuan , David Ouyang

Echocardiography records ultrasound videos of the heart, enabling clinicians to assess cardiac function. Recent advances in large-scale vision-language models (VLMs) have spurred interest in automating echocardiographic interpretation.…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Ryo Takizawa , Satoshi Kodera , Tempei Kabayama , Ryo Matsuoka , Yuta Ando , Yuto Nakamura , Haruki Settai , Norihiko Takeda

Echocardiography is the most widely used cardiac imaging modality, capturing ultrasound video data to assess cardiac structure and function. Artificial intelligence (AI) in echocardiography has the potential to streamline manual tasks and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Milos Vukadinovic , Xiu Tang , Neal Yuan , Paul Cheng , Debiao Li , Susan Cheng , Bryan He , David Ouyang

Foundation models have recently gained significant attention because of their generalizability and adaptability across multiple tasks and data distributions. Although medical foundation models have emerged, solutions for cardiac imaging,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-30 Sekeun Kim , Pengfei Jin , Sifan Song , Cheng Chen , Yiwei Li , Hui Ren , Xiang Li , Tianming Liu , Quanzheng Li

Ultrasound imaging has become the preferred imaging modality for early cancer screening due to its advantages of non-ionizing radiation, low cost, and real-time imaging capabilities. However, conventional ultrasound diagnosis heavily relies…

Computer Vision and Pattern Recognition · Computer Science 2026-04-20 Chaoyin She , Ruifang Lu , Lida Chen , Wei Wang , Qinghua Huang

Echocardiography is crucial for cardiovascular disease detection but relies heavily on experienced sonographers. Echocardiography probe guidance systems, which provide real-time movement instructions for acquiring standard plane images,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-18 Yang Yue , Yulin Wang , Haojun Jiang , Pan Liu , Shiji Song , Gao Huang

Automated interpretation of electrocardiograms (ECG) has garnered significant attention with the advancements in machine learning methodologies. Despite the growing interest, most current studies focus solely on classification or regression…

Signal Processing · Electrical Eng. & Systems 2023-11-07 Jielin Qiu , Jiacheng Zhu , Shiqi Liu , William Han , Jingqi Zhang , Chaojing Duan , Michael Rosenberg , Emerson Liu , Douglas Weber , Ding Zhao

Despite the promise of foundation models in medical AI, current systems remain limited - they are modality-specific and lack transparent reasoning processes, hindering clinical adoption. To address this gap, we present EVLF-FM, a multimodal…

Electrocardiogram (ECG) interpretation requires specialized expertise, often involving synthesizing insights from ECG signals with complex clinical queries posed in natural language. The scarcity of labeled ECG data coupled with the diverse…

Machine Learning · Computer Science 2025-05-09 Jialu Tang , Tong Xia , Yuan Lu , Cecilia Mascolo , Aaqib Saeed

Early detection of eye diseases like glaucoma, macular degeneration, and diabetic retinopathy is crucial for preventing vision loss. While artificial intelligence (AI) foundation models hold significant promise for addressing these…

Computer Vision and Pattern Recognition · Computer Science 2024-09-12 Danli Shi , Weiyi Zhang , Jiancheng Yang , Siyu Huang , Xiaolan Chen , Mayinuer Yusufu , Kai Jin , Shan Lin , Shunming Liu , Qing Zhang , Mingguang He

Purpose: Echocardiographic interpretation requires video-level reasoning and guideline-based measurement analysis, which current deep learning models for cardiac ultrasound do not support. We present EchoAgent, a framework that enables…

Foundation models have demonstrated remarkable potential in medical domain. However, their application to complex cardiovascular diagnostics remains underexplored. In this paper, we present Cardiac-CLIP, a multi-modal foundation model…

Electrocardiography (ECG) is central to cardiovascular care, but conventional AI models are often restricted to common arrhythmias and may generalize poorly across populations or clinically subtle diseases. We developed ECG Contrastive…

Quantitative evaluation of echocardiography is essential for precise assessment of cardiac condition, monitoring disease progression, and guiding treatment decisions. The diverse nature of echo images, including variations in probe types,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Abdoul Aziz Amadou , Yue Zhang , Sebastien Piat , Paul Klein , Ingo Schmuecking , Tiziano Passerini , Puneet Sharma

Echocardiography (echo) is an ultrasound imaging modality that is widely used for various cardiovascular diagnosis tasks. Due to inter-observer variability in echo-based diagnosis, which arises from the variability in echo image acquisition…

Computer Vision and Pattern Recognition · Computer Science 2023-08-28 Masoud Mokhtari , Neda Ahmadi , Teresa S. M. Tsang , Purang Abolmaesumi , Renjie Liao

While Multimodal Large Language Models (MLLMs) show promising performance in automated electrocardiogram interpretation, it remains unclear whether they genuinely perform actual step-by-step reasoning or just rely on superficial visual…

Machine Learning · Computer Science 2026-03-17 Jungwoo Oh , Hyunseung Chung , Junhee Lee , Min-Gyu Kim , Hangyul Yoon , Ki Seong Lee , Youngchae Lee , Muhan Yeo , Edward Choi

Echocardiographic diagnosis is vital for cardiac screening yet remains challenging. Existing echocardiography foundation models do not effectively capture the relationships between quantitative measurements and clinical manifestations,…

Computer Vision and Pattern Recognition · Computer Science 2026-01-14 Yi Qin , Lehan Wang , Chenxu Zhao , Alex P. W. Lee , Xiaomeng Li

Vision-Language Models (VLMs) have demonstrated remarkable capabilities in aligning and understanding multimodal signals, yet their potential to reason over structured data, where multimodal entities are connected through explicit…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Jiajin Liu , Dongzhe Fan , Chuanhao Ji , Daochen Zha , Qiaoyu Tan

Artificial intelligence (AI) shows great potential in assisting radiologists to improve the efficiency and accuracy of medical image interpretation and diagnosis. However, a versatile AI model requires large-scale data and comprehensive…

Computer Vision and Pattern Recognition · Computer Science 2025-01-27 Zhongyi Shui , Jianpeng Zhang , Weiwei Cao , Sinuo Wang , Ruizhe Guo , Le Lu , Lin Yang , Xianghua Ye , Tingbo Liang , Qi Zhang , Ling Zhang

Echocardiography plays an important role in the screening and diagnosis of cardiovascular diseases. However, automated intelligent analysis of echocardiographic data remains challenging due to complex cardiac dynamics and strong view…

Computer Vision and Pattern Recognition · Computer Science 2026-04-09 Peng Huang , Yiming Wang , Yineng Chen , Liangqiao Gui , Hui Guo , Bo Peng , Shu Hu , Xi Wu , Tsao Connie , Hongtu Zhu , Balakrishnan Prabhakaran , Xin Wang
‹ Prev 1 2 3 10 Next ›