English
Related papers

Related papers: EchoJEPA: A Latent Predictive Foundation Model for…

200 papers

We introduce Brain-JEPA, a brain dynamics foundation model with the Joint-Embedding Predictive Architecture (JEPA). This pioneering model achieves state-of-the-art performance in demographic prediction, disease diagnosis/prognosis, and…

In the process of patient diagnosis, non-invasive measurements are widely used due to their low risks and quick results. Electrocardiogram (ECG), as a non-invasive method to collect heart activities, is used to diagnose cardiac conditions.…

Machine Learning · Computer Science 2025-12-11 Yuhao Xu , Jiaying Lu , Sirui Ding , Defu Cao , Xiao Hu , Carl Yang

Listening to heart and lung sounds - auscultation - is one of the first and most fundamental steps in a clinical examination. Despite being fast and non-invasive, it demands years of experience to interpret subtle audio cues. Recent deep…

Machine Learning · Computer Science 2026-03-03 Yishan Wang , Tsai-Ning Wang , Mathias Funk , Aaqib Saeed

This paper explores feature prediction as a stand-alone objective for unsupervised learning from video and introduces V-JEPA, a collection of vision models trained solely using a feature prediction objective, without the use of pretrained…

Computer Vision and Pattern Recognition · Computer Science 2024-04-15 Adrien Bardes , Quentin Garrido , Jean Ponce , Xinlei Chen , Michael Rabbat , Yann LeCun , Mahmoud Assran , Nicolas Ballas

Electrocardiogram (ECG), a non-invasive and affordable tool for cardiac monitoring, is highly sensitive in detecting acute heart attacks. However, due to the lengthy nature of ECG recordings, numerous machine learning methods have been…

Signal Processing · Electrical Eng. & Systems 2025-03-04 Yue Wang , Xu Cao , Yaojun Hu , Haochao Ying , Hongxia Xu , Ruijia Wu , James Matthew Rehg , Jimeng Sun , Jian Wu , Jintai Chen

Echocardiography is crucial for cardiovascular disease detection but relies heavily on experienced sonographers. Echocardiography probe guidance systems, which provide real-time movement instructions for acquiring standard plane images,…

Computer Vision and Pattern Recognition · Computer Science 2025-04-18 Yang Yue , Yulin Wang , Haojun Jiang , Pan Liu , Shiji Song , Gao Huang

Echocardiography (echo) is the first imaging modality used when assessing cardiac function. The measurement of functional biomarkers from echo relies upon the segmentation of cardiac structures and deep learning models have been proposed to…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Iman Islam , Esther Puyol-Antón , Bram Ruijsink , Andrew J. Reader , Andrew P. King

Structural heart disease (SHD) is a prevalent condition with many undiagnosed cases, and early detection is often limited by the high cost and accessibility constraints of echocardiography (ECHO). Recent studies show that artificial…

Applications · Statistics 2026-03-04 Ya Zhou , Zhaohong Sun , Tianxiang Hao , Xiangjie Li

Conventional task-specific electrocardiogram (ECG) analysis models require large annotated datasets to train. Foundation models mitigate this burden by leveraging self-supervised pretraining; however, the scarcity of open-weight ECG…

Machine Learning · Computer Science 2025-06-02 Kaden McKeen , Sameer Masood , Augustin Toma , Barry Rubin , Bo Wang

Specialized foundation models are beginning to emerge in various medical subdomains, but pretraining methodologies and parametric scaling with the size of the pretraining dataset are rarely assessed systematically and in a like-for-like…

Signal Processing · Electrical Eng. & Systems 2026-05-13 M A Al-Masud , Nils Strodthoff

Objective To develop a robust and computationally efficient deep learning model for automated left ventricular ejection fraction (LVEF) estimation from echocardiography videos that is suitable for real-time point-of-care ultrasound (POCUS)…

Image and Video Processing · Electrical Eng. & Systems 2026-03-17 Moein Heidari , Afshin Bozorgpour , AmirHossein Zarif-Fakharnia , Wenjin Chen , Dorit Merhof , David J Foran , Jasmine Grewal , Ilker Hacihaliloglu

Electroencephalography (EEG), with its broad range of applications, necessitates models that can generalize effectively across various tasks and datasets. Large EEG Models (LEMs) address this by pretraining encoder-centric architectures on…

Machine Learning · Computer Science 2025-09-29 Chenyu Liu , Yuqiu Deng , Tianyu Liu , Jinan Zhou , Xinliang Zhou , Ziyu Jia , Yi Ding

We introduce a unified benchmarking framework focused on evaluating EEG-based foundation models in clinical applications. The benchmark spans 11 well-defined diagnostic tasks across 14 publicly available EEG datasets, including epilepsy,…

Machine Learning · Computer Science 2025-12-11 Ard Kastrati , Josua Bürki , Jonas Lauer , Cheng Xuan , Raffaele Iaquinto , Roger Wattenhofer

Foundation models have demonstrated remarkable potential in medical domain. However, their application to complex cardiovascular diagnostics remains underexplored. In this paper, we present Cardiac-CLIP, a multi-modal foundation model…

Pre-trained deep learning models, known as foundation models, have become essential building blocks in machine learning domains such as natural language processing and image domains. This trend has extended to respiratory and heart sound…

Audio and Speech Processing · Electrical Eng. & Systems 2025-04-28 Daisuke Niizumi , Daiki Takeuchi , Masahiro Yasuda , Binh Thien Nguyen , Yasunori Ohishi , Noboru Harada

Electroencephalography (EEG) is a non-invasive technique for recording brain activity, widely used in brain-computer interfaces, clinic, and healthcare. Traditional EEG deep models typically focus on specific dataset and task, limiting…

Signal Processing · Electrical Eng. & Systems 2025-09-03 Ang Li , Zikai Wang , Liuyin Yang , Zhenyu Wang , Tianheng Xu , Honglin Hu , Marc M. Van Hulle

EEG foundation models are typically pretrained on narrow-source clinical archives and evaluated on benchmarks from the same ecosystem, leaving unclear whether representations encode neural physiology or recording-distribution artifacts. We…

We introduce a novel question-answering (QA) dataset using echocardiogram reports sourced from the Medical Information Mart for Intensive Care database. This dataset is specifically designed to enhance QA systems in cardiology, consisting…

Artificial Intelligence · Computer Science 2025-03-07 Lama Moukheiber , Mira Moukheiber , Dana Moukheiiber , Jae-Woo Ju , Hyung-Chul Lee

Echocardiography is the most widely used imaging modality in cardiology, yet its interpretation remains labor-intensive and inherently multimodal, requiring view recognition, quantitative measurements, qualitative assessments, and…

Computer Vision and Pattern Recognition · Computer Science 2025-12-16 Yuheng Li , Yue Zhang , Abdoul Aziz Amadou , Yuxiang Lai , Jike Zhong , Tiziano Passerini , Dorin Comaniciu , Puneet Sharma

Tissue tracking in echocardiography is challenging due to the complex cardiac motion and the inherent nature of ultrasound acquisitions. Although optical flow methods are considered state-of-the-art (SOTA), they struggle with long-range…

Computer Vision and Pattern Recognition · Computer Science 2024-05-15 Md Abulkalam Azad , Artem Chernyshov , John Nyberg , Ingrid Tveten , Lasse Lovstakken , Håvard Dalen , Bjørnar Grenne , Andreas Østvik