English
Related papers

Related papers: EchoJEPA: A Latent Predictive Foundation Model for…

200 papers

Quantitative evaluation of echocardiography is essential for precise assessment of cardiac condition, monitoring disease progression, and guiding treatment decisions. The diverse nature of echo images, including variations in probe types,…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Abdoul Aziz Amadou , Yue Zhang , Sebastien Piat , Paul Klein , Ingo Schmuecking , Tiziano Passerini , Puneet Sharma

Electroencephalography (EEG) is a widely used tool for studying brain function, with applications in clinical neuroscience, diagnosis, and brain-computer interfaces (BCIs). Recent EEG foundation models trained on large unlabeled corpora aim…

Machine Learning · Computer Science 2026-05-08 Saarang Panchavati , Uddhav Panchavati , Hiroki Nariai , Corey Arnold , William Speier

Cardiovascular diseases stand as the primary global cause of mortality. Among the various imaging techniques available for visualising the heart and evaluating its function, echocardiograms emerge as the preferred choice due to their safety…

Image and Video Processing · Electrical Eng. & Systems 2023-11-22 Adil Dahlan , Cyril Zakka , Abhinav Kumar , Laura Tang , Rohan Shad , Robyn Fong , William Hiesinger

Multimodal deep learning foundation models can learn the relationship between images and text. In the context of medical imaging, mapping images to language concepts reflects the clinical task of diagnostic image interpretation, however…

Computer Vision and Pattern Recognition · Computer Science 2023-09-06 Matthew Christensen , Milos Vukadinovic , Neal Yuan , David Ouyang

Foundation models have recently gained significant attention because of their generalizability and adaptability across multiple tasks and data distributions. Although medical foundation models have emerged, solutions for cardiac imaging,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-30 Sekeun Kim , Pengfei Jin , Sifan Song , Cheng Chen , Yiwei Li , Hui Ren , Xiang Li , Tianming Liu , Quanzheng Li

Echocardiography is the most widely used cardiac imaging modality, capturing ultrasound video data to assess cardiac structure and function. Artificial intelligence (AI) in echocardiography has the potential to streamline manual tasks and…

Computer Vision and Pattern Recognition · Computer Science 2024-10-15 Milos Vukadinovic , Xiu Tang , Neal Yuan , Paul Cheng , Debiao Li , Susan Cheng , Bryan He , David Ouyang

Foundation models are reshaping medical imaging, yet their application in echocardiography remains limited, hindered by a heavy reliance on private datasets that prevent reproducible comparison. Echocardiography poses unique challenges,…

Computer Vision and Pattern Recognition · Computer Science 2026-05-21 Darya Taratynova , Ahmed Aly , Numan Saeed , Mohammad Yaqub

Ultrasound (US) imaging poses unique challenges for representation learning due to its inherently noisy acquisition process. The low signal-to-noise ratio and stochastic speckle patterns hinder standard self-supervised learning methods…

Computer Vision and Pattern Recognition · Computer Science 2026-02-24 Ashwath Radhachandran , Vedrana Ivezić , Shreeram Athreya , Ronit Anilkumar , Corey W. Arnold , William Speier

Joint Embedding Predictive Architectures (JEPA) offer a scalable paradigm for self-supervised learning by predicting latent representations rather than reconstructing high-entropy observations. However, existing formulations rely on…

Machine Learning · Computer Science 2026-01-22 Yongchao Huang

Artificial intelligence (AI) that can effectively learn ultrasound representations by integrating multi-source data holds significant promise for advancing clinical care. However, the scarcity of large labeled datasets in real-world…

Left ventricular ejection fraction (LVEF) is a key indicator of cardiac function and plays a central role in the diagnosis and management of cardiovascular disease. Echocardiography, as a readily accessible and non-invasive imaging…

Computer Vision and Pattern Recognition · Computer Science 2025-12-30 Shravan Saranyan , Pramit Saha

Learning manipulable representations of the world and its dynamics is central to AI. Joint-Embedding Predictive Architectures (JEPAs) offer a promising blueprint, but lack of practical guidance and theory has led to ad-hoc R&D. We present a…

Machine Learning · Computer Science 2025-11-17 Randall Balestriero , Yann LeCun

Vision-language pretraining has driven much of the recent progress in medical image representation learning, but this paradigm is constrained by the availability of paired image-text data and by the reporting bias of clinical narratives. We…

Computer Vision and Pattern Recognition · Computer Science 2026-05-27 Anas Anwarul Haq Khan , Mariam Husain , Pratik Jalan , Kshitij Jadhav

Aerodynamic surrogate models are increasingly used to replace repeated high-fidelity CFD evaluations in many-query design settings, but current approaches still face two important limitations: they often scale poorly to the very large…

This paper presents that the masked-modeling principle driving the success of large foundational vision models can be effectively applied to audio by making predictions in a latent space. We introduce Audio-based Joint-Embedding Predictive…

Sound · Computer Science 2024-01-12 Zhengcong Fei , Mingyuan Fan , Junshi Huang

Single-cell foundation models learn by reconstructing masked gene expression, implicitly treating technical noise as signal. With dropout rates exceeding 90%, reconstruction objectives encourage models to encode measurement artifacts rather…

Computational Engineering, Finance, and Science · Computer Science 2026-02-03 Ali ElSheikh , Rui-Xi Wang , Weimin Wu , Yibo Wen , Payam Dibaeinia , Jennifer Yuntong Zhang , Jerry Yao-Chieh Hu , Mei Knudson , Sudarshan Babu , Shao-Hua Sun , Aly A. Khan , Han Liu

Electrocardiography (ECG) is central to cardiovascular care, but conventional AI models are often restricted to common arrhythmias and may generalize poorly across populations or clinically subtle diseases. We developed ECG Contrastive…

Learning audio representations from raw waveforms overcomes key limitations of spectrogram-based audio representation learning, such as the long latency of spectrogram computation and the loss of phase information. Yet, while…

The early detection of esophagogastric junction adenocarcinoma (EGJA) is crucial for improving patient prognosis, yet its current diagnosis is highly operator-dependent. This paper aims to make the first attempt to develop an artificial…

Auscultation, particularly heart sound, is a non-invasive technique that provides essential vital sign information. Recently, self-supervised acoustic representation foundation models (FMs) have been proposed to offer insights into…

‹ Prev 1 2 3 10 Next ›