English
Related papers

Related papers: Self-supervised learning of imaging and clinical s…

200 papers

Though self-supervised learning (SSL) has demonstrated incredible ability to learn robust representations from unlabeled data, the choice of optimal SSL strategy can lead to vastly different performance outcomes in specialized domains.…

Computer Vision and Pattern Recognition · Computer Science 2026-03-25 Vedrana Ivezić , Mara Pleasure , Ashwath Radhachandran , Saarang Panchavati , Shreeram Athreya , Vivek Sant , Benjamin Emert , Gregory Fishbein , Corey Arnold , William Speier

Lung cancer, a leading cause of cancer-related deaths globally, emphasises the importance of early detection for better patient outcomes. Pulmonary nodules, often early indicators of lung cancer, necessitate accurate, timely diagnosis.…

Computer Vision and Pattern Recognition · Computer Science 2025-04-29 Jiahao Lu , Chong Yin , Silvia Ingala , Kenny Erleben , Michael Bachmann Nielsen , Sune Darkner

During the diagnostic process, clinicians leverage multimodal information, such as chief complaints, medical images, and laboratory-test results. Deep-learning models for aiding diagnosis have yet to meet this requirement. Here we report a…

Computer Vision and Pattern Recognition · Computer Science 2023-06-02 Hong-Yu Zhou , Yizhou Yu , Chengdi Wang , Shu Zhang , Yuanxu Gao , Jia Pan , Jun Shao , Guangming Lu , Kang Zhang , Weimin Li

Joint embeddings between medical imaging modalities and associated radiology reports have the potential to offer significant benefits to the clinical community, ranging from cross-domain retrieval to conditional generation of reports to the…

Machine Learning · Computer Science 2018-11-28 Tzu-Ming Harry Hsu , Wei-Hung Weng , Willie Boag , Matthew McDermott , Peter Szolovits

Graph Neural Networks (GNNs) have shown promise in learning dynamic functional connectivity for distinguishing phenotypes from human brain networks. However, obtaining extensive labeled clinical data for training is often…

Machine Learning · Computer Science 2025-05-06 Jungwon Choi , Hyungi Lee , Byung-Hoon Kim , Juho Lee

Self-supervised learning (SSL) has become an important approach in pretraining large neural networks, enabling unprecedented scaling of model and dataset sizes. While recent advances like I-JEPA have shown promising results for Vision…

Computer Vision and Pattern Recognition · Computer Science 2025-03-12 András Kalapos , Bálint Gyires-Tóth

In recent advancements in unsupervised visual representation learning, the Joint-Embedding Predictive Architecture (JEPA) has emerged as a significant method for extracting visual features from unlabeled imagery through an innovative…

Computer Vision and Pattern Recognition · Computer Science 2024-10-28 Shentong Mo , Shengbang Tong

We propose and demonstrate machine learning algorithms to assess the severity of pulmonary edema in chest x-ray images of congestive heart failure patients. Accurate assessment of pulmonary edema in heart failure is critical when making…

Computer Vision and Pattern Recognition · Computer Science 2019-04-11 Ruizhi Liao , Jonathan Rubin , Grace Lam , Seth Berkowitz , Sandeep Dalal , William Wells , Steven Horng , Polina Golland

Obtaining ground truth data in medical imaging has difficulties due to the fact that it requires a lot of annotating time from the experts in the field. Also, when trained with supervised learning, it detects only the cases included in the…

Computer Vision and Pattern Recognition · Computer Science 2022-12-26 Inha Kang , Jinah Park

Accurate and robust medical image classification is paramount for early disease diagnosis and treatment planning. However, challenges such as limited annotated data, high intra-class variability, and subtle inter-class differences often…

Image and Video Processing · Electrical Eng. & Systems 2026-05-22 Joao Florindo , Viviane Moura

Lung cancer remains among the deadliest types of cancer in recent decades, and early lung nodule detection is crucial for improving patient outcomes. The limited availability of annotated medical imaging data remains a bottleneck in…

Image and Video Processing · Electrical Eng. & Systems 2025-05-22 Muniba Noreen , Furqan Shaukat

The integration of different imaging modalities, such as structural, diffusion tensor, and functional magnetic resonance imaging, with deep learning models has yielded promising outcomes in discerning phenotypic characteristics and…

Image and Video Processing · Electrical Eng. & Systems 2024-10-08 Zhiyuan Li , Hailong Li , Anca L. Ralescu , Jonathan R. Dillman , Mekibib Altaye , Kim M. Cecil , Nehal A. Parikh , Lili He

Self-supervised learning has emerged as a major technique for the task of learning from unlabeled data, where the current methods mostly revolve around alignment of representations and input recon struction. Although such approaches have…

Machine Learning · Computer Science 2026-04-16 Mintu Dutta , Ritesh Vyas , Mohendra Roy

Joint-Embedding Predictive Architectures (JEPAs) have recently emerged as a novel and powerful technique for self-supervised representation learning. They aim to learn an energy-based model by predicting the latent representation of a…

Machine Learning · Computer Science 2025-01-22 Geri Skenderi , Hang Li , Jiliang Tang , Marco Cristani

Self-supervised pretraining attempts to enhance model performance by obtaining effective features from unlabeled data, and has demonstrated its effectiveness in the field of histopathology images. Despite its success, few works concentrate…

Computer Vision and Pattern Recognition · Computer Science 2023-09-22 Zhiyun Song , Penghui Du , Junpeng Yan , Kailu Li , Jianzhong Shou , Maode Lai , Yubo Fan , Yan Xu

Building on the Joint-Embedding Predictive Architecture (JEPA) paradigm, a recent self-supervised learning framework that predicts latent representations of masked regions in high-level feature spaces, we propose Audio-JEPA (Audio…

Sound · Computer Science 2025-07-08 Ludovic Tuncay , Etienne Labbé , Emmanouil Benetos , Thomas Pellegrini

Semi-supervised learning addresses the issue of limited annotations in medical images effectively, but its performance is often inadequate for complex backgrounds and challenging tasks. Multi-modal fusion methods can significantly improve…

Computer Vision and Pattern Recognition · Computer Science 2025-06-23 Dongdong Meng , Sheng Li , Hao Wu , Guoping Wang , Xueqing Yan

Self-supervised pretraining followed by supervised fine-tuning has seen success in image recognition, especially when labeled examples are scarce, but has received limited attention in medical image analysis. This paper studies the…

Joint Embedding Predictive Architectures (JEPA) have emerged as a powerful framework for learning general-purpose representations. However, these models often lack interpretability and suffer from inefficiencies due to dense embedding…

Machine Learning · Computer Science 2025-04-24 Max Hartman , Lav Varshney

In high energy physics, self-supervised learning (SSL) methods have the potential to aid in the creation of machine learning models without the need for labeled datasets for a variety of tasks, including those related to jets -- narrow…

High Energy Physics - Phenomenology · Physics 2024-12-13 Subash Katel , Haoyang Li , Zihan Zhao , Raghav Kansal , Farouk Mokhtar , Javier Duarte