English
Related papers

Related papers: Self-supervised contrastive learning unveils corti…

200 papers

Self-supervised contrastive learning (CL) has achieved remarkable empirical success, often producing representations that rival supervised pre-training on downstream tasks. Recent theory explains this by showing that the CL loss closely…

Machine Learning · Computer Science 2025-10-13 Achleshwar Luthra , Priyadarsi Mishra , Tomer Galanti

3D structural Magnetic Resonance Imaging (MRI) brain scans are commonly acquired in clinical settings to monitor a wide range of neurological conditions, including neurodegenerative disorders and stroke. While deep learning models have…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Emily Kaczmarek , Justin Szeto , Brennan Nichyporuk , Tal Arbel

Through minimization of an appropriate loss function such as the InfoNCE loss, contrastive learning (CL) learns a useful representation function by pulling positive samples close to each other while pushing negative samples far apart in the…

Machine Learning · Computer Science 2024-05-13 Ruijie Jiang , Thuan Nguyen , Prakash Ishwar , Shuchin Aeron

Bipolar disorder (BD) and schizophrenia (SZ) are severe mental disorders with profound societal impact. Identifying risk markers early is crucial for understanding disease progression and enabling preventive measures. The Danish High Risk…

Computer Vision and Pattern Recognition · Computer Science 2024-03-25 Vladyslav Zalevskyi , Kristoffer Hougaard Madsen

Disease diagnosis from medical images via supervised learning is usually dependent on tedious, error-prone, and costly image labeling by medical experts. Alternatively, semi-supervised learning and self-supervised learning offer…

Computer Vision and Pattern Recognition · Computer Science 2023-06-14 Attiano Purpura-Pontoniere , Demetri Terzopoulos , Adam Wang , Abdullah-Al-Zubaer Imran

Understanding individual differences in cortical structure is key to advancing diagnostics in neurology and psychiatry. Reference models aid in detecting aberrant cortical thickness, yet site-specific biases limit their direct application…

Computer Vision and Pattern Recognition · Computer Science 2025-09-24 Christian Wachinger , Dennis Hedderich , Melissa Thalhammer , Fabian Bongratz

Automatic and accurate segmentation of brain MR images throughout the human lifespan into tissue and structure is crucial for understanding brain development and diagnosing diseases. However, challenges arise from the intricate variations…

Image and Video Processing · Electrical Eng. & Systems 2024-08-01 Lin Teng , Zihao Zhao , Jiawei Huang , Zehong Cao , Runqi Meng , Feng Shi , Dinggang Shen

Neural networks exhibit severe brittleness to semantically irrelevant transformations. A mere 75ms electrocardiogram (ECG) phase shift degrades latent cosine similarity from 1.0 to 0.2, while sensor rotations collapse activity recognition…

Machine Learning · Computer Science 2025-11-20 Zhengyang Shen , Hua Tu , Mayue Shi

SimCLR is one of the most popular contrastive learning methods for vision tasks. It pre-trains deep neural networks based on a large amount of unlabeled data by teaching the model to distinguish between positive and negative pairs of…

Machine Learning · Computer Science 2024-09-30 Han Zhang , Yuan Cao

Learning useful data representations without requiring labels is a cornerstone of modern deep learning. Self-supervised learning methods, particularly contrastive learning (CL), have proven successful by leveraging data augmentations to…

Machine Learning · Computer Science 2023-12-11 Sacha Morin , Somjit Nath , Samira Ebrahimi Kahou , Guy Wolf

The neonatal cortical surface is known to be affected by preterm birth, and the subsequent changes to cortical organisation have been associated with poorer neurodevelopmental outcomes. Deep Generative models have the potential to lead to…

Neurons and Cognition · Quantitative Biology 2022-06-23 Abdulah Fawaz , Logan Z. Williams , A. David Edwards , Emma Robinson

Understanding human fetal neurodevelopment is of great clinical importance as abnormal development is linked to adverse neuropsychiatric outcomes after birth. Recent advances in functional Magnetic Resonance Imaging (fMRI) have provided new…

Image and Video Processing · Electrical Eng. & Systems 2019-06-11 Xiangrui Li , Jasmine Hect , Moriah Thomason , Dongxiao Zhu

Since gyri and sulci, two basic anatomical building blocks of cortical folding patterns, were suggested to bear different functional roles, a precise mapping from brain function to gyro-sulcal patterns can provide profound insights into…

Neurons and Cognition · Quantitative Biology 2022-05-24 Li Yang , Zhibin He , Changhe Li , Junwei Han , Dajiang Zhu , Tianming Liu , Tuo Zhang

Recently, self-supervised learning (SSL) methods have been used in pre-training the segmentation models for 2D and 3D medical images. Most of these methods are based on reconstruction, contrastive learning and consistency regularization.…

Computer Vision and Pattern Recognition · Computer Science 2024-06-25 Haofeng Li , Yiming Ouyang , Xiang Wan

Intrapartum cardiotocography (CTG) is widely used for fetal monitoring during labor, yet its interpretation suffers from high inter-observer variability and limited predictive accuracy. Deep learning approaches have been constrained by the…

Machine Learning · Computer Science 2026-01-13 Naomi Fridman , Berta Ben Shachar

Self-supervised learning has achieved a great success in the representation learning of visual and textual data. However, the current methods are mainly validated on the well-curated datasets, which do not exhibit the real-world long-tailed…

Computer Vision and Pattern Recognition · Computer Science 2022-07-08 Zhihan Zhou , Jiangchao Yao , Yanfeng Wang , Bo Han , Ya Zhang

The fetal cortical plate undergoes drastic morphological changes throughout early in utero development that can be observed using magnetic resonance (MR) imaging. An accurate MR image segmentation, and more importantly a topologically…

Image and Video Processing · Electrical Eng. & Systems 2024-10-30 Priscille de Dumast , Hamza Kebiri , Chirine Atat , Vincent Dunet , Mériam Koob , Meritxell Bach Cuadra

Alzheimer's disease is a progressive, neurodegenerative disorder that causes memory loss and cognitive decline. While there has been extensive research in applying deep learning models to Alzheimer's prediction tasks, these models remain…

Computer Vision and Pattern Recognition · Computer Science 2025-09-15 Emily Kaczmarek , Justin Szeto , Brennan Nichyporuk , Tal Arbel

For long it has been known that specific patterns of folding are necessary for an optimally functioning brain. For instance, lissencephaly and polymicrogyria can lead to severe mental retardation, short life expectancy, epileptic seizures,…

Biological Physics · Physics 2020-04-03 Lucas da Costa Campos , Raphael Hornung , Gerhard Gompper , Jens Elgeti , Svenja Caspers

We describe an application of machine learning to the problem of predicting preterm birth. We conduct a secondary analysis on a clinical trial dataset collected by the National In- stitute of Child Health and Human Development (NICHD) while…