English
Related papers

Related papers: Self-supervised contrastive learning unveils corti…

200 papers

Self-supervised learning methods can be used to learn meaningful representations from unlabeled data that can be transferred to supervised downstream tasks to reduce the need for labeled data. In this paper, we propose a 3D self-supervised…

Machine Learning · Computer Science 2021-10-04 Yamen Ali , Aiham Taleb , Marina M. -C. Höhne , Christoph Lippert

We develop biologically plausible training mechanisms for self-supervised learning (SSL) in deep networks. Specifically, by biological plausible training we mean (i) All updates of weights are based on current activities of pre-synaptic…

Neural and Evolutionary Computing · Computer Science 2022-02-02 Mufeng Tang , Yibo Yang , Yali Amit

The recent breakthrough achieved by contrastive learning accelerates the pace for deploying unsupervised training on real-world data applications. However, unlabeled data in reality is commonly imbalanced and shows a long-tail distribution,…

Computer Vision and Pattern Recognition · Computer Science 2021-06-08 Ziyu Jiang , Tianlong Chen , Bobak Mortazavi , Zhangyang Wang

Contrastive learning has emerged as a powerful method in deep learning, excelling at learning effective representations through contrasting samples from different distributions. However, dimensional collapse, where embeddings converge into…

Machine Learning · Computer Science 2025-12-10 Huanran Li , Manh Nguyen , Daniel Pimentel-Alarcón

An estimated 15 million babies are born too early every year. Approximately 1 million children die each year due to complications of preterm birth (PTB). Many survivors face a lifetime of disability, including learning disabilities and…

Image and Video Processing · Electrical Eng. & Systems 2020-08-25 Tomasz Włodarczyk , Szymon Płotka , Przemysław Rokita , Nicole Sochacki-Wójcicka , Jakub Wójcicki , Michał Lipa , Tomasz Trzciński

In the realms of computer vision, it is evident that deep neural networks perform better in a supervised setting with a large amount of labeled data. The representations learned with supervision are not only of high quality but also helps…

Machine Learning · Computer Science 2020-09-28 Souradip Chakraborty , Aritra Roy Gosthipaty , Sayak Paul

Accurate fetal movement (FM) detection is essential for assessing prenatal health, as abnormal movement patterns can indicate underlying complications such as placental dysfunction or fetal distress. Traditional methods, including maternal…

Contrastive learning has been proved to be a promising technique for image-level representation learning from unlabeled data. Many existing works have demonstrated improved results by applying contrastive learning in classification and…

Image and Video Processing · Electrical Eng. & Systems 2021-09-20 Dewen Zeng , John N. Kheir , Peng Zeng , Yiyu Shi

Medical image segmentation is a critical yet challenging task, primarily due to the difficulty of obtaining extensive datasets of high-quality, expert-annotated images. Contrastive learning presents a potential but still problematic…

Computer Vision and Pattern Recognition · Computer Science 2025-04-22 Shuang Zeng , Lei Zhu , Xinliang Zhang , Hangzhou He , Yanye Lu

Supervised contrastive learning (SupCL) has emerged as a prominent approach in representation learning, leveraging both supervised and self-supervised losses. However, achieving an optimal balance between these losses is challenging;…

Machine Learning · Computer Science 2025-03-12 Chungpa Lee , Jeongheon Oh , Kibok Lee , Jy-yong Sohn

Building accurate Deep Learning (DL) models for brain age prediction is a very relevant topic in neuroimaging, as it could help better understand neurodegenerative disorders and find new biomarkers. To estimate accurate and generalizable…

Image and Video Processing · Electrical Eng. & Systems 2023-03-22 Carlo Alberto Barbano , Benoit Dufumier , Edouard Duchesnay , Marco Grangetto , Pietro Gori

Inspired by the success of Self-supervised learning (SSL) in learning visual representations from unlabeled data, a few recent works have studied SSL in the context of continual learning (CL), where multiple tasks are learned sequentially,…

Computer Vision and Pattern Recognition · Computer Science 2023-03-15 Li Yang , Sen Lin , Fan Zhang , Junshan Zhang , Deliang Fan

Self-supervised learning has proven to be an effective way to learn representations in domains where annotated labels are scarce, such as medical imaging. A widely adopted framework for this purpose is contrastive learning and it has been…

Computer Vision and Pattern Recognition · Computer Science 2024-02-23 Hugo Figueiras , Helena Aidos , Nuno Cruz Garcia

Self-supervised learning (SSL) approaches have achieved great success when the amount of labeled data is limited. Within SSL, models learn robust feature representations by solving pretext tasks. One such pretext task is contrastive…

Computer Vision and Pattern Recognition · Computer Science 2024-02-28 Jamshid Hassanpour , Vinkle Srivastav , Didier Mutter , Nicolas Padoy

Most segmentation methods in child brain MRI are supervised and are based on global intensity distributions of major brain structures. The successful implementation of a supervised approach depends on availability of an age-appropriate…

Image and Video Processing · Electrical Eng. & Systems 2020-05-21 Nataliya Portman , Paule-J Toussaint , Alan C. Evans

Self-supervised learning techniques are celebrating immense success in natural language processing (NLP) by enabling models to learn from broad language data at unprecedented scales. Here, we aim to leverage the success of these techniques…

Neurons and Cognition · Quantitative Biology 2023-01-18 Armin W. Thomas , Christopher Ré , Russell A. Poldrack

The healthcare industry generates troves of unlabelled physiological data. This data can be exploited via contrastive learning, a self-supervised pre-training method that encourages representations of instances to be similar to one another.…

Machine Learning · Computer Science 2021-05-18 Dani Kiyasseh , Tingting Zhu , David A. Clifton

Deep learning (DL) methods are increasingly outperforming classical approaches in brain imaging, yet their generalizability across diverse imaging cohorts remains inadequately assessed. As age and sex are key neurobiological markers in…

The Blood-Oxygen-Level-Dependent (BOLD) signal of resting-state fMRI (rs-fMRI) records the temporal dynamics of intrinsic functional networks in the brain. However, existing deep learning methods applied to rs-fMRI either neglect the…

Machine Learning · Computer Science 2021-06-30 Soham Gadgil , Qingyu Zhao , Adolf Pfefferbaum , Edith V. Sullivan , Ehsan Adeli , Kilian M. Pohl

Fetal brain imaging is a cornerstone of prenatal screening and early diagnosis of congenital anomalies. Knowledge of fetal gestational age is the key to the accurate assessment of brain development. This study develops an attention-based…

Computer Vision and Pattern Recognition · Computer Science 2018-12-19 Liyue Shen , Katie Shpanskaya , Edward Lee , Emily McKenna , Maryam Maleki , Quin Lu , Safwan Halabi , John Pauly , Kristen Yeom