English

From Barlow Twins to Triplet Training: Differentiating Dementia with Limited Data

Computer Vision and Pattern Recognition 2024-04-10 v1

Abstract

Differential diagnosis of dementia is challenging due to overlapping symptoms, with structural magnetic resonance imaging (MRI) being the primary method for diagnosis. Despite the clinical value of computer-aided differential diagnosis, research has been limited, mainly due to the absence of public datasets that contain diverse types of dementia. This leaves researchers with small in-house datasets that are insufficient for training deep neural networks (DNNs). Self-supervised learning shows promise for utilizing unlabeled MRI scans in training, but small batch sizes for volumetric brain scans make its application challenging. To address these issues, we propose Triplet Training for differential diagnosis with limited target data. It consists of three key stages: (i) self-supervised pre-training on unlabeled data with Barlow Twins, (ii) self-distillation on task-related data, and (iii) fine-tuning on the target dataset. Our approach significantly outperforms traditional training strategies, achieving a balanced accuracy of 75.6%. We further provide insights into the training process by visualizing changes in the latent space after each step. Finally, we validate the robustness of Triplet Training in terms of its individual components in a comprehensive ablation study. Our code is available at https://github.com/ai-med/TripletTraining.

Keywords

Cite

@article{arxiv.2404.06253,
  title  = {From Barlow Twins to Triplet Training: Differentiating Dementia with Limited Data},
  author = {Yitong Li and Tom Nuno Wolf and Sebastian Pölsterl and Igor Yakushev and Dennis M. Hedderich and Christian Wachinger},
  journal= {arXiv preprint arXiv:2404.06253},
  year   = {2024}
}

Comments

Accepted for presentation at MIDL 2024