Where is VALDO? VAscular Lesions Detection and segmentatiOn challenge at MICCAI 2021
Abstract
Imaging markers of cerebral small vessel disease provide valuable information on brain health, but their manual assessment is time-consuming and hampered by substantial intra- and interrater variability. Automated rating may benefit biomedical research, as well as clinical assessment, but diagnostic reliability of existing algorithms is unknown. Here, we present the results of the \textit{VAscular Lesions DetectiOn and Segmentation} (\textit{Where is VALDO?}) challenge that was run as a satellite event at the international conference on Medical Image Computing and Computer Aided Intervention (MICCAI) 2021. This challenge aimed to promote the development of methods for automated detection and segmentation of small and sparse imaging markers of cerebral small vessel disease, namely enlarged perivascular spaces (EPVS) (Task 1), cerebral microbleeds (Task 2) and lacunes of presumed vascular origin (Task 3) while leveraging weak and noisy labels. Overall, 12 teams participated in the challenge proposing solutions for one or more tasks (4 for Task 1 - EPVS, 9 for Task 2 - Microbleeds and 6 for Task 3 - Lacunes). Multi-cohort data was used in both training and evaluation. Results showed a large variability in performance both across teams and across tasks, with promising results notably for Task 1 - EPVS and Task 2 - Microbleeds and not practically useful results yet for Task 3 - Lacunes. It also highlighted the performance inconsistency across cases that may deter use at an individual level, while still proving useful at a population level.
Keywords
Cite
@article{arxiv.2208.07167,
title = {Where is VALDO? VAscular Lesions Detection and segmentatiOn challenge at MICCAI 2021},
author = {Carole H. Sudre and Kimberlin Van Wijnen and Florian Dubost and Hieab Adams and David Atkinson and Frederik Barkhof and Mahlet A. Birhanu and Esther E. Bron and Robin Camarasa and Nish Chaturvedi and Yuan Chen and Zihao Chen and Shuai Chen and Qi Dou and Tavia Evans and Ivan Ezhov and Haojun Gao and Marta Girones Sanguesa and Juan Domingo Gispert and Beatriz Gomez Anson and Alun D. Hughes and M. Arfan Ikram and Silvia Ingala and H. Rolf Jaeger and Florian Kofler and Hugo J. Kuijf and Denis Kutnar and Minho Lee and Bo Li and Luigi Lorenzini and Bjoern Menze and Jose Luis Molinuevo and Yiwei Pan and Elodie Puybareau and Rafael Rehwald and Ruisheng Su and Pengcheng Shi and Lorna Smith and Therese Tillin and Guillaume Tochon and Helene Urien and Bas H. M. van der Velden and Isabelle F. van der Velpen and Benedikt Wiestler and Frank J. Wolters and Pinar Yilmaz and Marius de Groot and Meike W. Vernooij and Marleen de Bruijne},
journal= {arXiv preprint arXiv:2208.07167},
year = {2022}
}