English
Related papers

Related papers: X-SiT: Inherently Interpretable Surface Vision Tra…

200 papers

The brain is a highly complex organ that manages many important tasks, including movement, memory and thinking. Brain-related conditions, like tumors and degenerative disorders, can be hard to diagnose and treat. Magnetic Resonance Imaging…

Computer Vision and Pattern Recognition · Computer Science 2025-06-24 Shuvashis Sarker , Shamim Rahim Refat , Faika Fairuj Preotee , Shifat Islam , Tashreef Muhammad , Mohammad Ashraful Hoque

We propose a mesh-based technique to aid in the classification of Alzheimer's disease dementia (ADD) using mesh representations of the cortex and subcortical structures. Deep learning methods for classification tasks that utilize structural…

Image and Video Processing · Electrical Eng. & Systems 2022-03-14 Emanuel A. Azcona , Pierre Besson , Yunan Wu , Arjun Punjabi , Adam Martersteck , Amil Dravid , Todd B. Parrish , S. Kathleen Bandt , Aggelos K. Katsaggelos

Learning meaningful and interpretable representations from high-dimensional volumetric magnetic resonance (MR) images is essential for advancing personalized medicine. While Vision Transformers (ViTs) have shown promise in handling image…

Computer Vision and Pattern Recognition · Computer Science 2024-09-13 Qingqiao Hu , Daoan Zhang , Jiebo Luo , Zhenyu Gong , Benedikt Wiestler , Jianguo Zhang , Hongwei Bran Li

We present a deformable prototypical part network (Deformable ProtoPNet), an interpretable image classifier that integrates the power of deep learning and the interpretability of case-based reasoning. This model classifies input images by…

Computer Vision and Pattern Recognition · Computer Science 2024-05-06 Jon Donnelly , Alina Jade Barnett , Chaofan Chen

The differential diagnosis of neurodegenerative dementias is a challenging clinical task, mainly because of the overlap in symptom presentation and the similarity of patterns observed in structural neuroimaging. To improve diagnostic…

Machine Learning · Computer Science 2025-05-27 Andrew Zamai , Nathanael Fijalkow , Boris Mansencal , Laurent Simon , Eloi Navet , Pierrick Coupe

As the number of dementia patients rises, the need for accurate diagnostic procedures rises as well. Current methods, like using an MRI scan, rely on human input, which can be inaccurate. However, the decision logic behind machine learning…

Image and Video Processing · Electrical Eng. & Systems 2024-06-28 Tyler Morris , Ziming Liu , Longjian Liu , Xiaopeng Zhao

Mechanistic interpretability improves the safety, reliability, and robustness of large AI models. This study examined individual attention heads in vision transformers (ViTs) fine tuned on distorted 2D spectrogram images containing non…

Machine Learning · Computer Science 2025-03-25 Nooshin Bahador

Surface meshes are a favoured domain for representing structural and functional information on the human cortex, but their complex topology and geometry pose significant challenges for deep learning analysis. While Transformers have…

Image and Video Processing · Electrical Eng. & Systems 2024-06-12 Simon Dahan , Logan Z. J. Williams , Daniel Rueckert , Emma C. Robinson

Computer-aided early diagnosis of Alzheimer's disease (AD) and its prodromal form mild cognitive impairment (MCI) based on structure Magnetic Resonance Imaging (sMRI) has provided a cost-effective and objective way for early prevention and…

Image and Video Processing · Electrical Eng. & Systems 2021-11-16 Xin Zhang , Liangxiu Han , Wenyong Zhu , Liang Sun , Daoqiang Zhang

This study presents an innovative method for Alzheimer's disease diagnosis using 3D MRI designed to enhance the explainability of model decisions. Our approach adopts a soft attention mechanism, enabling 2D CNNs to extract volumetric…

Image and Video Processing · Electrical Eng. & Systems 2024-10-02 Gabriele Lozupone , Alessandro Bria , Francesco Fontanella , Frederick J. A. Meijer , Claudio De Stefano

Deep learning (DL) models have been popular due to their ability to learn directly from the raw data in an end-to-end paradigm, alleviating the concern of a separate error-prone feature extraction phase. Recent DL-based neuroimaging studies…

Machine Learning · Computer Science 2023-07-20 Md. Mahfuzur Rahman , Vince D. Calhoun , Sergey M. Plis

As Vision Transformers (ViTs) are increasingly adopted in sensitive vision applications, there is a growing demand for improved interpretability. This has led to efforts to forward-align these models with carefully annotated abstract,…

Computer Vision and Pattern Recognition · Computer Science 2025-02-05 Sanchit Sinha , Guangzhi Xiong , Aidong Zhang

In this paper, we propose an explainable and interpretable diabetic retinopathy (ExplainDR) classification model based on neural-symbolic learning. To gain explainability, a highlevel symbolic representation should be considered in decision…

Machine Learning · Computer Science 2022-04-05 Se-In Jang , Michael J. A. Girard , Alexandre H. Thiery

Deep Neural Networks (DNNs) demonstrate remarkable capabilities in learning complex hierarchical data representations, but the nature of these representations remains largely unknown. Existing global explainability methods, such as Network…

Machine Learning · Computer Science 2024-01-19 Kirill Bykov , Laura Kopf , Shinichi Nakajima , Marius Kloft , Marina M. -C. Höhne

The evolution of deep learning and artificial intelligence has significantly reshaped technological landscapes. However, their effective application in crucial sectors such as medicine demands more than just superior performance, but…

Computer Vision and Pattern Recognition · Computer Science 2024-02-27 Yasmine Mustafa , Tie Luo

Convolutional neural networks (CNNs) have shown exceptional performance for a range of medical imaging tasks. However, conventional CNNs are not able to explain their reasoning process, therefore limiting their adoption in clinical…

Computer Vision and Pattern Recognition · Computer Science 2022-08-02 Linde S. Hesse , Ana I. L. Namburete

The lack of explainability of deep learning models limits the adoption of such models in clinical practice. Prototype-based models can provide inherent explainable predictions, but these have predominantly been designed for classification…

Computer Vision and Pattern Recognition · Computer Science 2023-11-08 Linde S. Hesse , Nicola K. Dinsdale , Ana I. L. Namburete

Structural magnetic resonance imaging (sMRI) can identify subtle brain changes due to its high contrast for soft tissues and high spatial resolution. It has been widely used in diagnosing neurological brain diseases, such as Alzheimer…

Image and Video Processing · Electrical Eng. & Systems 2023-11-14 Xin Zhang , Liangxiu Han , Lianghao Han , Haoming Chen , Darren Dancey , Daoqiang Zhang

Unsupervised anomaly detection in brain imaging is challenging. In this paper, we propose self-supervised masked mesh learning for unsupervised anomaly detection on 3D cortical surfaces. Our framework leverages the intrinsic geometry of the…

Image and Video Processing · Electrical Eng. & Systems 2025-04-01 Hao-Chun Yang , Sicheng Dai , Saige Rutherford , Christian Gaser , Andre F Marquand , Christian F Beckmann , Thomas Wolfers