English
Related papers

Related papers: Medical Transformer: Universal Brain Encoder for 3…

200 papers

The application of deep learning (DL) models to the decoding of cognitive states from whole-brain functional Magnetic Resonance Imaging (fMRI) data is often hindered by the small sample size and high dimensionality of these datasets.…

Image and Video Processing · Electrical Eng. & Systems 2019-07-04 Armin W. Thomas , Klaus-Robert Müller , Wojciech Samek

In biomedical imaging analysis, the dichotomy between 2D and 3D data presents a significant challenge. While 3D volumes offer superior real-world applicability, they are less available for each modality and not easy to train in large scale,…

Computer Vision and Pattern Recognition · Computer Science 2025-01-28 Mehmet Can Yavuz , Yang Yang

Accurate brain tumor segmentation from Magnetic Resonance Imaging (MRI) is desirable to joint learning of multimodal images. However, in clinical practice, it is not always possible to acquire a complete set of MRIs, and the problem of…

Image and Video Processing · Electrical Eng. & Systems 2022-08-05 Yao Zhang , Nanjun He , Jiawei Yang , Yuexiang Li , Dong Wei , Yawen Huang , Yang Zhang , Zhiqiang He , Yefeng Zheng

Decoding brain states from functional magnetic resonance imaging (fMRI) data is vital for advancing neuroscience and clinical applications. While traditional machine learning and deep learning approaches have made strides in leveraging the…

Machine Learning · Computer Science 2025-12-10 Danial Jafarzadeh Jazi , Maryam Hajiesmaeili

Vision Transformers (ViT)s have shown great performance in self-supervised learning of global and local representations that can be transferred to downstream applications. Inspired by these results, we introduce a novel self-supervised…

Computer Vision and Pattern Recognition · Computer Science 2022-03-29 Yucheng Tang , Dong Yang , Wenqi Li , Holger Roth , Bennett Landman , Daguang Xu , Vishwesh Nath , Ali Hatamizadeh

Deciphering visual content from functional Magnetic Resonance Imaging (fMRI) helps illuminate the human vision system. However, the scarcity of fMRI data and noise hamper brain decoding model performance. Previous approaches primarily…

Computer Vision and Pattern Recognition · Computer Science 2024-06-14 Yulong Liu , Yongqiang Ma , Guibo Zhu , Haodong Jing , Nanning Zheng

To ensure safe clinical integration, deep learning models must provide more than just high accuracy; they require dependable uncertainty quantification. While current Medical Vision Transformers perform well, they frequently struggle with…

Image and Video Processing · Electrical Eng. & Systems 2026-04-13 Mohammed Maaz Sibhai , Abedalrhman Alkhateeb , Saad B. Ahmed

Recent advancements in large-scale Vision Transformers have made significant strides in improving pre-trained models for medical image segmentation. However, these methods face a notable challenge in acquiring a substantial amount of…

Computer Vision and Pattern Recognition · Computer Science 2023-07-25 Yiqing Wang , Zihan Li , Jieru Mei , Zihao Wei , Li Liu , Chen Wang , Shengtian Sang , Alan Yuille , Cihang Xie , Yuyin Zhou

Over the last decade, convolutional neural networks have emerged and advanced the state-of-the-art in various image analysis and computer vision applications. The performance of 2D image classification networks is constantly improving and…

Image and Video Processing · Electrical Eng. & Systems 2023-08-01 Hicham Messaoudi , Ahror Belaid , Douraied Ben Salem , Pierre-Henri Conze

Transfer learning is a standard technique to improve performance on tasks with limited data. However, for medical imaging, the value of transfer learning is less clear. This is likely due to the large domain mismatch between the usual…

Three-dimensional (3D) medical images, such as Computed Tomography (CT) and Magnetic Resonance Imaging (MRI), are essential for clinical applications. However, the need for diverse and comprehensive representations is particularly…

Computer Vision and Pattern Recognition · Computer Science 2025-05-26 Siwen Wang , Churan Wang , Fei Gao , Lixian Su , Fandong Zhang , Yizhou Wang , Yizhou Yu

Deep learning-based 3-dimensional (3D) shape reconstruction from 2-dimensional (2D) magnetic resonance imaging (MRI) has become increasingly important in medical disease diagnosis, treatment planning, and computational modeling. This review…

Machine Learning · Computer Science 2025-10-03 Emma McMillian , Abhirup Banerjee , Alfonso Bueno-Orovio

Following unprecedented success on the natural language tasks, Transformers have been successfully applied to several computer vision problems, achieving state-of-the-art results and prompting researchers to reconsider the supremacy of…

Image and Video Processing · Electrical Eng. & Systems 2022-01-25 Fahad Shamshad , Salman Khan , Syed Waqas Zamir , Muhammad Haris Khan , Munawar Hayat , Fahad Shahbaz Khan , Huazhu Fu

Magnetic Resonance Imaging (MRI) is a crucial diagnostic tool, but high-resolution scans are often slow and expensive due to extensive data acquisition requirements. Traditional MRI reconstruction methods aim to expedite this process by…

Image and Video Processing · Electrical Eng. & Systems 2025-11-11 Emmanuelle Bourigault , Abdullah Hamdi , Amir Jamaludin

Understanding 3D medical image volumes is a critical task in the medical domain. However, existing 3D convolution and transformer-based methods have limited semantic understanding of an image volume and also need a large set of volumes for…

Computer Vision and Pattern Recognition · Computer Science 2024-03-11 Qiuhui Chen , Huping Ye , Yi Hong

Self-supervised learning (SSL) has advanced medical image analysis be enabling learning form large unlabelled data. However, in brain magnetic resonance imaging (MRI), most 3D models remain specialized for either segmentation of…

Computer Vision and Pattern Recognition · Computer Science 2026-05-19 Amy Makawana , Abhijeet Parida , Marius George Linguraru , Julia Ive , Syed Muhammad Anwar

In modern medical diagnostics, magnetic resonance imaging (MRI) is an important technique that provides detailed insights into anatomical structures. In this paper, we present a comprehensive methodology focusing on streamlining the…

Image and Video Processing · Electrical Eng. & Systems 2024-04-25 Siddharth Jha , Zichen Gui , Benjamin Delbos , Richard Moreau , Arnaud Leleve , Irene Cheng

Magnetic Resonance Imaging (MRI) is a principal diagnostic approach used in the field of radiology to create images of the anatomical and physiological structure of patients. MRI is the prevalent medical imaging practice to find…

Computer Vision and Pattern Recognition · Computer Science 2021-06-16 Yusuf Brima , Mossadek Hossain Kamal Tushar , Upama Kabir , Tariqul Islam

Transformer, the latest technological advance of deep learning, has gained prevalence in natural language processing or computer vision. Since medical imaging bear some resemblance to computer vision, it is natural to inquire about the…

Computer Vision and Pattern Recognition · Computer Science 2022-11-22 Jun Li , Junyu Chen , Yucheng Tang , Ce Wang , Bennett A. Landman , S. Kevin Zhou

Computer-aided medical image segmentation has been applied widely in diagnosis and treatment to obtain clinically useful information of shapes and volumes of target organs and tissues. In the past several years, convolutional neural network…

Computer Vision and Pattern Recognition · Computer Science 2022-01-11 Yixuan Wu , Kuanlun Liao , Jintai Chen , Jinhong Wang , Danny Z. Chen , Honghao Gao , Jian Wu