English
Related papers

Related papers: Medical Transformer: Universal Brain Encoder for 3…

200 papers

Transformer architectures, including nnFormer,have demonstrated promising results in volumetric medical image segmentation by being able to capture long-range spatial interactions. Although they have high performance, these models need…

Computer Vision and Pattern Recognition · Computer Science 2026-04-28 R. M. Krishna Sureddi , T. Satyanarayana Murthy , Nomula Varsha Reddy , Adi Kanishka , Nalla Manvika Reddy

Encoding models have been used to assess how the human brain represents concepts in language and vision. While language and vision rely on similar concept representations, current encoding models are typically trained and tested on brain…

Computation and Language · Computer Science 2023-05-23 Jerry Tang , Meng Du , Vy A. Vo , Vasudev Lal , Alexander G. Huth

Convolutional neural networks (CNNs) achieved the state-of-the-art performance in medical image segmentation due to their ability to extract highly complex feature representations. However, it is argued in recent studies that traditional…

Computer Vision and Pattern Recognition · Computer Science 2025-03-31 Zhendi Gong , Andrew P. French , Guoping Qiu , Xin Chen

Visual-language models have advanced the development of universal models, yet their application in medical imaging remains constrained by specific functional requirements and the limited data. Current general-purpose models are typically…

Computer Vision and Pattern Recognition · Computer Science 2024-10-08 Kaini Wang , Ling Yang , Siping Zhou , Guangquan Zhou , Wentao Zhang , Bin Cui , Shuo Li

Automatic segmentation of pathological shoulder muscles in patients with musculo-skeletal diseases is a challenging task due to the huge variability in muscle shape, size, location, texture and injury. A reliable fully-automated…

Computer Vision and Pattern Recognition · Computer Science 2020-04-28 Pierre-Henri Conze , Sylvain Brochard , Valérie Burdin , Frances T. Sheehan , Christelle Pons

Deep learning has shown promising results in medical image analysis, however, the lack of very large annotated datasets confines its full potential. Although transfer learning with ImageNet pre-trained classification models can alleviate…

Computer Vision and Pattern Recognition · Computer Science 2018-08-16 Ken C. L. Wong , Tanveer Syeda-Mahmood , Mehdi Moradi

Automatic 3D neuron reconstruction is critical for analysing the morphology and functionality of neurons in brain circuit activities. However, the performance of existing tracing algorithms is hinged by the low image quality. Recently, a…

Image and Video Processing · Electrical Eng. & Systems 2021-09-17 Heng Wang , Chaoyi Zhang , Jianhui Yu , Yang Song , Siqi Liu , Wojciech Chrzanowski , Weidong Cai

Purpose: Neural networks have received recent interest for reconstruction of undersampled MR acquisitions. Ideally network performance should be optimized by drawing the training and testing data from the same domain. In practice, however,…

Computer Vision and Pattern Recognition · Computer Science 2019-05-07 Salman Ul Hassan Dar , Muzaffer Özbey , Ahmet Burak Çatlı , Tolga Çukur

A major goal of neuroscience is to understand brain computations during visual processing in naturalistic settings. A dominant approach is to use image-computable deep neural networks trained with different task objectives as a basis for…

Neurons and Cognition · Quantitative Biology 2026-02-06 Hossein Adeli , Sun Minni , Nikolaus Kriegeskorte

Segmentation of 3D medical images is a critical task for accurate diagnosis and treatment planning. Convolutional neural networks (CNNs) have dominated the field, achieving significant success in 3D medical image segmentation. However, CNNs…

Image and Video Processing · Electrical Eng. & Systems 2025-02-11 Canxuan Gang

Deep learning models such as convolutional neural net- work have been widely used in 3D biomedical segmentation and achieve state-of-the-art performance. However, most of them often adapt a single modality or stack multiple modalities as…

Computer Vision and Pattern Recognition · Computer Science 2017-04-26 Kuan-Lun Tseng , Yen-Liang Lin , Winston Hsu , Chung-Yang Huang

Transformer, the model of choice for natural language processing, has drawn scant attention from the medical imaging community. Given the ability to exploit long-term dependencies, transformers are promising to help atypical convolutional…

Computer Vision and Pattern Recognition · Computer Science 2022-02-07 Hong-Yu Zhou , Jiansen Guo , Yinghao Zhang , Lequan Yu , Liansheng Wang , Yizhou Yu

Accurate segmentation of brain tumors from 3D multimodal MRI is vital for diagnosis and treatment planning across diverse brain tumors. This paper addresses the challenges posed by the BraTS 2023, presenting a unified transfer learning…

Image and Video Processing · Electrical Eng. & Systems 2024-12-12 Ramy A. Zeineldin , Franziska Mathis-Ullrich

3D medical image analysis is of great importance in disease diagnosis and treatment. Recently, multimodal large language models (MLLMs) have exhibited robust perceptual capacity, strong cross-modal alignment, and promising generalizability.…

Computer Vision and Pattern Recognition · Computer Science 2026-04-14 Yang Yu , Dunyuan Xu , Yaoqian Li , Xiaomeng Li , Jinpeng Li , Pheng-Ann Heng

Efficient and fast reconstruction of anatomical structures plays a crucial role in clinical practice. Minimizing retrieval and processing times not only potentially enhances swift response and decision-making in critical scenarios but also…

In this work, we present Eformer - Edge enhancement based transformer, a novel architecture that builds an encoder-decoder network using transformer blocks for medical image denoising. Non-overlapping window-based self-attention is used in…

Image and Video Processing · Electrical Eng. & Systems 2021-11-10 Achleshwar Luthra , Harsh Sulakhe , Tanish Mittal , Abhishek Iyer , Santosh Yadav

Transfer learning is widely used for training machine learning models. Here, we study the role of transfer learning for training fully convolutional networks (FCNs) for medical image segmentation. Our experiments show that although transfer…

Computer Vision and Pattern Recognition · Computer Science 2022-04-05 Davood Karimi , Simon K. Warfield , Ali Gholipour

We propose a novel machine learning strategy for studying neuroanatomical shape variation. Our model works with volumetric binary segmentation images, and requires no pre-processing such as the extraction of surface points or a mesh. The…

Computer Vision and Pattern Recognition · Computer Science 2024-10-30 Evan M. Yu , Mert R. Sabuncu

Transfer learning from supervised ImageNet models has been frequently used in medical image analysis. Yet, no large-scale evaluation has been conducted to benchmark the efficacy of newly-developed pre-training techniques for medical image…

Computer Vision and Pattern Recognition · Computer Science 2021-08-16 Mohammad Reza Hosseinzadeh Taher , Fatemeh Haghighi , Ruibin Feng , Michael B. Gotway , Jianming Liang

In the last decade, convolutional neural networks (ConvNets) have been a major focus of research in medical image analysis. However, the performances of ConvNets may be limited by a lack of explicit consideration of the long-range spatial…

Image and Video Processing · Electrical Eng. & Systems 2022-10-18 Junyu Chen , Eric C. Frey , Yufan He , William P. Segars , Ye Li , Yong Du