English
Related papers

Related papers: SwiFT: Swin 4D fMRI Transformer

200 papers

Accurate brain age estimation from structural MRI is a valuable biomarker for studying aging and neurodegeneration. Traditional regression and CNN-based methods face limitations such as manual feature engineering, limited receptive fields,…

Computer Vision and Pattern Recognition · Computer Science 2025-11-21 Wasif Jalal , Md Nafiu Rahman , Atif Hasan Rahman , M. Sohel Rahman

The Swin transformer has recently attracted attention in medical image analysis due to its computational efficiency and long-range modeling capability. Owing to these properties, the Swin Transformer is suitable for establishing more…

Computer Vision and Pattern Recognition · Computer Science 2024-08-21 Mingrui Ma , Tao Wang , Lei Song , Weijie Wang , Guixia Liu

The detailed reconstruction of neural anatomy for connectomics studies requires a combination of resolution and large three-dimensional data capture provided by serial section electron microscopy (ssEM). The convergence of high throughput…

Computer Vision and Pattern Recognition · Computer Science 2017-11-21 Arthur W. Wetzel , Jennifer Bakal , Markus Dittrich , David G. C. Hildebrand , Josh L. Morgan , Jeff W. Lichtman

The pre-trained transformer demonstrates remarkable generalization ability in natural image processing. However, directly transferring it to magnetic resonance images faces two key challenges: the inability to adapt to the specificity of…

Computer Vision and Pattern Recognition · Computer Science 2026-01-21 Jingkai Li , Xiaoze Tian , Yuhang Shen , Jia Wang , Dianjie Lu , Guijuan Zhang , Zhuoran Zheng

Reliable brain tumor segmentation in MRI is indispensable for treatment planning and outcome monitoring, yet models trained on curated benchmarks often fail under domain shifts arising from scanner and protocol variability as well as…

Computer Vision and Pattern Recognition · Computer Science 2025-09-23 Yuanhan Wang , Yifei Chen , Shuo Jiang , Wenjing Yu , Mingxuan Liu , Beining Wu , Jinying Zong , Feiwei Qin , Changmiao Wang , Qiyuan Tian

Multi-modal brain magnetic resonance imaging (MRI) plays a crucial role in clinical diagnostics by providing complementary information across different imaging modalities. However, a common challenge in clinical practice is missing MRI…

Image and Video Processing · Electrical Eng. & Systems 2025-06-04 Haowen Pang , Weiyan Guo , Chuyang Ye

In recent years, vision transformers have been introduced into face recognition and analysis and have achieved performance breakthroughs. However, most previous methods generally train a single model or an ensemble of models to perform the…

Computer Vision and Pattern Recognition · Computer Science 2023-08-23 Lixiong Qin , Mei Wang , Chao Deng , Ke Wang , Xi Chen , Jiani Hu , Weihong Deng

This paper presents a new vision Transformer, called Swin Transformer, that capably serves as a general-purpose backbone for computer vision. Challenges in adapting Transformer from language to vision arise from differences between the two…

Computer Vision and Pattern Recognition · Computer Science 2021-08-18 Ze Liu , Yutong Lin , Yue Cao , Han Hu , Yixuan Wei , Zheng Zhang , Stephen Lin , Baining Guo

It is well believed that Transformer performs better in semantic segmentation compared to convolutional neural networks. Nevertheless, the original Vision Transformer may lack of inductive biases of local neighborhoods and possess a high…

Computer Vision and Pattern Recognition · Computer Science 2022-08-04 Wentao Shi , Jing Xu , Pan Gao

Swin-Transformer has demonstrated remarkable success in computer vision by leveraging its hierarchical feature representation based on Transformer. In speech signals, emotional information is distributed across different scales of speech…

Computation and Language · Computer Science 2024-01-22 Yong Wang , Cheng Lu , Hailun Lian , Yan Zhao , Björn Schuller , Yuan Zong , Wenming Zheng

Structural magnetic resonance imaging (sMRI) provides accurate estimates of the brain's structural organization and learning invariant brain representations from sMRI is an enduring issue in neuroscience. Previous deep representation…

Computer Vision and Pattern Recognition · Computer Science 2023-06-21 Ning Jiang , Gongshu Wang , Tianyi Yan

Functional magnetic resonance imaging (fMRI) is a powerful tool for investigating human brain function. However, the high cost of data acquisition and the inherent subjectivity of psychiatric rating scales often lead to datasets with small…

Machine Learning · Computer Science 2026-05-29 Jiyao Wang , Peiyu Duan , Nicha C. Dvornek , Lawrence H. Staib , Denis Sukhodolsky , Pamela Ventola , James S. Duncan

Accurate estimation of biological brain age from three dimensional (3D) T$_1$-weighted magnetic resonance imaging (MRI) is a critical imaging biomarker for identifying accelerated aging associated with neurodegenerative diseases. Effective…

Image and Video Processing · Electrical Eng. & Systems 2025-08-05 Mehreen Kanwal , Yunsik Son

Transfer learning has gained attention in medical image analysis due to limited annotated 3D medical datasets for training data-driven deep learning models in the real world. Existing 3D-based methods have transferred the pre-trained models…

Computer Vision and Pattern Recognition · Computer Science 2021-04-29 Eunji Jun , Seungwoo Jeong , Da-Woon Heo , Heung-Il Suk

Current fMRI foundation models primarily rely on a limited range of brain states and mismatched pretraining tasks, restricting their ability to learn generalized representations across diverse brain states. We present \textit{Brain-DiT}, a…

Computer Vision and Pattern Recognition · Computer Science 2026-04-15 Junfeng Xia , Wenhao Ye , Xuanye Pan , Xinke Shen , Mo Wang , Quanying Liu

Spiking neural networks (SNNs) offer an energy-efficient alternative to conventional deep learning by emulating the event-driven processing manner of the brain. Incorporating Transformers with SNNs has shown promise for accuracy. However,…

Neural and Evolutionary Computing · Computer Science 2024-09-05 Yuetong Fang , Ziqing Wang , Lingfeng Zhang , Jiahang Cao , Honglei Chen , Renjing Xu

Unsupervised pre-training has emerged as a transformative paradigm, displaying remarkable advancements in various domains. However, the susceptibility to domain shift, where pre-training data distribution differs from fine-tuning, poses a…

Computer Vision and Pattern Recognition · Computer Science 2024-05-22 Abhiroop Talasila , Maitreya Maity , U. Deva Priyakumar

Automated fetal brain extraction from full-uterus MRI is a challenging task due to variable head sizes, orientations, complex anatomy, and prevalent artifacts. While deep-learning (DL) models trained on synthetic images have been successful…

Image and Video Processing · Electrical Eng. & Systems 2024-10-30 Javid Dadashkarimi , Valeria Pena Trujillo , Camilo Jaimes , Lilla Zöllei , Malte Hoffmann

Advancements in clinical Brain-Computer Interfaces (BCIs) depend on precise and reliable signal interpretation. However, the high-dimensional and noisy nature of data captured from both implanted and non-implanted BCIs poses significant…

Neurons and Cognition · Quantitative Biology 2026-05-20 Elena C Offenberg , Dirk Keller , Mariska J Vansteensel , Zachary V Freudenburg , Nick F Ramsey , Julia Berezutskaya

Finding an appropriate representation of dynamic activities in the brain is crucial for many downstream applications. Due to its highly dynamic nature, temporally averaged fMRI (functional magnetic resonance imaging) can only provide a…

Machine Learning · Computer Science 2022-08-18 Sikun Lin , Shuyun Tang , Scott Grafton , Ambuj Singh