English
Related papers

Related papers: SwiFT: Swin 4D fMRI Transformer

200 papers

Semantic information is vital for human interaction, and decoding it from brain activity enables non-invasive clinical augmentative and alternative communication. While there has been significant progress in reconstructing visual images,…

Computer Vision and Pattern Recognition · Computer Science 2024-06-13 Wanaiu Huang

In recent years, Vision Transformer-based approaches for low-level vision tasks have achieved widespread success. Unlike CNN-based models, Transformers are more adept at capturing long-range dependencies, enabling the reconstruction of…

Computer Vision and Pattern Recognition · Computer Science 2024-11-26 Chih-Chung Hsu , Chia-Ming Lee , Yi-Shiuan Chou

Understanding cognitive processes in major depressive disorder (MDD) often relies on behavioral tasks, which are typically analyzed separately, overlooking potential correlations and shared latent structure. To address this limitation, we…

Methodology · Statistics 2026-05-26 Yuan Bian , Yuanjia Wang , Xingche Guo

Current atlas-based approaches to brain network analysis rely heavily on standardized anatomical or connectivity-driven brain atlases. However, these fixed atlases often introduce significant limitations, such as spatial misalignment across…

Neurons and Cognition · Quantitative Biology 2026-02-27 Shuai Huang , Xuan Kan , James J. Lah , Deqiang Qiu

This paper presents the Sensorimotor Transformer (SMT), a vision model inspired by human saccadic eye movements that prioritize high-saliency regions in visual input to enhance computational efficiency and reduce memory consumption. Unlike…

Computer Vision and Pattern Recognition · Computer Science 2025-04-04 Konrad Gadzicki , Kerstin Schill , Christoph Zetzsche

Accurate segmentation of brain tumors from 3D multimodal MRI is vital for diagnosis and treatment planning across diverse brain tumors. This paper addresses the challenges posed by the BraTS 2023, presenting a unified transfer learning…

Image and Video Processing · Electrical Eng. & Systems 2024-12-12 Ramy A. Zeineldin , Franziska Mathis-Ullrich

Perfusion MRI (pMRI) offers valuable insights into tumor vascularity and promises to predict tumor genotypes, thus benefiting prognosis for glioma patients, yet effective models tailored to 4D pMRI are still lacking. This study presents the…

Image and Video Processing · Electrical Eng. & Systems 2024-06-11 Ruodan Yan , Carola-Bibiane Schönlieb , Chao Li

Autism spectrum disorder(ASD) is a lifelong neurodevelopmental condition that affects social communication and behavior. Investigating functional magnetic resonance imaging (fMRI)-based brain functional connectome can aid in the…

Neurons and Cognition · Quantitative Biology 2023-07-21 Anushree Bannadabhavi , Soojin Lee , Wenlong Deng , Xiaoxiao Li

Search-Based Software Testing (SBST) automates test input generation but is frequently hindered by challenging fitness landscapes characterized by numerous deceptive local optima that impede search progress, as well as extended plateaus…

Software Engineering · Computer Science 2026-04-13 Jeongjin Han , Seunghoon Sim , Jian Lee , Seongyoon Park

Brain aging involves structural and functional changes and therefore serves as a key biomarker for brain health. Combining structural magnetic resonance imaging (sMRI) and functional magnetic resonance imaging (fMRI) has the potential to…

Computer Vision and Pattern Recognition · Computer Science 2024-12-10 Abd Ur Rehman , Azka Rehman , Muhammad Usman , Abdullah Shahid , Sung-Min Gho , Aleum Lee , Tariq M. Khan , Imran Razzak

Understanding the hidden mechanisms behind human's visual perception is a fundamental question in neuroscience. To that end, investigating into the neural responses of human mind activities, such as functional Magnetic Resonance Imaging…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Yuankun Yang , Li Zhang , Ziyang Xie , Zhiyuan Yuan , Jianfeng Feng , Xiatian Zhu , Yu-Gang Jiang

Reconstructing visual information from brain activity via computer vision technology provides an intuitive understanding of visual neural mechanisms. Despite progress in decoding fMRI data with generative models, achieving accurate…

Computer Vision and Pattern Recognition · Computer Science 2025-10-23 Shiyi Zhang , Dong Liang , Yihang Zhou

The existing deep learning fusion methods mainly concentrate on the convolutional neural networks, and few attempts are made with transformer. Meanwhile, the convolutional operation is a content-independent interaction between the image and…

Computer Vision and Pattern Recognition · Computer Science 2022-04-26 Zhishe Wang , Yanlin Chen , Wenyu Shao , Hui Li , Lei Zhang

Prediction of the cognitive evolution of a person susceptible to develop a neurodegenerative disorder is crucial to provide an appropriate treatment as soon as possible. In this paper we propose a 3D siamese network designed to extract…

Image and Video Processing · Electrical Eng. & Systems 2019-09-04 Cecilia Ostertag , Marie Beurton-Aimar , Thierry Urruty

The computer-assisted radiologic informative report is currently emerging in dental practice to facilitate dental care and reduce time consumption in manual panoramic radiographic interpretation. However, the amount of dental radiographs…

Computer Vision and Pattern Recognition · Computer Science 2022-10-21 Amani Almalki , Longin Jan Latecki

As intensities of MRI volumes are inconsistent across institutes, it is essential to extract universal features of multi-modal MRIs to precisely segment brain tumors. In this concept, we propose a volumetric vision transformer that follows…

Image and Video Processing · Electrical Eng. & Systems 2022-09-19 Himashi Peiris , Munawar Hayat , Zhaolin Chen , Gary Egan , Mehrtash Harandi

Estimated brain age from magnetic resonance image (MRI) and its deviation from chronological age can provide early insights into potential neurodegenerative diseases, supporting early detection and implementation of prevention strategies.…

High-dimensional imaging of neural activity, such as widefield calcium and functional ultrasound imaging, provide a rich source of information for understanding the relationship between brain activity and behavior. Accurately modeling…

Neurons and Cognition · Quantitative Biology 2025-09-24 Mohammad Hosseini , Maryam M. Shanechi

Transfer learning can be seen as a data- and compute-efficient alternative to training models from scratch. The emergence of rich model repositories, such as TensorFlow Hub, enables practitioners and researchers to unleash the potential of…

Machine Learning · Computer Science 2022-09-29 Cedric Renggli , Xiaozhe Yao , Luka Kolar , Luka Rimanic , Ana Klimovic , Ce Zhang

Understanding how the brain's complex nonlinear dynamics give rise to cognitive function remains a central challenge in neuroscience. While brain functional dynamics exhibits scale-free and multifractal properties across temporal scales,…

Neurons and Cognition · Quantitative Biology 2025-06-18 Sangyoon Bae , Junbeom Kwon , Shinjae Yoo , Jiook Cha