English
Related papers

Related papers: Brain Foundation Models with Hypergraph Dynamic Ad…

200 papers

Ultrasound (US) video segmentation remains a challenging problem due to strong inter- and intra-dataset variability, motion artifacts, and limited annotated data. Although foundation models such as Segment Anything Model 2 (SAM2)…

Computer Vision and Pattern Recognition · Computer Science 2025-11-11 Xing Yao , Ahana Gangopadhyay , Hsi-Ming Chang , Ravi Soni

Recently, the application of deep learning models to diagnose neuropsychiatric diseases from brain imaging data has received more and more attention. However, in practice, exploring interactions in brain functional connectivity based on…

Machine Learning · Computer Science 2022-06-29 Sartaj Ahmed Salman , Zhichao Lian , Milad Taleby Ahvanooey , Hiroki Takahashi , Yuduo Zhang

Foundation models are emerging as a powerful paradigm for fMRI analysis, but current approaches face a dual bottleneck of data- and training-efficiency. Atlas-based methods aggregate voxel signals into fixed regions of interest, reducing…

Computer Vision and Pattern Recognition · Computer Science 2026-02-02 Mo Wang , Junfeng Xia , Wenhao Ye , Enyu Liu , Kaining Peng , Jianfeng Feng , Quanying Liu , Hongkai Wen

Generative AI framework-based modeling and prediction of longitudinal human brain images offer an efficient mechanism to track neurodegenerative progression, essential for the assessment of diseases like Alzheimer's. Among the existing…

Computer Vision and Pattern Recognition · Computer Science 2026-03-03 Ayantika Das , Keerthi Ram , Mohanasankar Sivaprakasam

Despite achieving impressive results in general-purpose semantic segmentation with strong generalization on natural images, the Segment Anything Model (SAM) has shown less precision and stability in medical image segmentation. In…

Image and Video Processing · Electrical Eng. & Systems 2024-11-08 Sekeun Kim , Pengfei Jin , Cheng Chen , Kyungsang Kim , Zhiliang Lyu , Hui Ren , Sunghwan Kim , Zhengliang Liu , Aoxiao Zhong , Tianming Liu , Xiang Li , Quanzheng Li

Image registration is a fundamental task in medical image analysis. Deformations are often closely related to the morphological characteristics of tissues, making accurate feature extraction crucial. Recent weakly supervised methods improve…

Computer Vision and Pattern Recognition · Computer Science 2025-09-18 Yue He , Min Liu , Qinghao Liu , Jiazheng Wang , Yaonan Wang , Hang Zhang , Xiang Chen

Foundation models (FMs) have emerged as a transformative paradigm in medical image analysis, offering the potential to provide generalizable, task-agnostic solutions across a wide range of clinical tasks and imaging modalities. Their…

Computer Vision and Pattern Recognition · Computer Science 2025-11-04 Karma Phuntsho , Abdullah , Kyungmi Lee , Ickjai Lee , Euijoon Ahn

Accurate segmentation of neural structures in Electron Microscopy (EM) images is paramount for neuroscience. However, this task is challenged by intricate morphologies, low signal-to-noise ratios, and scarce annotations, limiting the…

Computer Vision and Pattern Recognition · Computer Science 2025-11-18 Zhenghua Li , Hang Chen , Zihao Sun , Kai Li , Xiaolin Hu

Accurate hyperspectral image (HSI) interpretation is critical for providing valuable insights into various earth observation-related applications such as urban planning, precision agriculture, and environmental monitoring. However, existing…

Autism spectrum disorder (ASD) is a complex neurodevelopmental condition characterized by atypical functional brain connectivity and subtle structural alterations. rs-fMRI has been widely used to identify disruptions in large-scale brain…

Computer Vision and Pattern Recognition · Computer Science 2026-03-17 Ansar Rahman , Hassan Shojaee-Mend , Sepideh Hatamikia

As large language models (LLMs) continue to revolutionize AI research, there is a growing interest in building large-scale brain foundation models to advance neuroscience. While most existing brain foundation models are pre-trained on…

Neurons and Cognition · Quantitative Biology 2026-02-11 Xinxu Wei , Kanhao Zhao , Yong Jiao , Lifang He , Yu Zhang

The Segment Anything Model (SAM) represents a state-of-the-art research advancement in natural image segmentation, achieving impressive results with input prompts such as points and bounding boxes. However, our evaluation and recent…

Computer Vision and Pattern Recognition · Computer Science 2023-08-31 Junlong Cheng , Jin Ye , Zhongying Deng , Jianpin Chen , Tianbin Li , Haoyu Wang , Yanzhou Su , Ziyan Huang , Jilong Chen , Lei Jiang , Hui Sun , Junjun He , Shaoting Zhang , Min Zhu , Yu Qiao

Current medical vision-language models (VLMs) process volumetric brain MRI using 2D slice-based approximations, fragmenting the spatial context required for accurate neuroradiological interpretation. We developed \textbf{Brain3D}, a staged…

Computer Vision and Pattern Recognition · Computer Science 2026-02-26 Mariano Barone , Francesco Di Serio , Giuseppe Riccio , Antonio Romano , Marco Postiglione , Antonino Ferraro , Vincenzo Moscato

Understanding how the brain's complex nonlinear dynamics give rise to cognitive function remains a central challenge in neuroscience. While brain functional dynamics exhibits scale-free and multifractal properties across temporal scales,…

Neurons and Cognition · Quantitative Biology 2025-06-18 Sangyoon Bae , Junbeom Kwon , Shinjae Yoo , Jiook Cha

Fusing structural-functional images of the brain has shown great potential to analyze the deterioration of Alzheimer's disease (AD). However, it is a big challenge to effectively fuse the correlated and complementary information from…

Image and Video Processing · Electrical Eng. & Systems 2023-10-06 Qiankun Zuo , Junren Pan , Shuqiang Wang

The rapid rise of large-scale foundation models has reshaped the landscape of image segmentation, with models such as Segment Anything achieving unprecedented versatility across diverse vision tasks. However, previous generations-including…

Computer Vision and Pattern Recognition · Computer Science 2025-11-25 Tianrun Chen , Runlong Cao , Xinda Yu , Lanyun Zhu , Chaotao Ding , Deyi Ji , Cheng Chen , Qi Zhu , Chunyan Xu , Papa Mao , Ying Zang

Medical vision-language models (Med-VLMs) have shown impressive results in tasks such as report generation and visual question answering, but they still face several limitations. Most notably, they underutilize patient metadata and lack…

Computer Vision and Pattern Recognition · Computer Science 2025-10-16 Fangqi Cheng , Surajit Ray , Xiaochen Yang

Neural dynamics underlie behaviors from memory to sleep, yet identifying mechanisms for higher-order phenomena (e.g., social interaction) is experimentally challenging. Existing whole-brain models often fail to scale to single-neuron…

Neurons and Cognition · Quantitative Biology 2025-11-03 Sam Fatehmanesh Vegas , Matt Thomson , James Gornet , David Prober

Brain connectivity alternations associated with brain disorders have been widely reported in resting-state functional imaging (rs-fMRI) and diffusion tensor imaging (DTI). While many dual-modal fusion methods based on graph neural networks…

Computer Vision and Pattern Recognition · Computer Science 2024-11-14 Feiyu Yin , Yu Lei , Siyuan Dai , Wenwen Zeng , Guoqing Wu , Liang Zhan , Jinhua Yu

Recent advancements in the acquisition of various brain data sources have created new opportunities for integrating multimodal brain data to assist in early detection of complex brain disorders. However, current data integration approaches…

Image and Video Processing · Electrical Eng. & Systems 2023-05-26 Reza Shirkavand , Liang Zhan , Heng Huang , Li Shen , Paul M. Thompson