English
Related papers

Related papers: Brain Harmony: A Multimodal Foundation Model Unify…

200 papers

Functional magnetic resonance imaging (fMRI) is a neuroimaging technique that records neural activations in the brain by capturing the blood oxygen level in different regions based on the task performed by a subject. Given fMRI data, the…

Computer Vision and Pattern Recognition · Computer Science 2021-09-21 Ashish Jaiswal , Ashwin Ramesh Babu , Mohammad Zaki Zadeh , Fillia Makedon , Glenn Wylie

Cognitive neuroscience is enjoying rapid increase in extensive public brain-imaging datasets. It opens the door to large-scale statistical models. Finding a unified perspective for all available data calls for scalable and automated…

Machine Learning · Statistics 2019-05-16 Arthur Mensch , Julien Mairal , Danilo Bzdok , Bertrand Thirion , Gaël Varoquaux

At this moment, databanks worldwide contain brain images of previously unimaginable numbers. Combined with developments in data science, these massive data provide the potential to better understand the genetic underpinnings of brain…

Machine Learning · Statistics 2025-01-30 Santiago Silva , Boris Gutman , Eduardo Romero , Paul M Thompson , Andre Altmann , Marco Lorenzi

There are multiple scales of abstraction from which we can describe the same image, depending on whether we are focusing on fine-grained details or a more global attribute of the image. In brain mapping, learning to automatically parse…

Multimodal deep learning harnesses diverse imaging modalities, such as MRI sequences, to enhance diagnostic accuracy in medical imaging. A key challenge is determining the optimal timing for integrating these modalities-specifically,…

Computer Vision and Pattern Recognition · Computer Science 2026-02-16 Valerio Guarrasi , Klara Mogensen , Sara Tassinari , Sara Qvarlander , Paolo Soda

Although developed functional magnetic resonance imaging (fMRI) registration algorithms based on deep learning have achieved a certain degree of alignment of functional area, they underutilized fine structural information. In this paper, we…

Image and Video Processing · Electrical Eng. & Systems 2024-09-27 Baolong Li , Yuhu Shi , Lei Wang , Weiming Zeng , Changming Zhu

This paper asks whether integrating multimodal EEG and fMRI data offers a better characterisation of functional brain architectures than either modality alone. This evaluation rests upon a dynamic causal model that generates both EEG and…

Quantitative Methods · Quantitative Biology 2019-06-19 Huilin Wei , Amirhossein Jafarian , Peter Zeidman , Vladimir Litvak , Adeel Razi , Dewen Hu , Karl J. Friston

Decoding brain states from functional magnetic resonance imaging (fMRI) data is vital for advancing neuroscience and clinical applications. While traditional machine learning and deep learning approaches have made strides in leveraging the…

Machine Learning · Computer Science 2025-12-10 Danial Jafarzadeh Jazi , Maryam Hajiesmaeili

Mental disorders are among the foremost contributors to the global healthcare challenge. Research indicates that timely diagnosis and intervention are vital in treating various mental disorders. However, the early somatization symptoms of…

Computer Vision and Pattern Recognition · Computer Science 2024-09-05 Yichun Li , Shuanglin Li , Syed Mohsen Naqvi

Functional and structural connectivity (FC/SC) are key multimodal biomarkers for brain analysis, yet their clinical utility is hindered by costly acquisition, complex preprocessing, and frequent missing modalities. Existing foundation…

Neurons and Cognition · Quantitative Biology 2025-11-11 Xiongri Shen , Jiaqi Wang , Yi Zhong , Zhenxi Song , Leilei Zhao , Liling Li , Yichen Wei , Lingyan Liang , Shuqiang Wang , Baiying Lei , Demao Deng , Zhiguo Zhang

Recent studies have shown that multi-modeling methods can provide new insights into the analysis of brain components that are not possible when each modality is acquired separately. The joint representations of different modalities is a…

Neurons and Cognition · Quantitative Biology 2022-01-24 Jalal Mirakhorli

Recent achievements in implantable brain-computer interfaces (iBCIs) have demonstrated the potential to decode cognitive and motor behaviors with intracranial brain recordings; however, individual physiological and electrode implantation…

Neurons and Cognition · Quantitative Biology 2025-06-17 Di Wu , Linghao Bu , Yifei Jia , Lu Cao , Siyuan Li , Siyu Chen , Yueqian Zhou , Sheng Fan , Wenjie Ren , Dengchang Wu , Kang Wang , Yue Zhang , Yuehui Ma , Jie Yang , Mohamad Sawan

Multi-modal MRIs are widely used in neuroimaging applications since different MR sequences provide complementary information about brain structures. Recent works have suggested that multi-modal deep learning analysis can benefit from…

Computer Vision and Pattern Recognition · Computer Science 2021-06-14 Jiahong Ouyang , Ehsan Adeli , Kilian M. Pohl , Qingyu Zhao , Greg Zaharchuk

Multimodal MRI provides complementary and clinically relevant information to probe tissue condition and to characterize various diseases. However, it is often difficult to acquire sufficiently many modalities from the same subject due to…

Image and Video Processing · Electrical Eng. & Systems 2021-06-08 Xiaofeng Liu , Fangxu Xing , Georges El Fakhri , Jonghye Woo

The connectional brain template (CBT) captures the shared traits across all individuals of a given population of brain connectomes, thereby acting as a fingerprint. Estimating a CBT from a population where brain graphs are derived from…

Neurons and Cognition · Quantitative Biology 2022-09-28 Ece Cinar , Sinem Elif Haseki , Alaa Bessadok , Islem Rekik

The incorporation of neuroimaging techniques such as electroenchephalography (EEG) and functional near-infrared spectroscopy (fNIRS) has provided new opportunities for the analysis of dynamic brain processes involved in cognitive and motor…

Neurons and Cognition · Quantitative Biology 2026-03-25 Zaineb Ajra , Grégoire Vergotte , Stéphane Perrey , Lilian Evra , Simon Pla , Gérard Dray , Jacky Montmain , Binbin Xu

Vision science, particularly machine vision, has been revolutionized by introducing large-scale image datasets and statistical learning approaches. Yet, human neuroimaging studies of visual perception still rely on small numbers of images…

Neurons and Cognition · Quantitative Biology 2020-01-23 Nadine Chang , John A. Pyles , Abhinav Gupta , Michael J. Tarr , Elissa M. Aminoff

Resting-state functional magnetic resonance imaging (rs-fMRI) can reflect spontaneous neural activities in brain and is widely used for brain disorder analysis.Previous studies propose to extract fMRI representations through diverse…

Quantitative Methods · Quantitative Biology 2023-06-27 Qianqian Wang , Wei Wang , Yuqi Fang , P. -T. Yap , Hongtu Zhu , Hong-Jun Li , Lishan Qiao , Mingxia Liu

Computer-aided diagnosis (CAD) systems play a crucial role in analyzing neuroimaging data for neurological and psychiatric disorders. However, small-sample studies suffer from low reproducibility, while large-scale datasets introduce…

Machine Learning · Computer Science 2025-08-12 Xinglin Zhao , Yanwen Wang , Xiaobo Liu , Yanrong Hao , Rui Cao , Xin Wen

Retrospective MRI harmonization is limited by poor scalability across modalities and reliance on traveling subject datasets. To address these challenges, we introduce IHF-Harmony, a unified invertible hierarchy flow framework for…

Computer Vision and Pattern Recognition · Computer Science 2026-05-18 Pengli Zhu , Yitao Zhu , Haowen Pang , Anqi Qiu