English
Related papers

Related papers: Brain Harmony: A Multimodal Foundation Model Unify…

200 papers

This paper presents a novel approach towards creating a foundational model for aligning neural data and visual stimuli across multimodal representationsof brain activity by leveraging contrastive learning. We used electroencephalography…

Computer Vision and Pattern Recognition · Computer Science 2024-11-18 Matteo Ferrante , Tommaso Boccato , Grigorii Rashkov , Nicola Toschi

Multimodal brain magnetic resonance (MR) imaging is indispensable in neuroscience and neurology. However, due to the accessibility of MRI scanners and their lengthy acquisition time, multimodal MR images are not commonly available. Current…

Image and Video Processing · Electrical Eng. & Systems 2024-09-26 Yulin Wang , Honglin Xiong , Kaicong Sun , Shuwei Bai , Ling Dai , Zhongxiang Ding , Jiameng Liu , Qian Wang , Qian Liu , Dinggang Shen

Functional MRI (fMRI) is crucial for studying brain function and diagnosing neurological disorders. However, existing analysis methods suffer from reproducibility and transferability challenges due to complex preprocessing pipelines and…

Reconstructing perceived images from human brain activity forms a crucial link between human and machine learning through Brain-Computer Interfaces. Early methods primarily focused on training separate models for each individual to account…

Computer Vision and Pattern Recognition · Computer Science 2025-01-27 Zhibo Tian , Ruijie Quan , Fan Ma , Kun Zhan , Yi Yang

This study proposes a novel perspective on multimodal deep learning for biomedical signal classification, systematically analyzing how complementary feature domains impact model performance. While fusing multiple domains often presumes…

Machine Learning · Computer Science 2025-08-05 Timothy Oladunni , Alex Wong

Functional magnetic resonance imaging (fMRI) is widely used for studying and diagnosing brain disorders, with functional connectivity (FC) matrices providing powerful representations of large-scale neural interactions. However, existing…

Tissues and Organs · Quantitative Biology 2026-04-17 Qianyu Chen , Shujian Yu

Brain imaging analysis is fundamental in neuroscience, providing valuable insights into brain structure and function. Traditional workflows follow a sequential pipeline-brain extraction, registration, segmentation, parcellation, network…

Image and Video Processing · Electrical Eng. & Systems 2025-02-27 Yao Su , Keqi Han , Mingjie Zeng , Lichao Sun , Liang Zhan , Carl Yang , Lifang He , Xiangnan Kong

We present FOMO260K, a large-scale, heterogeneous dataset of 260,927 brain Magnetic Resonance Imaging (MRI) scans from 77,589 MRI sessions and 55,378 subjects, aggregated from 910 publicly available sources. The dataset includes both…

3D structural Magnetic Resonance Imaging (MRI) brain scans are commonly acquired in clinical settings to monitor a wide range of neurological conditions, including neurodegenerative disorders and stroke. While deep learning models have…

Computer Vision and Pattern Recognition · Computer Science 2025-09-16 Emily Kaczmarek , Justin Szeto , Brennan Nichyporuk , Tal Arbel

Multimodal magnetic resonance imaging (MRI) constitutes the first line of investigation for clinicians in the care of brain tumors, providing crucial insights for surgery planning, treatment monitoring, and biomarker identification.…

Computer Vision and Pattern Recognition · Computer Science 2025-08-26 Lucas Robinet , Ahmad Berjaoui , Elizabeth Cohen-Jonathan Moyal

Brain connectivity alternations associated with brain disorders have been widely reported in resting-state functional imaging (rs-fMRI) and diffusion tensor imaging (DTI). While many dual-modal fusion methods based on graph neural networks…

Computer Vision and Pattern Recognition · Computer Science 2024-11-14 Feiyu Yin , Yu Lei , Siyuan Dai , Wenwen Zeng , Guoqing Wu , Liang Zhan , Jinhua Yu

Combining Functional MRI (fMRI) data across different subjects and datasets is crucial for many neuroscience tasks. Relying solely on shared anatomy for brain-to-brain mapping is inadequate. Existing functional transformation methods thus…

Neurons and Cognition · Quantitative Biology 2025-03-18 Navve Wasserman , Roman Beliy , Roy Urbach , Michal Irani

Accurate cortical surface reconstruction from magnetic resonance imaging (MRI) data is crucial for reliable neuroanatomical analyses. Current methods have to contend with complex cortical geometries, strict topological requirements, and…

Image and Video Processing · Electrical Eng. & Systems 2025-10-22 Kaveh Moradkhani , R Jarrett Rushmore , Sylvain Bouix

Recent advances in deep learning have made it possible to predict phenotypic measures directly from functional magnetic resonance imaging (fMRI) brain volumes, sparking significant interest in the neuroimaging community. However, existing…

Computer Vision and Pattern Recognition · Computer Science 2025-07-01 Arunkumar Kannan , Martin A. Lindquist , Brian Caffo

We address prevailing challenges of the brain-powered research, departing from the observation that the literature hardly recover accurate spatial information and require subject-specific models. To address these challenges, we propose…

Computer Vision and Pattern Recognition · Computer Science 2024-07-19 Weihao Xia , Raoul de Charette , Cengiz Öztireli , Jing-Hao Xue

Multimodal neuroimages, such as diffusion tensor imaging (DTI) and resting-state functional MRI (fMRI), offer complementary perspectives on brain activities by capturing structural or functional interactions among brain regions. While…

Machine Learning · Computer Science 2025-07-08 Meimei Yang , Yongheng Sun , Qianqian Wang , Andrea Bozoki , Maureen Kohi , Mingxia Liu

In MRI, images of the same contrast (e.g., T$_1$) from the same subject can exhibit noticeable differences when acquired using different hardware, sequences, or scan parameters. These differences in images create a domain gap that needs to…

Image and Video Processing · Electrical Eng. & Systems 2023-08-17 Hwihun Jeong , Heejoon Byun , Dong Un Kang , Jongho Lee

This study presents a new high-fidelity multi-modal dataset containing 16000+ geometric variants of automotive hoods useful for machine learning (ML) applications such as engineering component design and process optimization, and…

Machine Learning · Computer Science 2025-11-11 Vansh Sharma , Harish Jai Ganesh , Maryam Akram , Wanjiao Liu , Venkat Raman

With the wide adoption of functional magnetic resonance imaging (fMRI) by cognitive neuroscience researchers, large volumes of brain imaging data have been accumulated in recent years. Aggregating these data to derive scientific insights…

Applications · Statistics 2020-06-01 Ming Bo Cai , Michael Shvartsman , Anqi Wu , Hejia Zhang , Xia Zhu

Multimodal medical image fusion helps in combining contrasting features from two or more input imaging modalities to represent fused information in a single image. One of the pivotal clinical applications of medical image fusion is the…

Image and Video Processing · Electrical Eng. & Systems 2019-09-20 Nishant Kumar , Nico Hoffmann , Martin Oelschlägel , Edmund Koch , Matthias Kirsch , Stefan Gumhold